SPRKPY1034

pyspark.sql.functions.desc has a workaround

Category

Warning.

Description

This issue appears when the tool detects the usage of pyspark.sql.functions.desc which has a workaround.

Note: This workaround is deprecated because a later tool version supports the desc snowflake function as direct.

Input code:

df.orderBy(desc(col))
df.orderBy(desc("colName"))

Output code:

#EWI: SPRKPY1034 => pyspark.sql.functions.desc has a workaround, see documentation for more info
df.orderBy(desc(col))
#EWI: SPRKPY1034 => pyspark.sql.functions.desc has a workaround, see documentation for more info
df.orderBy(desc("colName"))

Scenarios

This function has two overloads:

1. desc(col: Column)

Action: use instead com.snowflake.snowpark.Column.desc function, by applying it to the column parameter. For example:

df.orderBy(col.asc())

2. desc(colName: str)

Action: use instead com.snowflake.snowpark.Column.desc function, by converting the parameter string into a column (by using col function) and then applying desc to it. For example:

df.orderBy(col("colName").desc())

Recommendation

• For more support, you can email us at [email protected]. If you have a contract for support with Snowflake, reach out to your sales engineer and they can direct your support needs.