SPRKSCL1152

org.apache.spark.sql.functions.variance has a workaround.

Description

This issue appears when the tool detects the usage of org.apache.spark.sql.functions.variance which has a workaround.

Input code

val result = variance("columnName")

Output code

/*EWI: SPRKSCL1152 => org.apache.spark.sql.functions.variance has a workaround, see documentation for more info*/
val result = variance("columnName")

Scenarios

This function has two overloads.

1. variance(e: Column)

Action: does not need any change.

2. variance(columnName: String)

Action: convert the param to Column type using the com.snowflake.snowpark.functions.col function. For example:

val result = variance(col("columnName"))

Recommendation

• For more support, you can email us at [email protected]. If you have a contract for support with Snowflake, reach out to your sales engineer and they can direct your support needs.