SPRKSCL1122

org.apache.spark.sql.functions.corr has a workaround.

Description

This issue appears when the tool detects the usage of org.apache.spark.sql.functions.corr which has a workaround.

Input code

val result = corr("columnName1", "columnName2")

Output code

/*EWI: SPRKSCL1122 => org.apache.spark.sql.functions.corr has a workaround, see documentation for more info*/
val result = corr("columnName1", "columnName2")

Scenarios

This function has two overloads.

1. corr(column1: Column, column2: Column)

Action: does not need any change.

2. corr(columnName1: String, columnName2: String)

Action: convert the params to Column type using the com.snowflake.snowpark.functions.col function. For example:

val result = corr(col("columnName1"), col("columnName2"))

Recommendation

For more support, you can email us at [email protected]. If you have a contract for support with Snowflake, reach out to your sales engineer and they can direct your support needs.

PreviousSPRKSCL1121 NextSPRKSCL1123