SPRKSCL1134
org.apache.spark.sql.functions.log has a workaround.
Description
This issue appears when the tool detects the usage of org.apache.spark.sql.functions.log which has a workaround.
Input code
val result = log(5, "columnName1")
Output code
/*EWI: SPRKSCL1134 => org.apache.spark.sql.functions.log has a workaround, see documentation for more info*/
val result = log(5, "columnName1")
Scenarios
This function has four overloads.
1. log(e: Column)
Action: does not need any change, becuse is not supported by Snowpark.
2. log(columnName: String)
Action: does not need any change, becuse is not supported by Snowpark.
3. log(base: Double, a: Column)
Action: convert the param to Column type using the com.snowflake.snowpark.functions.col function. For example:
val result = log(col(5), someColumn)
4. log(base: Double, columnName: String)
Action: convert the params to Column type using the com.snowflake.snowpark.functions.col function. For example:
val result = log(col(5), col("columnName1"))
Recommendation
For more support, you can email us at [email protected]. If you have a contract for support with Snowflake, reach out to your sales engineer and they can direct your support needs.