SPRKSCL1116

org.apache.spark.sql.functions.split has a workaround.

Description

This issue appears when the tool detects the usage of org.apache.spark.sql.functions.split which has a workaround.

Input code

val result = split(someColumn, "[ABC]", 5)

Output code

/*EWI: SPRKSCL1116 => org.apache.spark.sql.functions.split has a workaround, see documentation for more info*/
val result = split(someColumn, "[ABC]", 5)

Scenarios

This function has two overloads.

1. split(str: Column, pattern: String)

Action: convert the second param to Column type using the com.snowflake.snowpark.functions.col function. For example:

val result = split(someColumn, col("[ABC]"))

2. split(str: Column, pattern: String, limit: Int)

Action: convert the second and third param to Column type using the com.snowflake.snowpark.functions.col function. For example:

val result = split(someColumn, col("[ABC]"), col(5))

Recommendation

• For more support, you can email us at [email protected]. If you have a contract for support with Snowflake, reach out to your sales engineer and they can direct your support needs.