SPRKSCL1103

Spark session builder method is not supported.

Description

This issue appears when the tool detecs the usage of spark session builder method is not supported.

Not supported spark session builder methods:

• master

• appName

• enableHiveSupport

• withExtensions

Input Code:

val spark = SparkSession.builder()
           .master("local")
           .appName("testApp")
           .config("spark.sql.broadcastTimeout", "3600")
           .enableHiveSupport()
           .getOrCreate()

Output Code:

val spark = Session.builder.configFile("connection.properties")
/*EWI: SPRKSCL1103 => SparkBuilder Method is not supported .master("local")*/
/*EWI: SPRKSCL1103 => SparkBuilder Method is not supported .appName("testApp")*/
/*EWI: SPRKSCL1104 => SparkBuilder Option is not supported .config("spark.sql.broadcastTimeout", "3600")*/
/*EWI: SPRKSCL1103 => SparkBuilder method is not supported .enableHiveSupport()*/
.create

Recommendation

• For more support, you can email us at [e-mail]. If you have a contract for support with Snowflake, reach out to your sales engineer and they can direct your support needs.