search
SnowflakeDocumentation Home

SPRKSCL1103

Spark session builder method is not supported.

hashtag
Description

This issue appears when the tool detecs the usage of spark session builder method is not supported.

hashtag
Not supported spark session builder methods:

  • master

  • appName

  • enableHiveSupport

  • withExtensions

hashtag
Input Code: 

val spark = SparkSession.builder()
           .master("local")
           .appName("testApp")
           .config("spark.sql.broadcastTimeout", "3600")
           .enableHiveSupport()
           .getOrCreate()

hashtag
Output Code: 

val spark = Session.builder.configFile("connection.properties")
/*EWI: SPRKSCL1103 => SparkBuilder Method is not supported .master("local")*/
/*EWI: SPRKSCL1103 => SparkBuilder Method is not supported .appName("testApp")*/
/*EWI: SPRKSCL1104 => SparkBuilder Option is not supported .config("spark.sql.broadcastTimeout", "3600")*/
/*EWI: SPRKSCL1103 => SparkBuilder method is not supported .enableHiveSupport()*/
.create

hashtag
Recommendation

  • For more support, you can email us at [email protected]envelope. If you have a contract for support with Snowflake, reach out to your sales engineer and they can direct your support needs.

PreviousSPRKSCL1102NextSPRKSCL1104