search
SnowflakeDocumentation Home

SPRKSCL1104

Spark session builder option is not supported

hashtag
Description

This issue appears when the tool detecs the usage of spark session builder option is not supported.

hashtag
Not supported spark ssesion builder options:

  • Config

hashtag
Input Code: 

val spark = SparkSession.builder()
           .master("local")
           .appName("testApp")
           .config("spark.sql.broadcastTimeout", "3600")
           .getOrCreate()

hashtag
Output Code: 

val spark = Session.builder.configFile("connection.properties")
/*EWI: SPRKSCL1103 => SparkBuilder Method is not supported .master("local")*/
/*EWI: SPRKSCL1103 => SparkBuilder Method is not supported .appName("testApp")*/
/*EWI: SPRKSCL1104 => SparkBuilder Option is not supported .config("spark.sql.broadcastTimeout", "3600")*/
.create()

hashtag
Recommendation

  • For more support, you can email us at [email protected]envelope. If you have a contract for support with Snowflake, reach out to your sales engineer and they can direct your support needs.

PreviousSPRKSCL1103NextSPRKSCL1105