SPRKPY1005

pyspark.conf.SparkConf is not required

Category

Warning.

Description

This issue appears when the tool detects the usage of pyspark.conf.SparkConf which is not required.

Input code:

from pyspark import SparkConf

my_conf = SparkConf(loadDefaults=True)

Output code:

#EWI: SPRKPY1005 => pyspark.conf.SparkConf is not required
#from pyspark import SparkConf
pass

#EWI: SPRKPY1005 => pyspark.conf.SparkConf is not required
my_conf = Session.builder.configs({"user" : "my_user", "password" : "my_password", "account" : "my_account", "role" : "my_role", "warehouse" : "my_warehouse", "database" : "my_database", "schema" : "my_schema"}).create()

Recommendation

• This is an unnecessary parameter being removed with a warning comment being inserted. There should be no action from the user.

• For more support, you can email us at [e-mail]. If you have a contract for support with Snowflake, reach out to your your account representative.