SPRKPY1050
pyspark.conf.SparkConf.set
Last updated
pyspark.conf.SparkConf.set
Last updated
Message: pyspark.conf.SparkConf.set has a workaround
Category: Warning.
This issue appears when the tool detects the usage of which has a workaround.
Input
Below is an example that sets a variable using conf.set
.
Output
The tool adds the EWI SPRKPY1050
indicating that a workaround can be implemented.
Recommended fix
SparkConf.set is used to set a configuration setting only used by Pyspark and doesn't apply to Snowpark. You can remove or comment on the code
For more support, you can email us at or post an issue .