SPRKPY1000

Not supported spark version

Message: Source project spark-core version is xx.xx:xx.x.x, the spark-core version supported by snowpark is 2.12:3.1.2 so there may be functional differences between the existing mappings.

Category: Warning.

Description

This issue appears when the Pyspark version of your source code is not supported. This means that there may be functional differences between the existing mappings.

Additional recommendations

  • The pyspark version scanned by the SMA for compatibility to Snowpark is from 2.12 to 3.1.2. If you are using a version outside this range, the tool may produce inconsistent results. You could alter the version of the source code you are scanning.

  • For more support, you can email us at [email protected]envelope or post an issue in the SMAarrow-up-right.

Last updated