SPRKPY1046

pyspark.sql.functions.monotonically_increasing_id has workaround

Description

This issue appears when the tool detects the usage of pyspark.sql.functions.monotonically_increasing_id which has a workaround. Note: This workaround is deprecated because a later tool version supports this function.

Input code:

df.select(monotonically_increasing_id()) 

Output code:

#EWI: SPRKPY1045 => pyspark.sql.functions.map_values has a workaround, see documentation for more info
df.select(monotonically_increasing_id())

Scenario

monotonically_increasing_id() -> pyspark.sql.column.Column

Action: Update the tool version.

df.select(monotonically_increasing_id())

Recommendation

  • For more support, you can email us at snowconvert-info@snowflake.com. If you have a contract for support with Snowflake, reach out to your sales engineer and they can direct your support needs.

Last updated

#332: [SIT-1562] SQL Readiness

Change request updated