Spark Scala
In this section, you will find information about Errors, Warnings, and Issues on the ApacheSpark Scala
Issue Codes
Parsing errors, conversion exceptions caused by ApacheSpark Scala. The user should contact to us (sma-support@snowflake.com) to fix the issue.
| Code | Description | Category | Deprecated since |
|---|---|---|---|
Not supported spark version. | Warning | - | |
File with parsing errors. | Parsing error | - | |
Repartition is not supported | Conversion error | ||
Broadcast is not supported | Conversion error | ||
Explode is not supported | Conversion error | ||
Spark session builder method is not supported | Conversion error | ||
Spark session builder option is not supported | Conversion error | ||
Writer format value is not supported | Conversion error | ||
Writer option is not supported | Conversion error | ||
Writer method is not supported | Conversion error | ||
Reader format value is not supported | Conversion error | ||
Reader option is not supported | Conversion error | ||
Reader method is not supported | Conversion error | ||
CreateDecimalType is not supported | Conversion error | ||
Element is not supported | Conversion error | - | |
org.apache.spark.sql.functions.next_day has a workaround | Warning | - | |
org.apache.spark.sql.functions.repeat has a workaround | Warning | - | |
org.apache.spark.sql.functions.round has a workaround | Warning | ||
org.apache.spark.sql.functions.split has a workaround | Warning | ||
org.apache.spark.sql.functions.translate has a workaround | Warning | ||
org.apache.spark.sql.functions.trunc has a workaround | Warning | - | |
org.apache.spark.sql.Column.endsWith has a workaround | Warning | - | |
org.apache.spark.sql.functions.asin has a workaround | Warning | - | |
org.apache.spark.sql.functions.atan has a workaround | Warning | - | |
org.apache.spark.sql.functions.corr has a workaround | Warning | - | |
org.apache.spark.sql.functions.cos has a workaround | Warning | - | |
org.apache.spark.sql.functions.cosh has a workaround | Warning | - | |
org.apache.spark.sql.functions.count has a workaround | Warning | ||
org.apache.spark.sql.functions.covar_pop has a workaround | Warning | - | |
org.apache.spark.sql.functions.covar_samp has a workaround | Warning | - | |
org.apache.spark.sql.functions.exp has a workaround | Warning | - | |
org.apache.spark.sql.functions.floor has a workaround | Warning | - | |
org.apache.spark.sql.functions.greatest has a workaround | Warning | - | |
org.apache.spark.sql.functions.grouping has a workaround | Warning | - | |
org.apache.spark.sql.functions.grouping_id has a workaround | Warning | - | |
org.apache.spark.sql.functions.least has a workaround | Warning | - | |
org.apache.spark.sql.functions.log has a workaround | Warning | - | |
org.apache.spark.sql.functions.mean has a workaround | Warning | ||
org.apache.spark.sql.functions.min has a workaround | Warning | ||
org.apache.spark.sql.functions.sin has a workaround | Warning | - | |
org.apache.spark.sql.functions.sinh has a workaround | Warning | - | |
org.apache.spark.sql.functions.sqrt has a workaround | Warning | - | |
org.apache.spark.sql.functions.stddev has a workaround | Warning | - | |
org.apache.spark.sql.functions.stddev_pop has a workaround | Warning | - | |
Element is not defined | Conversion error | - | |
An error occurred when loading the symbol table | Conversion error | - | |
The symbol table could not be loaded | Parsing error | - | |
org.apache.spark.sql.functions.sumDistinct has a workaround | Warning | - | |
org.apache.spark.sql.functions.tan has a workaround | Warning | - | |
org.apache.spark.sql.functions.tanh has a workaround | Warning | - | |
org.apache.spark.sql.functions.toDegrees has a workaround | Warning | - | |
org.apache.spark.sql.functions.toRadians has a workaround | Warning | - | |
org.apache.spark.sql.functions.var_pop has a workaround | Warning | - | |
org.apache.spark.sql.functions.var_samp has a workaround | Warning | - | |
org.apache.spark.sql.functions.variance has a workaround | Warning | - | |
org.apache.spark.sql.functions.max has a workaround | Warning | ||
org.apache.spark.sql.functions.ceil has a workaround | Warning | - | |
org.apache.spark.sql.functions.countDistinct has a workaround | Warning | ||
org.apache.spark.sql.functions.degrees has a workaround | Warning | - | |
org.apache.spark.sql.functions.kurtosis has a workaround | Warning | - | |
org.apache.spark.sql.functions.skewness has a workaround | Warning | - | |
org.apache.spark.sql.functions.stddev_samp has a workaround | Warning | - | |
org.apache.spark.sql.functions.sum has a workaround | Warning | - | |
Failed to add dependency | Conversion error | - | |
Element is not a literal. | Warning | - | |
Parameter is not supported for reader option. | Conversion error | ||
Reader format on DataFrameReader is undefined. | Warning | - | |
Parameter is not supported for reader format. | Conversion error | ||
Project file not found. | Warning | - | |
Spark element with a given argument is not supported. | Warning | - | |
Spark element is missing on the method chaining. | Warning | - | |
The single-parameter udf function is supported in Snowpark but it might require manual intervention. | Warning | - | |
The two-parameter udf function is not supported in Snowpark. | Conversion error | - |
Last updated