Spark Scala

In this section, you will find information about Errors, Warnings, and Issues on the ApacheSpark Scala

Issue Codes

Parsing errors, conversion exceptions caused by ApacheSpark Scala. The user should contact to us (sma-support@snowflake.com) to fix the issue.

Code
Description
Category
Deprecated since

Not supported spark version.

Warning

-

File with parsing errors.

Parsing error

-

Repartition is not supported

Conversion error

Broadcast is not supported

Conversion error

Explode is not supported

Conversion error

Spark session builder method is not supported

Conversion error

Spark session builder option is not supported

Conversion error

Writer format value is not supported

Conversion error

Writer option is not supported

Conversion error

Writer method is not supported

Conversion error

Reader format value is not supported

Conversion error

Reader option is not supported

Conversion error

Reader method is not supported

Conversion error

CreateDecimalType is not supported

Conversion error

Function is not supported

Conversion error

-

org.apache.spark.sql.functions.next_day has a workaround

Warning

-

org.apache.spark.sql.functions.repeat has a workaround

Warning

-

org.apache.spark.sql.functions.round has a workaround

Warning

-

org.apache.spark.sql.functions.split has a workaround

Warning

-

org.apache.spark.sql.functions.translate has a workaround

Warning

-

org.apache.spark.sql.functions.trunc has a workaround

Warning

-

org.apache.spark.sql.column.endsWith has a workaround

Warning

-

org.apache.spark.sql.functions.asin has a workaround

Warning

-

org.apache.spark.sql.functions.atan has a workaround

Warning

-

org.apache.spark.sql.functions.corr has a workaround

Warning

-

org.apache.spark.sql.functions.cos has a workaround

Warning

-

org.apache.spark.sql.functions.cosh has a workaround

Warning

-

org.apache.spark.sql.functions.count has a workaround

Warning

-

org.apache.spark.sql.functions.covar_pop has a workaround

Warning

-

org.apache.spark.sql.functions.covar_samp has a workaround

Warning

-

org.apache.spark.sql.functions.exp has a workaround

Warning

-

org.apache.spark.sql.functions.floor has a workaround

Warning

-

org.apache.spark.sql.functions.greatest has a workaround

Warning

-

org.apache.spark.sql.functions.grouping has a workaround

Warning

-

org.apache.spark.sql.functions.grouping_id has a workaround

Warning

-

org.apache.spark.sql.functions.least has a workaround

Warning

-

org.apache.spark.sql.functions.log has a workaround

Warning

-

org.apache.spark.sql.functions.mean has a workaround

Warning

-

org.apache.spark.sql.functions.min has a workaround

Warning

-

org.apache.spark.sql.functions.sin has a workaround

Warning

-

org.apache.spark.sql.functions.sinh has a workaround

Warning

-

org.apache.spark.sql.functions.sqrt has a workaround

Warning

-

org.apache.spark.sql.functions.stddev has a workaround

Warning

-

org.apache.spark.sql.functions.stddev_pop has a workaround

Warning

-

Function is not defined

Conversion error

-

An error occurred when loading the symbol table

Conversion error

-

The symbol table could not be loaded

Parsing error

-

org.apache.spark.sql.functions.sumDistinct has a workaround

Warning

-

org.apache.spark.sql.functions.tan has a workaround

Warning

-

org.apache.spark.sql.functions.tanh has a workaround

Warning

-

org.apache.spark.sql.functions.toDegrees has a workaround

Warning

-

org.apache.spark.sql.functions.toRadians has a workaround

Warning

-

org.apache.spark.sql.functions.var_pop has a workaround

Warning

-

org.apache.spark.sql.functions.var_samp has a workaround

Warning

-

org.apache.spark.sql.functions.variance has a workaround

Warning

-

org.apache.spark.sql.functions.max has a workaround

Warning

-

org.apache.spark.sql.functions.ceil has a workaround

Warning

-

org.apache.spark.sql.functions.countDistinct has a workaround

Warning

-

org.apache.spark.sql.functions.degrees has a workaround

Warning

-

org.apache.spark.sql.functions.kurtosis has a workaround

Warning

-

org.apache.spark.sql.functions.skewness has a workaround

Warning

-

org.apache.spark.sql.functions.stddev_samp has a workaround

Warning

-

org.apache.spark.sql.functions.sum has a workaround

Warning

-

Failed to add dependency

Conversion error

-

Element is not a literal.

Warning

-

Parameter is not supported for reader option.

Conversion error

Reader format on DataFrameReader is undefined.

Warning

-

Parameter is not supported for reader format.

Conversion error

Project file not found.

Warning

-

Spark element with a given argument is not supported.

Warning

-

Spark element is missing on the method chaining.

Warning

-

Last updated

#332: [SIT-1562] SQL Readiness

Change request updated