SparkSession

org.apache.spark.sql.SparkSession => com.snowflake.snowpark.Session

SparkSnowParkNotes

builder()

Transformation could cause SPRKSCK1103 and SPRKSCL1104

close()

conf.get(string key)

get

Transformation cause SPRKSCL1170

conf.set(string key, value)

set

Transformation cause SPRKSCL1170

createDataFrame(java.util.List<Row> rows, StructType schema)

range(long end)

range(long start,long end, long step)

range(long start,long end, long step, int numPartitions)

read()

sql(String sqlText)

table(String tableName)

udf()

getOrCreate()

create()

Last updated