CREATE OR REPLACE PROCEDURE HumanResources.uspGetAllEmployees (FIRSTNAME STRING, AGE INT)RETURNS STRINGLANGUAGE JAVASCRIPTCOMMENT ='{"origin":"sf_sc","name":"snowconvert","version":{"major":1, "minor":0},{"attributes":{"component":"transact"}}'EXECUTE AS CALLERAS$$// SnowConvert Helpers Code section is omitted.$$;
Parameter's DATA TYPE
Parameters data types are being translated to Snowflake equivalent. See also Data Types.
EXEC helper
In order to be able to run statements from a procedure in the SnowFlake environment, these statements have to be preprocessed and adapted to reflect their execution in several variables that are specific to the source language.
SnowConvert automatically translates the supported statements and makes use of an EXEC helper. This helper provides access and update capabilities to many variables that simulate how the execution of these statements would be in their native environment.
For instance, you may see that in the migrated procedures, there is a block of code that is always added. We are going to explain the basic structure of this code in the next section. Please keep in mind that we are always evaluating and searching for new and improved ways to streamline the transformations and any helper that we require.
Structure
The basic structure of the EXEC helper is as follows:
Variable declaration section: Here, we declare the different variables or objects that will contain values associated with the execution of the statements inside the procedure. This includes values such as the number of rows affected by a statement, or even the result set itself.
fixBind function declaration: This is an auxiliary function used to fix binds when they are of Date type.
EXEC function declaration: This is the main EXEC helper function. It receives the statement to execute, the array of binds (basically the variables or parameters that may be modified by the execution and require data permanence throughout the execution of the procedure), the noCatch flag that determines if the ERROR_HANDLERS must be used, and the catchFunction function for executing custom code when there's an exception in the execution of the statement. The body of the EXEC function is very straightforward; execute the statement and store every valuable data produced by its execution, all inside an error handling block.
ERROR VARS: The EXEC catch block sets up a list of error variables such as MESSAGE_TEXT, SQLCODE, SQLSTATE, PROC_NAME and ERROR_LINE that could be used to retrieve values from user defined functions, in order to emulate the SQL Server ERROR_LINE, ERROR_MESSAGE, ERROR_NUMBER, ERROR_PROCEDURE and ERROR_STATE built in functions behavour. After all of these variables are set with one value, the UPDATE_ERROR_VARS user defined function, will be in charge of update some environment variables with the error values, in order to have access to them in the SQL scope.
Code
The following code block represents the EXEC helper inside a procedure:
-- =============================================-- Example to execute the stored procedure-- =============================================EXECUTE dbo.EXEC_EXAMPLE_1GO
-- =============================================-- Example to execute the stored procedure-- =============================================EXECUTE dbo.EXEC_EXAMPLE_2 N'''Hello World!'''GO
Expected Code
OUT -> SqlServer_03.sql
CREATE OR REPLACE PROCEDURE dbo.EXEC_EXAMPLE_2 (P1 STRING DEFAULT '')RETURNS STRINGLANGUAGE JAVASCRIPTCOMMENT ='{"origin":"sf_sc","name":"snowconvert","version":{"major":1, "minor":0},{"attributes":{"component":"transact"}}'EXECUTE AS CALLERAS$$// SnowConvert Helpers Code section is omitted. EXEC(`SELECT ${P1};`);$$;
EXEC invoking a Store Procedure with a parameter
In this example, the EXEC invokes another Stored Procedure and pass adds a parameter
-- =============================================-- Example to execute the stored procedure-- =============================================EXECUTE dbo.EXEC_EXAMPLE_3 N'''Hello World!'''GO
Expected Code
OUT -> SqlServer_04.sql
CREATE OR REPLACE PROCEDURE dbo.EXEC_EXAMPLE_3 (P1 STRING DEFAULT '')RETURNS STRINGLANGUAGE JAVASCRIPTCOMMENT ='{"origin":"sf_sc","name":"snowconvert","version":{"major":1, "minor":0},{"attributes":{"component":"transact"}}'EXECUTE AS CALLERAS$$// SnowConvert Helpers Code section is omitted. EXEC(`CALL EXEC_EXAMPLE_2(?)`,[P1]);$$;
Parameters with Default Value.
In SqlServer, there can be parameters with a default value in case these are not specified when a procedure is being called.
For example
CREATE PROCEDURE PROC_WITH_DEFAULT_PARAMS1@PARAM1 INT =0, @PARAM2 INT =0, @PARAM3 INT =0, @PARAM4 INT =0ASBEGIN . . .END
In Snowflake is translated to
CREATE OR REPLACE PROCEDURE PROC_WITH_DEFAULT_PARAMS1(param1 intdefault0, param2 intdefault0, param3 intdefault0, param4 intdefault0)RETURNS TABLE()LANGUAGE SQLEXECUTE AS CALLERAS$$ . . .$$;
The Insert into Exec helper generates a function called Insert insertIntoTemporaryTable(sql). This function will allow the transformation for INSERT INTO TABLE_NAME EXEC(...) from TSQL to Snowflake to imitate the behavior from the original statement by inserting it's data into a temporary table and then re-adding it into the original Insert.
For more information on how the code for this statement is modified look at the section for Insert Into Exec
This Generated code for the INSERT INTO EXEC, may present performance issues when handling EXECUTE statements containing multiple queries inside.
function insertIntoTemporaryTable(sql) { var table="SnowConvertPivotTemporaryTable";return EXEC('CREATE OR REPLACE TEMPORARY TABLE ${table} AS ${sql}'); } insertIntoTemporaryTable(`${DBTABLES}`) EXEC(`INSERT INTO MYDB.PUBLIC.T_Table SELECT * FROM MYDB.PUBLIC.SnowConvertPivotTemporaryTable`); EXEC(`DROP TABLE SnowConvertPivotTemporaryTable`)
LIKE Helper
In case that a like expression is found in a procedure, for example
CREATE PROCEDURE ProcedureLike @VariableValue VARCHAR(50) ASBEGIN IF @VariableValue like'%c%' BEGINSelect AValue from ATable; END;END;
Since the inside of the procedure is transformed to javascript, the like expression will throw an error. In order to avoid and keep the functionality, a function is added at the start of the procedure if a like expression is found.
The parameters that the function LIKE receive are the followings:
The expression that is being evaluated.
The pattern of comparison
If it is present, the escape character, this is an optional parameter.
Select Helper
Generates a function called SELECT when a scalar value has to be set to a variable
IN -> SqlServer_06.sql
-- Additional Params: -t JavaScriptCREATE PROCEDURE MAX_EMPLOYEE_IDASBEGIN DECLARE @VARIABLE INT SET @VARIABLE = (SELECT MAX(EMPLOYEE_ID) FROM EMPLOYEES); RETURN @VARIABLEEND;
In this case, it will generate the following code with the SELECT helper
OUT -> SqlServer_06.sql
CREATE OR REPLACE PROCEDURE MAX_EMPLOYEE_ID ()RETURNS STRINGLANGUAGE JAVASCRIPTCOMMENT ='{"origin":"sf_sc","name":"snowconvert","version":{"major":1, "minor":0},{"attributes":{"component":"transact"}}'EXECUTE AS CALLERAS$$// SnowConvert Helpers Code section is omitted. let VARIABLE; VARIABLE = SELECT(` MAX(EMPLOYEE_ID) FROM EMPLOYEES`);return VARIABLE;$$;
The SELECT helper could be used as well to insert into a local value a retrieved value from a query. The helper was designed specifically to support the same behavour of the SQL Server SELECT @local_variable. The args parameter, represents each operation applied to all of the local variables inside the select. See also SELECT @Variable. For example:
The RAISERROR executes the UPDATE_ERROR_VARS_UDF in order to store the value of the error message, severity and state as environment variables, in case they need to be used by calling any of the ERROR built in functions. Finally, the error message is thrown with the same format as SQL Server does.
Identity Function Helper
This helper is generated whenever the Identity Fuction is used on a Select Into inside a procedure.
var IdentityHelper = (seed,increment) => { var sequenceString ="`CREATE OR REPLACE SEQUENCE SnowConvert_Temp_Seq START = ${seed} INCREMENT = ${increment}`";return EXEC(sequenceString);
The parameters for this helper are the same as the original function, it is created in order to generate a sequence to mimic the identity function behavior in TSQL, the changes to the original code are:
An additional method call to the IdentityHelper function using the same parameters found in the source code.
And call to the IDENTITY_UDF a function design to get the next value in the sequence.
IdentityHelper(1,1) EXEC(`CREATE TABLE PUBLIC.department_table3 AS SELECT IDENTITY_UDF() /*** MSC-WARNING - MSCEWI1046 - 'identity' FUNCTION MAPPED TO 'IDENTITY_UDF', FUNCTIONAL EQUIVALENCE VERIFICATION PENDING ***/ as Primary_Rankfrom PUBLIC.department_table`);
Just like in the TSQL if no parameters are given (1,1) will be the default values.
CALL Procedure Helper
This helper is generated whenever there is a call to what previously was a user defined function, but is now a procedure as a result of the translation process.
In this case, the DECLARE is used to declare a variable table, let's see an example.
IN -> SqlServer_08.sql
-- Additional Params: -t JavaScriptCREATE PROCEDURE PROC1ASBEGINDECLARE @VariableNameTable TABLE ( [Col1] INT NOT NULL, [Col2] INT NOT NULL );INSERT INTO @VariableNameTable Values(111,222);Select*from @VariableNameTable;ENDExec PROC1;
If we execute that code in Sql Server, we will get the following result
Now, let's see the transformation in Snowflake
OUT -> SqlServer_08.sql
CREATE OR REPLACE PROCEDURE PROC1 ()RETURNS STRINGLANGUAGE JAVASCRIPTCOMMENT ='{"origin":"sf_sc","name":"snowconvert","version":{"major":1, "minor":0},{"attributes":{"component":"transact"}}'EXECUTE AS CALLERAS$$// SnowConvert Helpers Code section is omitted. { EXEC(`CREATE OR REPLACE TEMPORARY TABLE T_VariableNameTable( Col1 INT NOT NULL, Col2 INT NOT NULL)`); EXEC(`INSERT INTO T_VariableNameTable Values(111,222)`); EXEC(`Select *from T_VariableNameTable`); } EXEC(`CALL PROC1()`);$$;
Note that from the lines 61 to 67 are the results of those statements inside the procedure.
The Declare Variable Table is turned into a Temporary Table. Note that the name, which that in the name the character @ was replaced for T_.
If we execute that code in Snowflake, we will not get any result. it will display just null. That's because that last Select is now in the EXEC helper. So, how do we know that the table is there?
Since it was created as a temporary table inside the Procedure in an EXEC, we can do a Select to that table outside of the Procedure.
Select*from PUBLIC.T_VariableNameTable;
If we execute that statement, we will get the following result
SET @Variable
For now, the Set Variable is transformed depending on the expression that is has on the right side.
If the expression has a transformation, it will be transformed to it's JavaScript equivalent.
Example
IN -> SqlServer_09.sql
-- Additional Params: -t JavaScriptCREATE PROCEDURE PROC1ASBEGIN SET @product_list2 =''; SET @product_list =''; SET @var1 +=''; SET @var2 &=''; SET @var3 ^=''; SET @var4 |=''; SET @var5 /=''; SET @var6 %=''; SET @var7 *=''; SET @var8 -=''; SET @ProviderStatement ='SELECT * FROM TABLE1WHERE COL1 = '+@PARAM1+' AND COL2 = '+ @LOCALVAR1; SET @NotSupported = functionValue(a,b,c);END
As you can see in the example, the value of the variable NOTSUPPORTED is commented since it is not being transformed for the time being. Note that means that the transformation is not completed yet.
Other kinds of sets are commented, for example the following
CREATE OR REPLACE PROCEDURE PROC1 ()RETURNS STRINGLANGUAGE JAVASCRIPTCOMMENT ='{"origin":"sf_sc","name":"snowconvert","version":{"major":1, "minor":0},{"attributes":{"component":"transact"}}'EXECUTE AS CALLERAS$$// SnowConvert Helpers Code section is omitted./*** SSC-EWI-0040 - THE STATEMENT IS NOT SUPPORTED IN SNOWFLAKE ***//*SET TRANSACTION ISOLATION LEVEL READ UNCOMMITTED*/;/*** SSC-EWI-0040 - THE STATEMENT IS NOT SUPPORTED IN SNOWFLAKE ***//*SET NOCOUNT ON*/;/*** SSC-EWI-0040 - THE STATEMENT IS NOT SUPPORTED IN SNOWFLAKE ***//*SET TRANSACTION ISOLATION LEVEL READ UNCOMMITTED*/;/*** SSC-EWI-0040 - THE STATEMENT IS NOT SUPPORTED IN SNOWFLAKE ***//*SET NOCOUNT OFF*/;$$;
SELECT @Variable
For now, the SELECT @variable is being transformed into a simple select, removing the variable assignations, and keeping the expressions at the right side of the operator. The assignment operations of the local variables in the select, will be replaced with arrow functions that represent the same behavour of the operation being did during the local variable assignment in SQL Server.
CREATE OR REPLACE PROCEDURE PROC1 ()RETURNS STRINGLANGUAGE JAVASCRIPTCOMMENT ='{"origin":"sf_sc","name":"snowconvert","version":{"major":1, "minor":0},{"attributes":{"component":"transact"}}'EXECUTE AS CALLERAS$$// SnowConvert Helpers Code section is omitted.let VAR1;let VAR2;SELECT(` COL1 + COL2, COL3 FROM TABLE1`,[],(value) => VAR1 =value,(value) => VAR2 =value);$$;
3. Statements translation
SELECT
Basic form
The basic SELECT form does not have bindings, so the translation implies the creation of a call to the EXEC helper function, with one parameter.
For example:
-- Source code:SELECT * FROM DEMO_TABLE_1;
// Translated code:EXEC(`SELECT * FROM DEMO_TABLE_1`);
IF
Source Code
IF Conditional_Expression-- SQL StatementELSE IF Conditiona_Expression2-- SQL StatementELSE-- SQL Statement
WHILE ( Conditional_Expression )BEGIN-- SQL STATEMENTSEND;
Translated Code
while ( Conditional_Expression ){// SQL STATEMENTS}
EXEC / EXECUTE
Source code
-- Execute simple statementExec('Select 1');-- Execute statement using Dynamic SqlExec('Select '+ @par1 +' from [db].[t1]');-- Execute Procedure with parameterEXEC db.sp2 'Create proc [db].[p3] AS', @par1, 1
Translated Code
-- Execute simple statementEXEC(`Select 1`);-- Execute statement using Dynamic SqlEXEC(`Select ${PAR1} from MYDB.db.t1`);-- Execute Procedure with parameterEXEC(`CALL db.sp2(/*** SSC-EWI-0038 - THIS STATEMENT MAY BE A DYNAMIC SQL THAT COULD NOT BE RECOGNIZED AND CONVERTED ***/'Select * from MYDB.db.t1', ?, 1, Default)`,[PAR1]);
THROW
The transformation for THROW ensures that the catch block that receives the error has access to the information specified in the original statement.
For instance:
-- Case 1THROW-- Case 2THROW 123, 'The error message', 1-- Case 3THROW @var1, @var2, @var3
Will be transformed to:
// Case 1throw {};// Case 2throw { code:123, message:"The error message", status:1 };// Case 3throw { code:VAR1, message:VAR2, status:VAR3 };
RAISERROR
SQL Server RAISERROR function is not supported in Snowflake. SnowConvert identifies all the usages in order to generate a helper that emulates the original behavour. Example:
From
IN -> SqlServer_12.sql
-- Additional Params: -t JavaScriptCREATE OR ALTER PROCEDURE RAISERRORTEST ASBEGIN DECLARE @MessageTXT VARCHAR='ERROR MESSAGE'; RAISERROR (N'E_INVALIDARG', 16, 1); RAISERROR ('Diagram does not exist or you do not have permission.', 16, 1); RAISERROR(@MessageTXT, 16, 1);ENDGO
To
OUT -> SqlServer_12.sql
CREATE OR REPLACE PROCEDURE RAISERRORTEST ()RETURNS STRINGLANGUAGE JAVASCRIPTCOMMENT ='{"origin":"sf_sc","name":"snowconvert","version":{"major":1, "minor":0},{"attributes":{"component":"transact"}}'EXECUTE AS CALLERAS$$// SnowConvert Helpers Code section is omitted. let MESSAGETXT =`ERROR MESSAGE`; RAISERROR("E_INVALIDARG","16","1"); RAISERROR("Diagram does not exist or you do not have permission.","16","1"); RAISERROR(MESSAGETXT,"16","1");$$;
BREAK/CONTINUE
The break/continue transformation, ensures flow of the code to be stopped or continue with another block.
CREATE OR REPLACE PROCEDURE ProcSample ()RETURNS STRINGLANGUAGE JAVASCRIPTCOMMENT ='{"origin":"sf_sc","name":"snowconvert","version":{"major":1, "minor":0},{"attributes":{"component":"transact"}}'EXECUTE AS CALLERAS$$// SnowConvert Helpers Code section is omitted.if (ROW_COUNT >0) {continue; } else {break; }$$;
INSERT INTO EXEC
The code is modify slightly due to the INSERT INTO [Table] EXEC(...) Statement not being supported in Snowflake this allows us to replicate the behavior by adding a few lines of code:
The first line added is a call to the insertIntoTemporaryTable to where the extracted code from the argument inside the EXEC, this will Insert the result set into a Temporary table. For more information on the function check the Insert Into EXEC Helper section.
The Insert's Exec is removed from the code and a query retrieving the results of the EXEC from the temporary table.
SELECT * FROM MYDB.PUBLIC.SnowConvertPivotTemporaryTable
The last line added is a DROP TABLE statement for the Temporary Table added.
DROPTABLESnowConvertPivotTemporaryTable
Source Code:
INSERT INTO #Table1EXEC ('SELECTTable1.IDFROM Population');INSERT INTO #Table1EXEC (@DBTables);
Translated Code:
insertIntoTemporaryTable(`SELECT Table1.ID FROM MYDB.PUBLIC.Population) EXEC(`INSERT INTO MYDB.PUBLIC.T_Table1 SELECT * FROM MYDB.PUBLIC.SnowConvertPivotTemporaryTable`); EXEC(`DROPTABLESnowConvertPivotTemporaryTable`) insertIntoTemporaryTable(`${DBTABLES}`) EXEC(`INSERT INTO MYDB.PUBLIC.T_Table1 SELECT * FROM MYDB.PUBLIC.SnowConvertPivotTemporaryTable`); EXEC(`DROPTABLESnowConvertPivotTemporaryTable`)
BEGIN TRANSACTION
BEGIN TRANSACTION is transformed to Snowflake's BEGIN command, and inserted into an EXEC helper call.
The helper is in charge of actually executing the resulting BEGIN.
Example:
-- Input codeBEGIN TRAN @transaction_name;
// Output codeEXEC(`BEGIN`, []);
COMMIT TRANSACTION
COMMIT TRANSACTION is transformed to Snowflake's COMMIT command, and inserted into an EXEC helper call.
The helper is in charge of actually executing the resulting COMMIT.
Example:
-- Input codeCOMMIT TRAN @transaction_name;
// Output codeEXEC(`COMMIT`, []);
ROLLBACK TRANSACTION
ROLLBACK TRANSACTION is transformed to Snowflake's ROLLBACK command, and inserted into an EXEC helper call.
The helper is in charge of actually executing the resulting ROLLBACK .
Example:
-- Input codeROLLBACK TRAN @transaction_name;
// Output codeEXEC(`ROLLBACK`, []);
WAITFOR DELAY
WAITFOR DELAY clause is transformed to Snowflake's SYSTEM$WAIT function. The time_to_pass parameter of the DELAY is transformed to seconds, for usage as a parameter in the SYSTEM$WAIT function.
The other variants of the WAITFOR clause are not supported in Snowflake, and are therefore marked with the corresponding message.
//Output code1) EXEC(`SYSTEM$WAIT(120)`,[]);2) /*** SSC-EWI-0040 - THE STATEMENT IS NOT SUPPORTED IN SNOWFLAKE ***//*WAITFOR TIME '13:30'*/ ;3) /*** SSC-EWI-0040 - THE STATEMENT IS NOT SUPPORTED IN SNOWFLAKE ***//*WAITFOR (RECEIVE TOP (1) @dh = conversation_handle, @mt = message_type_name, @body = message_body FROM [eqe]), TIMEOUT 5000*/ ;
3. Cursors
Since CURSORS are not supported in Snowflake, SnowConvert maps their functionality to a JavaScript helper that emulates the original behavior in the target platform. Example:
Input:
IN -> SqlServer_14.sql
-- Additional Params: -t JavaScriptCREATE PROCEDURE [procCursorHelper] ASDECLARE vendor_cursor CURSOR FOR SELECT VendorID, Name FROM Purchasing.Vendor WHERE PreferredVendorStatus =1 ORDER BY VendorID;GO
Output:
OUT -> SqlServer_14.sql
CREATE OR REPLACE PROCEDURE procCursorHelper ()RETURNS STRINGLANGUAGE JAVASCRIPTCOMMENT ='{"origin":"sf_sc","name":"snowconvert","version":{"major":1, "minor":0},{"attributes":{"component":"transact"}}'EXECUTE AS CALLERAS$$// SnowConvert Helpers Code section is omitted. var VENDOR_CURSOR = new CURSOR(`SELECT VendorID, Name FROM Purchasing.Vendor WHERE PreferredVendorStatus = 1 ORDER BY VendorID`,[],false);$$;
DECLARE CURSOR
For now, the Declare Cursor is just being commented.
Source Code
DECLARE myCursor1 CURSOR FOR SELECT COL1 FROM TABLE1
Translated Code
let myCursor1 =newCURSOR(`SELECT COL1 FROM TABLE1`,() => []);
OPEN
Source Code
OPEN myCursor1OPEN GLOBAL myCursor2
Translated Code
myCursor1.OPEN();myCursor2.OPEN()
FETCH
Source Code
DECLARE @VALUE1 INTFETCH NEXT FROM myCursor1 into @VALUE1
Labels have not the same behavior in JavaScript as SQL Server has. To simulate the behavior, they are being transformed to functions . Its usage is being replaced with a call of the generated function that contains all the logic of the label. Example:
CREATE OR REPLACE PROCEDURE procWithLabels ()RETURNS STRINGLANGUAGE JAVASCRIPTCOMMENT ='{"origin":"sf_sc","name":"snowconvert","version":{"major":1, "minor":0},{"attributes":{"component":"transact"}}'EXECUTE AS CALLERAS$$// SnowConvert Helpers Code section is omitted. SUCCESS_EXIT(); ERROR_EXIT();function SUCCESS_EXIT() { ERRORSTATUS =0;return ERRORSTATUS; }function ERROR_EXIT() {return ERRORSTATUS; }$$;
As you see in the example above, the function declarations that were the labels in the source code, will be put at the end of the code in order to make it cleaner.
GOTO is another command that does not exist in JavaScript. To simulate its behavour, their usages are being transformed to calls to the function (label) that is referenced, preceded by a return statement. Example: