Conclusions
What are we taking away from this?
By utilizing the SMA, we were able to accelerate the migration of both a data pipeline and a reporting notebook. The more of each that you have, the more value a tool like the SMA can provide.
And let’s go back to the assessment -> conversion -> validation flow that we have consistently come back to. In this migration, we:
Setup out project in the SMA
Ran SMA’s assessment and conversion engine on the code files
Reviewed the output reporting from the SMA to better understand what we have
Review what could not be converted by the SMA in VS Code
Resolve issues and errors
Resolve session references
Resolve input/output references
Run the code locally
And run the code in Snowflake
Ran the newly migrated scripts and validated their success
Snowflake has spent a great deal of time improving its ingestion and data engineering capabilities, just as it has spent time improving migration tools like SnowConvert, the SnowConvert Migration Assistant, and the Snowpark Migration Accelerator. Each of these will continue to improve. Please feel free to reach out if you have any suggestions for migration tooling. These teams are always looking for additional feedback to improve the tools.
Last updated