About Me
Experienced Snowflake developer seeking to utilize expertise in designing, implementing, and optimizing data solutions to contribute effectively to the success of a dynamic organization.
Experience
Snowflake developer
Migrated tables from Oracle db, my sql, sql server to snowflake.
● Validated the data when migrating from my sql, sql server, oracle to snowflake to make sure it has an
apple to apple match.
● Created snowpipe for continuous data load.
● Defined virtual warehouse re-sizing for snowflake for different types of workloads.
● Designed new databases to meet business needs and designed mapping documents, which is a guideline
for ETL coding.
● Defined roles, privileges required to access different database objects.
● Have in depth knowledge of snowflake databases, schema, and table structures.
● Used copy command to bulk load the data from the external stage(built on AWS) to snowflake.
1
● Created multiple internal and external stages and have transformed the data during load.
● Redesigned the existing views in snowflake to improve the performance.
● Created Materialized views for time sensitive data for business users.
● Implemented Near real time process in snowflake with a cadence of 30 min. Implemented a process to
read kafka topics & copy the data to s3, then load the data to snowflake.
● Consumed semi-structured json data from kafka & used lateral flatten and table flatten functions to
flatten the data & load into the snowflake tables.
● Worked with multiple file formats like csv and parquet.
● Created external tables in snowflake to read data directly from external stage S3 buckets in AWS.
● Created both javascript and sql/scripting procedures for data transformations & data loading from AWS
S3 to snowflake and also for data unloading from Snowflake tables to S3 buckets.
● Created snowflake data sharing between two snowflake accounts.
● Have created efficient stored procedures for near real time processes to loop through all the production
tables & purge the data which is older than 30 days.
● migrated 2 business critical tables from teradata to snowflake using TPTs (teradata parallel transport).
● Implemented CDC process (change data capture) using snowflake streams.
● Created User defined functions (UDFs) for specific use cases.
● Have extensively used Snowflake zero copy cloning & time travel.
● Created multiple temporary & transient tables during the implementation of ETL process.
● Created multiple documents such as source to target data mapping documents and unit test cases
documents.
● performed multiple unit test cases & tuned the procedures for better performance.
● Created multiple reusable workflows & jobs in One automation/ Automic scheduler fo
Snowflake developer
<p>Migrated tables from Oracle db, my sql, sql server to snowflake.<br>
Validated the data when migrating from my sql, sql server, oracle to snowflake to make sure it has an apple to apple match.<br>
Created snowpipe for continuous data load.<br>
Defined virtual warehouse re-sizing for snowflake for different types of workloads.<br>
Designed new databases to meet business needs and designed mapping documents, which is a guideline for ETL coding.<br>
Defined roles, privileges required to access different database objects.<br>
Have in depth knowledge of snowflake databases, schema, and table structures.<br>
Used copy command to bulk load the data from the external stage(built on AWS) to snowflake.<br>
Created multiple internal and external stages and have transformed the data during load.<br>
Redesigned the existing views in snowflake to improve the performance.<br>
Created Materialized views for time sensitive data for business users.<br>
Implemented Near real time process in snowflake with a cadence of 30 min.<br>
Implemented a process to read kafka topics & copy the data to s3, then load the data to snowflake.<br>
Consumed semi-structured json data from kafka & used lateral flatten and table flatten functions to flatten the data & load into the snowflake tables.<br>
Worked with multiple file formats like csv and parquet.<br>
Created external tables in snowflake to read data directly from external stage S3 buckets in AWS.<br>
Created both javascript and sql/scripting procedures for data transformations & data loading from AWS S3 to snowflake and also for data unloading from Snowflake tables to S3 buckets.<br>
Created snowflake data sharing between two snowflake accounts.<br>
Have created efficient stored procedures for near real time processes to loop through all the production tables & purge the data which is older than 30 days.<br>
migrated 2 business critical tables from teradata to snowflake using TPTs (teradata parallel transport).<br>
Implemented CDC process (change data capture) using snowflake streams.<br>
Created User defined functions (UDFs) for specific use cases.<br>
Have extensively used Snowflake zero copy cloning & time travel.<br>
Created multiple temporary & transient tables during the implementation of ETL process.<br>
Created multiple documents such as source to target data mapping documents and unit test cases documents.<br>
performed multiple unit test cases & tuned the procedures for better performance.<br>
Created multiple reusable workflows & jobs in One automation/ Automic scheduler for data orchestration.<br>
Worked closely with the production support team during UAT/Production deployments and fixing production failures.</p>
Snowflake developer
<p>Responsible for migration of 700+ objects with 6TB size from Teradata to Snowflake.<br>
Design and develop various data integration and data warehousing objects in snowflake.<br>
Identify all the different kinds of tables in the source databases and create permanent, temporary, and transient tables in the snowflake schemas.<br>
Identified & implemented the appropriate time travel and fail-safe periods for the permanent tables and created Data definition language for the tables and views.<br>
Establish Connections between amazon s3 bucket and snowflake (using integration objects) to load and unload data between s3 and snowflake.<br>
Install copy utilities in the on-premises servers to copy data to AWS s3 buckets.<br>
Develop User defined functions to handle date logics, timestamp differences, and substring logics.<br>
Developed JavaScript stored procedures to handle update and insert incremental data into the tables.<br>
Convert On-premises ETL scripts to snowsql ETL scripts using python by modifying the SQL logics compatible to snowflake user interface.<br>
Design virtual warehouse sizes in snowflake for different types of workloads.<br>
Validate the data types, nullability, and data type lengths between the source and the snowflake target tables.<br>
Create scripts to validate the data between postgre SQL schemas and snowflake schemas.<br>
Perform unit testing on stored procedures with different ranges of parameters.<br>
Redesign views in snowflake to improve performance.<br>
Create data sharing out of snowflake with consumers.<br>
Create a snow pipe and automate continuous data loading from various sources S3 buckets into snowflake.<br>
Work to minimize performance issues on ETL scripts & stored procedures.<br>
Integrated snowflake with Power BI for data processing and reporting.</p>
Snowflake developer
<p>worked on Teradata to Snowflake migration (Migrating the business data warehouse, which also interfaces transactional systems) in Microsoft Azure cloud.<br>
Migrated 6TB of data from teradata to snowflake.<br>
Created multiple containers inside the azure and separated the data files based on type delimited (bell or pipe) files.<br>
Bulk loading from external stage, internal stage to snowflake cloud using the copy command.<br>
Created Materialized Views & Non-Materialized Views.<br>
Created both JavaScript and SQL Stored Procedures.<br>
Cloned production data for code modification and testing in dev environment.<br>
Converted all the Teradata Macros to JavaScript Stored procedures.<br>
Used snowpipe for continuous data ingestion from external buckets to snowflake.<br>
Created Data Definition Language for all the tables in snowflake.<br>
Copied all the data from Teradata tables to Snowflake using Linux box and Azure as an intermediate platform.<br>
Extensively involved in troubleshooting post migration issues.<br>
Performed troubleshooting analysis and resolution of critical issues.<br>
Experience with AWS cloud services: EC2, S3</p>
Systems Analyst
<p>Ensured batch structure and flow is efficient and effective<br>
Prepared ETL standards, naming conventions and wrote ETL flow documentation for stage, mart.<br>
Involved in design, analysis, implementation, testing and support of ETL processes.<br>
Designed batch solutions for complex technical and business requests<br>
Ensured new standards and best practices are adhered to.<br>
Tested the new development, Functional Testing and Flow/Negative testing on all the changes made.<br>
Followed SDLC for the development process.<br>
Upgraded Autosys and WCC tool to a new release which includes Agent upgrades, SAP Adapter configuration, testing of Autosys jobs in new release.<br>
Maintained users in WCC using WCC EEM.<br>
Moved transports from QA to Production for Change requests<br>
Created Incidents in Service now for failures</p>
Systems Administrator Intern
<p>Identifying user requirements and performing research and analysis to determine conception/ logical design for solving business problems.<br>
Analyze user requirements, prepare detailed technical specifications for development and testing environments.<br>
Design, develop, and debug unit test programs for commercial release of development applications.<br>
Responsible for analysis of hardware/ software requirements, system maintenance, maintaining overall security primarily in a client server environment.<br>
Developing applications using embedded systems software, testing, and verifying the applications developed using embedded systems software, working on time series algorithms for quantitative analysis.</p>