gautamshasank

Working as a Data Engineer and responsible for implementing the architecture, setting up the Azure SQL
DW and ensure the smooth running of scheduled ADF Jobs and provide end-user assistance.
● Responsibilities:
● Gathering and analyzing the requirements from the business users to provide the compatible solution.
● Creating the Ingestion pipelines using ADF (Azure Data Factory) based on the Source requirements.
● Scheduled the ADF Pipeline with Event based and Scheduled triggers.
● Media Data Store, responsible for implementing the architecture, setting up the Azure SQL Data
warehouse. Using Azure Functions (C#) the logs from different media store sources like Google
Campaign Manager, Facebook Ads, Amazon are ingested into Azure SQL data warehouse (Azure Data
Factory) for data science team.
● As part of data management track, responsible for analyzing/performance improvement of the existing
jobs, ensure the smooth running of scheduled ADF Jobs and provide end-user assistance.
● Creating packages as per business requirements to load data to downstream Database.
● Incorporated pipeline to import files (JSON, CSV or TSV) uploaded by the users or logs generated to
new or existing SQL DW tables.
● Experienced in creating pipelines in Azure Cloud ADFv2 using different activities like Move &Transform,
Control Flow, Data Transformation etc.
● Supply Chain Data Store (Canada), Designed and built a scalable Data store solution on Azure by
leveraging Azure’s Synapse Analytics data service to ingest data received from SAP APO, residing in
Teradata to SQL DW using ADF that would enable Self Service reporting capabilities using Power BI for
Sales and CFR report for data science team.
● First Party Data Store, responsible for implementing the architecture, setting up the Azure SQL Data
warehouse. Data from different data store sources are ingested into Azure SQL data warehouse using
Azure Data Factory for data science team.

Working as a Data Engineer and responsible for implementing the architecture, setting up the Azure SQL DW and ensure the smooth running of scheduled ADF Jobs and provide end-user assistance.
Gathering and analyzing the requirements from the business users to provide the compatible solution.
Creating the Ingestion pipelines using ADF (Azure Data Factory) based on the Source requirements.
Scheduled the ADF Pipeline with Event based and Scheduled triggers.
Media Data Store, responsible for implementing the architecture, setting up the Azure SQL Data warehouse.
Using Azure Functions (C#) the logs from different media store sources like Google Campaign Manager, Facebook Ads, Amazon are ingested into Azure SQL data warehouse (Azure Data Factory) for data science team.
As part of data management track, responsible for analyzing/performance improvement of the existing jobs, ensure the smooth running of scheduled ADF Jobs and provide end-user assistance.
Creating packages as per business requirements to load data to downstream Database.
Incorporated pipeline to import files (JSON, CSV or TSV) uploaded by the users or logs generated to new or existing SQL DW tables.
Experienced in creating pipelines in Azure Cloud ADFv2 using different activities like Move &Transform, Control Flow, Data Transformation etc.
Supply Chain Data Store (Canada), Designed and built a scalable Data store solution on Azure by leveraging Azure’s Synapse Analytics data service to ingest data received from SAP APO, residing in Teradata to SQL DW using ADF that would enable Self Service reporting capabilities using Power BI for Sales and CFR report for data science team.
First Party Data Store, responsible for implementing the architecture, setting up the Azure SQL Data warehouse.
Data from different data store sources are ingested into Azure SQL data warehouse using Azure Data Factory for data science team.

Collaborated as an integral part of a team of database developers and implementation consultants (IC) for implementation and automation of various modules for the eHCM systems developed by the organization.
Troubleshoot issues across the data stack and identify opportunities to enhance server performance and maintain 99.99% uptime.
Programming – utilize programming languages to create complex functions for use in databases.
Developing back-end components with python to improve responsiveness and overall performance.
Working in an agile environment.
Build scalable, and efficient back-end features in Python.
Work along with popular python framework - Django, Flask.
Write reusable, testable, and efficient Python code.
Write python scripts to Integrate data storage solutions on the server side
Worked on VBA projects to automate excel functions using macros.
Worked on capturing, cleansing, and storing data using a uniform and consistent format that is accessible and relevant to end users and IoT technologies.
Create KTRs and run Jobs for transformation of the data as desired.
Generated Ad- hoc reports using IBM Cognos and Skybot tools.
Creating complex query definitions that allow data to be extracted from the databases.
Develop mapping specifications, Source to target mappings and ETL development.
Develop the workflow and dataflow of SSIS ETL processes to support many different file structures and business processes.
High level proficiency with Microsoft Word, Excel, and Outlook.

Creating complex query definitions that allow data to be extracted from oracle database.
Setting up and testing new database and data handling systems.
Monitoring database efficiency.
Sustaining the security and integrity of data.
Exposure to work on real time project web application and development.
Query tuning, troubleshooting.
Creating and designing a library database from the scratch.
Installation and configuration of MySQL.