Neha Nayal

Neha Nayal

ETL Developer
United Arab Emirates
English

About Me

Experience in development and design of ETL (Extract, Transform and Loading data) methodology for supporting data transformations and processing, in a corporate wide ETL Solution using TALEND Big Data /DI Platform. Exten…

Experience

Data Engineer

ABInBev GCC Services India Pvt Ltd.
Jun 2021 - Present · 5 years

Created Talend Anaplan Framework to integrate Talend and Anaplan to perform Anaplan actions.
Transformed data from various sources like flat file, Anaplan, and SAP ERP using a single framework for each source.
Placed the transformed data into ADLS Gen2, Hive and data warehouse layer.
Created Hive tables and SQL tables from Azure Blob file system path.
Created and deployed physical objects including custom tables and stored procedures for Staging and Data-Warehouse environment.
Wrote SQL queries and used joins to access data in SQL Server.
Incorporated agile methodologies using Azure DevOps.
Worked on Talend Cloud Management Console for adding and scheduling Execution Plans.

Data Engineer

AbInBev GCC Services India Private Limited
Jun 2021 - Present · 5 years

 Created Talend Anaplan Framework to integrate Talend and Anaplan to perform Anaplan Actions (Import/Export/Actions Within Anaplan)
 Transformed data from various source like Flat file, Anaplan, SAP ERP using a single framework for each source. Placed the transformed data into ADLS Gen2, Hive and Datawarehouse layer.
 Created Hive tables and SQL tables from Azure Blob file system path.
 Created and deployed physical objects including custom tables, stored procedures for Staging and Data -Warehouse environment. Involved in writing SQL Queries and used Joins to access data in SQL Server.
 Incorporated Agile Methodologies using Azure DevOps.
 Worked on Talend Cloud Management Console for adding and scheduling Execution Plans.

Data Engineer

ABInBev GCC Services India Pvt Ltd.
Jun 2021 - Present · 5 years

Created Talend Anaplan Framework to integrate Talend and Anaplan to perform Anaplan Actions
Transformed data from various sources like Flat file, Anaplan, SAP ERP using a single framework for each source
Created Hive tables and SQL tables from Azure Blob file system path
Created and deployed physical objects including custom tables, stored procedures for Staging and Data-Warehouse environment
Incorporated Agile Methodologies using Azure DevOps
Worked on Talend Cloud Management Console for adding and scheduling Execution Plans

Software Engineer

Decision Minds India Pvt Ltd.
May 2019 - Jun 2021 · 2 years 1 month

Performed data migration from on premise system to extract data from multiple data sources like SQL, Oracle, file based sources, Salesforce, and unstructured files and load into Snowflake Cloud data warehouse using Talend and Snowflake equivalent components.
Migrated data from all tables from one database to another with one job using Dynamic Schema.
Wrote SQL testing scripts to perform pre and post data validation checks to ensure the completeness of the data migrated.
Performed job scheduling by creating Execution Plans in TAC and job publishing to TAC server artifact repository.
Worked collaboratively with First Tech Data Modelling team to understand business and technical requirements to deliver accurate and on-time data from complex and highly diversified sources.
Operated in an agile environment using JIRA to document and track progress through the development cycle.

Talend ETL Developer

Tata Consultancy Services
Sep 2016 - May 2019 · 2 years 8 months

Prepared ETL mapping documents for every mapping.
Prepared data migration documents for smooth transfer of the project from development to testing environment and then to production environment.
Performed unit testing and system testing to validate data loads in the target.
Troubleshot long running jobs and fixed the issues.
Performed data migration to extract data from SQL and load data into Amazon Redshift and AWS S3 using Talend Big Data supporting components.
Created mappings in Talend using Big Data supporting components and standard components.
Used ETL methodologies and best practices to create Talend ETL jobs.
Followed and enhanced programming and naming standards.
Developed jobs, components and Joblets in Talend.
Used tRunJob component to run child job from a parent job and to pass parameters from parent to child job.
Created and deployed physical objects including custom tables, custom views, stored procedures, and indexes to SQL Server for Staging and Data-Warehouse environment.
Wrote SQL queries and used joins to access data from MySQL.
Created and managed source to target mapping documents for all Facts and Dimension tables.
Worked on performance tuning of mappings.
Extensively used tMap component for lookup and joiner functions.
Wrote expressions within tMap as per business need.
Handled insert and update strategy using tSQLRow.
Created implicit, local and global context variables in the job to run Talend jobs against different environments.
Worked on Talend Administration Console (TAC) for scheduling jobs and adding users.
Built a Talend job outside of Talend Studio as well as on TAC server.
Developed mappings to load Fact and Dimension tables, SCD Type 1 and SCD Type 2 dimensions and incremental loading.
Unit tested the mappings.
Developed a framework integrated job which schedules multiple jobs at a time and updates the last successful run time, success status, sends mail for failed jobs, and maintains the counts in SQL Database.
Used tParalleize component and multi-thread execution option to run subjobs in parallel.
Created Talend jobs to copy files from one server to another and utilized Talend FTP components.
Implemented FTP operations using Talend Studio to transfer files between network folders and to FTP server.
Extracted data from flat files and databases and applied business logic to load them in the staging database as well as flat files.
Successfully loaded data into different targets from various source systems like SQL Database, DB2, Flat files, XML files into the Staging table and then to the target database.

Software Engineer

Decision Minds India Pvt Ltd.
May 2019 - Jun 2021 · 2 years 1 month

Performed Data Migration from on premise system to extract data from multiple data sources
Migrated data from all tables from one database to another with one Job using Dynamic Schema
Proficient in writing SQL testing scripts to perform pre and post data validation checks
Performed job scheduling by creating Execution Plans in TAC
Worked collaboratively with First Tech Data Modelling team to understand business and technical requirements
Experience in operating in an agile environment using agile tools such as JIRA

Software Engineer

Decision Minds India Pvt Ltd
May 2019 - Jun 2021 · 2 years 1 month

 Performed Data Migration from on premise system to extract data from multiple data sources like SQL, Oracle,File based (csv, txt, xlsx, positional etc.), Salesforce, Unstructured Files (Converting to Structured files using Pycharm) and load into Snowflake Cloud Data warehouse using Talend and Snowflake equivalent components.
 Migrated data from all tables from one database to another with one Job using Dynamic Schema.
 Proficient in writing SQL testing scripts to perform pre and post data validation checks inorder to ensure the completeness of the data migrated.
 Performed job scheduling by creating Execution Plans in TAC and job publishing to TAC server artifact repository.
 Worked collaboratively with First Tech Data Modelling team to understand business and technical requirements inorder to deliver accurate and on-time data.
 Experience in operating in an agile environment using agile tools such as JIRA to document and track progress through the development cycle.

System Engineer

Tata Consultancy Services
Sep 2016 - May 2019 · 2 years 7 months

 Prepared ETL mapping Documents for every mapping and Data Migration document for smooth transfer of project from development to testing environment and then to production environment. Performed Unit testing and System testing to validate data loads in the target. Troubleshoot long running jobs and fixed the issues.
 Performed Data Migration to extract data from SQL and load data into Amazon Redshift and AWS –S3 using Talend Big Data supporting components.
 Expertise in creating mappings in TALEND using Big Data supporting components such as tJDBCConfiguration, tJDBCInput, tHDFSConfiguration, tS3configuration, tCacheOut, tCacheIn , tSqlRow and standard components like tFileInputDelimited, tFileOutputDelimited, tMap, tJoin, tReplicate, tParallelize, tConvertType, tAggregate, tSortRow, tFlowMeter, tLogCatcher, tRowGenerator, tJava, tJavarow, tAggregateRow, tFilter etc.
 Worked on Talend Administration Console (TAC) for scheduling jobs and adding users.

Skills

SQL Server Microsoft Azure Talend Amazon Web Services (AWS) Redshift Talend Big Data/DI Platform/Cloud Informatica Power center Microsoft SQL Server SQL Management Studio AWS Services Talend Administration Center Microsoft Visual Studio Athena Data Modeling – Microsoft Access Data Warehouse Concept - Star Schema Facts Dimensions SQL S3 Data Integration Snowflake Github Winscp Pycharm (Python basics) Microsoft Azure services (Storage accounts SQL DB Resource Groups) Databrick (SQL Endpoint) Hive Talend Big Data/DI Platform Informatica PowerCenter Data Modeling Microsoft Access Data Warehouse Concepts Star Schema Facts Dimensions GitHub WinSCP PyCharm Python Microsoft Azure services Databricks ETL Agile methodologies JIRA ADLS Gen2 Anaplan SAP ERP Azure DevOps Oracle Salesforce DB2 MySQL FTP HDFS TAC Talend Cloud Management Console
Report this Profile?