Anish Singh

Creating ETL and ELT data ingestion pipelines using Python, SQS, Lambda, Step Functions, Glue, AWS Batch, Pyspark, EMR and SQL which extract data from various source systems, transform and load data into S3 and other SQL and NoSQL data stores like DynamoDB, Document DB, RDS and s3
Performance tuning of ETL/ELT data loads and SQL/HiveQL queries optimization
Creating highly performant and scalable REST API services using AWS API Gateway, Chalice and MuleSoft
Performing data analysis/profiling on files present in S3 using Python, Athena, Hive and Redshift spectrum
Creating DevOps and CICD pipelines using Terraform and Azure DevOps
Writing Unit and end-to-end tests. Documenting test plans, testing status and testing outcomes as required by the project
Creating components (python scripts) to send ETL processing Logs to Splunk
Creating automated Alerts in Splunk to notify users of any failures or errors during the ETL process
Designing and implementing data validation framework in AWS cloud to monitor quality assurance metrics, validation results and statuses
Designing and implementing metadata driven data delivery framework in AWS cloud to securely transfer data files to both internal and external data partners using FTP, SFTP or S3 transfers
Analysing, Defining and Implementing user requirements and functional specifications using Agile methodologies (Scrum and Kanban)
Maintaining software version control using Azure DevOps and Git.
Participating in the deployment of applications into existing systems from Quality assurance perspective
Operating Systems worked on: Windows, Red Hat Enterprise Linux (RHEL), Amazon Linux and Ubuntu

Creating ETL and ELT data ingestion pipelines using Python, SQS, Lambda, Step Functions, Glue, AWS Batch, Pyspark,
EMR and SQL which extract data from various source systems, transform and load data into S3 and other SQL and
NoSQL data stores like DynamoDB, Document DB, RDS and s3
• Performance tuning of ETL/ELT data loads and SQL/HiveQL queries optimization
• Creating highly performant and scalable REST API services using AWS API Gateway, Chalice and MuleSoft
• Performing data analysis/profiling on files present in S3 using Python, Athena, Hive and Redshift spectrum
• Creating DevOps and CICD pipelines using Terraform and Azure DevOps
• Writing Unit and end-to-end tests. Documenting test plans, testing status and testing outcomes as required by the project
• Creating components (python scripts) to send ETL processing Logs to Splunk
• Creating automated Alerts in Splunk to notify users of any failures or errors during the ETL process
• Designing and implementing data validation framework in AWS cloud to monitor quality assurance metrics, validation
results and statuses
• Designing and implementing metadata driven data delivery framework in AWS cloud to securely transfer data files to both
internal and external data partners using FTP, SFTP or S3 transfers
• Analysing, Defining and Implementing user requirements and functional specifications using Agile methodologies (Scrum
and Kanban)
• Maintaining software version control using Azure DevOps and Git.
• Participating in the deployment of applications into existing systems from Quality assurance perspective
• Operating Systems worked on: Windows, Red Hat Enterprise Linux (RHEL), Amazon Linux and Ubuntu

Creating ETL and ELT data ingestion pipelines using Python, SQS, Lambda, Step Functions, Glue, AWS Batch, Pyspark, EMR and SQL
Performance tuning of ETL/ELT data loads and SQL/HiveQL queries optimization
Creating highly performant and scalable REST API services using AWS API Gateway, Chalice and MuleSoft
Performing data analysis/profiling on files present in S3 using Python, Athena, Hive and Redshift spectrum
Creating DevOps and CI/CD pipelines using Terraform and Azure DevOps
Writing Unit and end-to-end tests
Creating components (python scripts) to send ETL processing Logs to Splunk
Creating automated Alerts in Splunk to notify users of any failures or errors during the ETL process
Designing and implementing data validation framework in AWS cloud to monitor quality assurance metrics, validation results and statuses
Designing and implementing metadata driven data delivery framework in AWS cloud to securely transfer data files to both internal and external data partners using FTP, SFTP or S3 transfers
Analysing, Defining and Implementing user requirements and functional specifications using Agile methodologies (Scrum and Kanban)
Maintaining software version control using Azure DevOps and Git
Participating in the deployment of applications into existing systems from Quality assurance perspective
Operating Systems worked on: Windows, Red Hat Enterprise Linux (RHEL), Amazon Linux and Ubuntu

Successfully implemented Informatica migration project and performed multiple Informatica upgrades
Worked on migrating Netezza Datawarehouse to IBM DB2 IIAS and IBM Performance Server (IPS) platforms
Created scalable, reusable and metadata driven data ingestion framework in AWS Cloud using Python, Spark, Glue, EMR, Hive, S3 and DynamoDB to consume data from a variety of different data sources (Web Services, FTP, SFTP, SAN, SQL Server, Netezza, Hadoop) with different file formats including CSV, fixed width and delimited files, XML, parquet and JSON
Created scalar UDFs using SQL and Python/C++ in AWS Redshift and Netezza database
Wrote complex SQLs and Procedures in Netezza/Redshift to support data analytics requirements.
Created ETL data pipelines using Informatica PowerCenter (v 10.x) to load data from various source systems into IBM Netezza and IPS databases
Designed and implemented automated data archival and clean-up process to offload data from on-prem Datawarehouse to S3 and SAN drives
Provided support to the Decision Sciences and Valuations teams on a day-to-day basis
Performed data analysis/profiling on files in s3 using Athena, Hive, Redshift Spectrum and Apache drill.
Performance Tuning of Data Loads and SQL Query Optimization
Software version control using GitHub
Provided Production support to Datawarehouse and VOV applications
Performed Unit and System testing.
Participated in Scrum ceremonies including Backlog Prioritization, Story Grooming and Sprint Planning activities
Operating Systems worked on: Windows, Red Hat Enterprise Linux (RHEL), Amazon Linux and Ubuntu

Created Big data ETL processes on Cloudera cluster utilizing Hadoop, Hive, Python, Sqoop, Impala and Apache Spark (Pyspark)
Worked on migrating Data warehousing application from Windows to Red Hat Enterprise Linux (RHEL) platform
Created ELT and ETL data ingestion pipelines in AWS Cloud using Python, Lambda, Step Functions, Pyspark, Sparksql, Amazon EMR to transform and load data into AWS S3 and Redshift
Utilized AWS Schema Conversion Tool (SCT) to migrate data from On-Prem to Redshift in AWS cloud
Created ETL workflows using Informatica PowerCenter (v 10.x) to load data from various source systems into IBM Netezza database
Software version control using Microsoft TFS
Production support to Data warehouse applications
Performed Informatica software upgrades
Created automated SQL and shell scripts to perform data validations. Performed unit and system testing.
Created outlier detection processes for SAS models
Participated in Project Planning, Story Grooming and Sprint Planning activities. Worked on standard Waterfall, Kanban and Scrum frameworks
Operating Systems worked on: Windows, Red Hat Enterprise Linux (RHEL), Amazon Linux

Designed and developed several ETL workflows using Informatica PowerCenter (v 9.x) and Microsoft SSIS to load data from various data sources into Datawarehouse
Developed windows DOS and Unix shell scripts to remotely execute SAS programs
Created Big data ETL processes on Cloudera cluster utilizing Hadoop, HDFS, Hive, Python, Sqoop, Impala and Apache Spark (Pyspark)
Created complex File Parsers using Unix Shell, and Python scripts
Created Stored Procedures and views in IBM Netezza appliance
Created user defined functions using C++ programming language in IBM Netezza
Provided production support to Datawarehouse applications
Create Automated scripts and Alerts using UNIX shell scripts to monitor Production Processes and SLAs
Software version control using Microsoft TFS
Performed unit and system testing.
Worked on both standard waterfall and agile project implementation frameworks.
Operating Systems worked on: Windows, Red Hat Enterprise Linux (RHEL)

Engaged with client partners in discussions regarding project health and future roadmap
Worked on End-to-End implementation of projects including requirements gathering, design, development, testing, deployment and maintenance
Created analytics dashboard and report prototypes using QlikView
Developed solution prototypes utilizing modern software tools and provided recommendations to customer
Created OLAP cubes using Microsoft SQL Server Analysis Services (SSAS)
Designed and developed ETL workflows using Informatica PowerCenter and IBM DataStage extracting data from Oracle, Microsoft SQL Server, AS400 and MFGPRO systems, applying transformations and loading the transformed data into Oracle Data warehouse
Performed Analysis of Legacy code in order to re-engineer those legacy applications
Developed Source to Target Mapping documents for various ETL pipelines
Created several SQLs and PL/SQL procedures in Oracle for analytical users
Created flat file data extracts to be fed into Logility Planning tool
Developed data interfaces to Salesforce application
Performance tuning of Informatica mappings/workflows and SQLs.
Created UNIX, AWK and Python scripts to parse complex files and facilitate data loads
Managed a five-member team and served as technical mentor for the team as well.
Worked with Business analysts on a day-to-day basis and help them with data analysis and SQL queries
Analysis and Effort estimation of Change Requests
Worked on TCS internal tools for Project management and status reporting
Operating Systems worked on: Windows, Red Hat Enterprise Linux (RHEL), IBM AIX
Tasks allocation among team members and regular follow-ups to make sure the timelines are met

Created ETL jobs using IBM DataStage pulling data from multiple data sources into Datawarehouse.
Collaborated and coordinated with different application teams to address inter-application dependencies
Worked on End-to-End implementation of projects including requirements gathering, design, development, testing, deployment and maintenance
Created SSIS packages to load data from Oracle to Microsoft SQL Server
Created ETL mappings and workflows using Informatica PowerCenter to process data into POS, OBS and Supply Chain data marts.
Created ASO (Aggregate Storage) and BSO (Block Storage) cubes using Hyperion ESSBASE
Created UNIX Shell scripts and PL/SQL scripts to facilitate data loads and data cleansing
Performed Unit and System Testing
Provided Production Support to Datawarehousing applications
Worked on TCS internal tools for Project management and status reporting
Operating Systems worked on: Windows, Red Hat Enterprise Linux (RHEL), IBM AIX, Sun Solaris

Created ETL jobs using IBM DataStage sourcing data from relational databases and message queues (IBM MQ)
Created Dashboards and Reports using Hyperion Interactive Reporting tool (also known as Hyperion IR and Brio)
Administered user access and permissions to various Hyperion reports and OLAP cubes (Data Governance and Security) using Hyperion Shared Services
Created ETL mappings and workflows using Informatica PowerCenter
Created Triggers, Materialized Views, Stored Procedures and User Defined Functions in Oracle and SQL Server databases
Created High Level and Low Level (HLDs and LLDs) design documents
Data Modelling as per mBIDS methodology using ERWIN and IBM M1 tool
Designed data marts as per Kimball’s (Star and Snowflake schema) and Bill Inmon’s model
Utilized HP Mercury tool to perform unit and system testing
Performed installation and upgrades of Informatica, Hyperion and IBM DataStage software
Provided production support to Datawarehousing and Seibel applications
Worked on TCS internal tools for Project management and status reporting
Operating Systems worked on: Windows, IBM AIX, Sun Solaris

Designed ETL Framework for various data marts
Re-engineered legacy applications and created ETL data pipelines using Ab-Initio graphs, Unix shell and PERL scripts
Created ETL Jobs using IBM DataStage
Created SQL, PL/SQL scripts in Oracle, DB2 and Netezza
Conceptual, Logical and Physical data modelling using ERWin and M1 tools
Created custom tools using Shell and Awk scripts to perform automated verification of coding standards in Abinitio graphs.
Created Autosys Job schedules for batch processing of ETL data loads
Software version control using CVS tool
Performed data analysis to support queries from Business users on a day-to-day basis
Created Test Plans and performed Unit and System Testing
Tasks allocation among team members and regular follow-ups to make sure the timelines are met. Also served as a technical Mentor to other team members
Daily coordination with client. Status reporting and project planning using IPMS tool
Production Support
Operating Systems worked on: Windows, IBM AIX

Created secure file transfer scripts using Power Channel
Created mappings, mapplets, reusable transformations, lookups and ETL workflows using Informatica PowerCenter
Performed analysis of COBOL Code and created reverse engineering documents for migrating legacy mainframe applications to IBM RS 6000
Created stored procedures using IBM DB2 to facilitate data loads
Created DB2 bulk load utility programs to load huge amount of data into Data marts
Conceptual, Logical and Physical design of databases.
Created Base SAS programs to generate Audit sampling data sets
Created Reports and Dashboards using Business Objects reporting tool.
Created shell and awk scripts for file handling and data parsing.
Created Unit and System Test Plans and performed Unit and System Testing
Acted as coordinator between Client and Offshore team. Delegated tasks to offshore team members as per client’s priorities.
Coordinated deployment and Migration of Unix, DB2 and Informatica code to production environment
Actively participated in resolving coding bugs and production processing issues
Operating Systems worked on: Windows, IBM AIX

Created user defined functions in IBM DB2 Universal Database using C Programming language
Created Informatica ETL Mappings and Workflows to process data from flat files into DB2 Operational Data Store (ODS).
Created reports using SQL, PL/SQL and IBM DB2 Stored Procedures
Performed Unit and System testing of applications
Worked as Unix system administrator for offshore development environment and was responsible to apply patches, install software and Backup/Restore processes
Worked as IBM DB2 DBA for offshore development team and was responsible for maintaining databases in development environment.
Created High-level and Low-level Design Documents (HLD and LLD)
Coordinated with the Onsite Counterparts on day-to-day basis
Participated in Initial learning program designed by TCS to induct new employees on various aspects of software development including Software Development Life Cycle (SDLC) Concepts, UNIX, C, Operating System Concepts, Relational Database Management Systems (RDBMS), SQL, Software Engineering
Operating Systems worked on: Windows, IBM AIX

Successfully implemented Informatica migration project and performed multiple Informatica upgrades
Worked on migrating Netezza Datawarehouse to IBM DB2 IIAS and IBM Performance Server (IPS) platforms
Created scalable, reusable and metadata driven data ingestion framework in AWS Cloud using Python, Spark, Glue, EMR, Hive, S3 and DynamoDB to consume data from a variety of different data sources (Web Services, FTP, SFTP, SAN, SQL Server, Netezza, Hadoop) with different file formats including CSV, fixed width and delimited files, XML, parquet and JSON
Created scalar UDFs using SQL and Python/C++ in AWS Redshift and Netezza database
Wrote complex SQLs and Procedures in Netezza/Redshift to support data analytics requirements
Created ETL data pipelines using Informatica PowerCenter (v 10.x) to load data from various source systems into IBM Netezza and IPS databases
Designed and implemented automated data archival and clean-up process to offload data from on-prem Datawarehouse to S3 and SAN drives
Provided support to the Decision Sciences and Valuations teams on a day-to-day basis
Performed data analysis/profiling on files in S3 using Athena, Hive, Redshift Spectrum and Apache drill
Performance Tuning of Data Loads and SQL Query Optimization
Software version control using GitHub
Provided Production support to Datawarehouse and VOV applications
Performed Unit and System testing
Participated in Scrum ceremonies including Backlog Prioritization, Story Grooming and Sprint Planning activities
Operating Systems worked on: Windows, Red Hat Enterprise Linux (RHEL), Amazon Linux and Ubuntu

Created Big data ETL processes on Cloudera cluster utilizing Hadoop, Hive, Python, Sqoop, Impala and Apache Spark (Pyspark)
Worked on migrating Data warehousing application from Windows to Red Hat Enterprise Linux (RHEL) platform

• Successfully implemented Informatica migration project and performed multiple Informatica upgrades
• Worked on migrating Netezza Datawarehouse to IBM DB2 IIAS and IBM Performance Server (IPS) platforms
• Created scalable, reusable and metadata driven data ingestion framework in AWS Cloud using Python, Spark, Glue,
EMR, Hive, S3 and DynamoDB to consume data from a variety of different data sources (Web Services, FTP, SFTP, SAN,
SQL Server, Netezza, Hadoop) with different file formats including CSV, fixed width and delimited files, XML, parquet and
JSON
• Created scalar UDFs using SQL and Python/C++ in AWS Redshift and Netezza database
• Wrote complex SQLs and Procedures in Netezza/Redshift to support data analytics requirements.
• Created ETL data pipelines using Informatica PowerCenter (v 10.x) to load data from various source systems into IBM
Netezza and IPS databases
• Designed and implemented automated data archival and clean-up process to offload data from on-prem Datawarehouse
to S3 and SAN drives
• Provided support to the Decision Sciences and Valuations teams on a day-to-day basis
• Performed data analysis/profiling on files in s3 using Athena, Hive, Redshift Spectrum and Apache drill.
• Performance Tuning of Data Loads and SQL Query Optimization
• Software version control using GitHub
• Provided Production support to Datawarehouse and VOV applications
• Performed Unit and System testing.
• Participated in Scrum ceremonies including Backlog Prioritization, Story Grooming and Sprint Planning activities