Umesh Sahebrao Jadhav

Umesh Sahebrao Jadhav

Data Engineer
India
English

About Me

Data engineer with 3 years of experience in data wrangling, modeling, and building scalable ETL and ELT pipelines. Currently leading a team of 3 developers in an ongoing project. Proficient in Python, PySpark, SQL, AWS, …

Experience

Data Engineer (Team Lead)

Cognizant Technology Solutions, Pune, India
Nov 2022 - Present · 3 years 8 months

Developed and integrated APIs to pull and process over 10 million records daily from third-party platforms (Vindicia, Adobe), enhancing data availability and system reliability.
Led the migration of tables and views from Hive Metastore to Unity Catalog, validating external table locations to ensure compliance with production standards.
Automated the archival process for OneTrust audit data, reducing storage usage and ensuring strict adherence to data retention policies.
Streamlined Databricks-to-Snowflake job configurations, accelerating data transfer speeds by 20% and enhancing overall system performance.
Migrated DAGs from Apache Airflow to Databricks, replicating and optimizing existing Airflow functionalities for seamless workflow transition.
Utilized Python and PySpark extensively for data extraction, transformation, and loading (ETL) processes, optimizing large-scale data pipelines.
Optimized Databricks jobs, resulting in savings of approximately $1,000 per month (Hard Dollars) in direct costs.

Data Engineer (Team Lead)

Cognizant Technology Solutions, Pune, India
Feb 2022 - Present · 4 years 5 months

Cognizant Technology Solutions -
1. A+E Television Networks, LLC is an American multinational broadcasting company that is a joint venture with Hearst
Communications and The Walt Disney Company through its general entertainment content division. It’s a global media and
entertainment brand portfolio founded in 1983 that finds, cultivates, illuminates, and markets entertainment content to
worldwide audiences.
2. Broadridge Financial Solutions is a public corporate services and financial technology company founded in 2007 as a spin-
off from management software company Automatic Data Processing. Broadridge supplies public companies with proxy
statements, annual reports and other financial documents, and shareholder communications solutions, such as virtual
annual meetings

Python Consultant

Broadridge Financial Solutions
May 2022 - Oct 2022 · 5 months

Utilized a range of AWS Services for infrastructure management and automation.
Engineered and optimized 6 AWS Glue jobs to accommodate evolving data loading specifications, reducing job execution time by an average of 25 minutes per load cycle while ensuring accuracy in data transfer processes.
Managed artifact deployment using Jenkins across different development stages.
Implemented S3 file upload triggers to initiate data loading processes via Lambda functions.
Validated database-loaded data and generated corresponding reports.
Contributed to comprehensive documentation creation and maintenance on AWS architectures.
Engaged in Agile methodology and JIRA for efficient project management and sprint planning.

Skills

Python Structured Query Language (SQL) PySpark Amazon Web Services (AWS) ETL ELT MySQL Snowflake RDS Jenkins GitHub Terraform Apache Airflow MWAA Shell Commands Bash API integration
Report this Profile?