C Preethi Esther

C Preethi Esther

Data Engineer
India
Full-time Hybrid

About Me

Data Engineer with 5 years of experience building scalable ETL pipelines and enterprise data platforms on Azure Cloud using PySpark, Azure Databricks, SQL, and Azure Data Factory. Experienced in processing large-scale da…

Experience

Senior Consultant / Consultant – Data Engineer

Ernst &Young · Bangalore, India
Dec 2023 - Aug 2026 · 2 years 7 months

<p>Developed and maintained scalable ETL pipelines using Azure Databricks, PySpark, and Azure Data Factory, processing 2TB+ enterprise data weekly for FMCG analytics and reporting use cases.</p><p> Built reusable and parameterized data processing frameworks that reduced manual effort and improved onboarding efficiency for new data sources.</p><p> Optimized Spark jobs and ETL workflows, improving pipeline performance by approximately 30% through tuning and efficient transformation strategies.</p><p> Implemented CI/CD pipelines using Azure DevOps for automated deployment and release management across environments.</p><p> Designed and supported enterprise data lake solutions following Medallion Architecture principles for scalable and analytics-ready datasets.</p><p> Developed data validation, monitoring, and alerting mechanisms to improve data reliability and reduce production issues.</p><p> Collaborated with cross-functional teams to deliver end-to-end data solutions from requirement gathering to production deployment.</p><p> Received Client Extraordinaire Award (2x) for outstanding project delivery and performance.</p>

Senior Analyst / Analyst – Data Engineer

Capgemini · Bangalore, India
Sep 2021 - Dec 2023 · 2 years 2 months

<p>Developed ETL and data transformation pipelines using Azure Data Factory, Azure Databricks, PySpark, Python, and SQL.</p><p> Processed and transformed large-scale raw datasets from ADLS Gen2 into structured, analytics-ready Delta tables for reporting and downstream consumption.</p><p> Built reusable and parameterized pipelines supporting multiple data ingestion and transformation workflows.</p><p> Performed data cleansing, validation, and quality checks to improve reliability and consistency across pipelines.</p><p> Supported production deployments and release activities using Azure DevOps CI/CD pipelines.</p><p> Contributed to performance optimization and troubleshooting of enterprise data workflows.</p><p> Received Rising Star Award for strong ownership and delivery contributions.</p>

Skills

Python SQL PySpark Spark SQL Azure Databricks Azure Data Factory ADLS Gen2 Azure SQL ETL ELT Data Warehousing Data Modelling Medallion Architecture Star Schema Snowflake Schema Data Validation Data Quality Pipeline Automation Azure DevOps CI/CD Logic Apps Performance Optimization Monitoring Troubleshooting
Report this Profile?