About Me
Senior Data Engineer and Principal Consultant - Data Analytics with 7+ years of experience designing, building, optimizing, and supporting scalable data pipelines, ETL/ELT processes, cloud data platforms, and enterprise …
Senior Data Engineer and Principal Consultant - Data Analytics with 7+ years of experience designing, building, optimizing, and supporting scalable data pipelines, ETL/ELT processes, cloud data platforms, and enterprise data warehouses. Strong hands-on expertise in Python, SQL, PySpark/Spark, Hadoop/Hive, Apache NiFi, Informatica PowerCenter, AWS, Snowflake, Redshift, Databricks, and Airflow/MWAA. Experienced in integrating diverse source systems, implementing data-quality and governance controls, optimizing distributed workloads, designing analytical data models, and supporting production reliability across healthcare/pharmaceutical, retail, supply chain, and enterprise analytics domains. Proven ability to work with data scientists, analysts, architects, QA teams, and business stakeholders to deliver trusted, scalable data products.
Experience
Principal Consultant - Data Analytics / Senior Data Engineer
<p>Design, build, and maintain scalable ETL/ELT pipelines using Python, SQL, PySpark/Spark, NiFi, Informatica, Airflow/MWAA, AWS Glue, EMR, Redshift, Snowflake, and Databricks.</p><p> Integrate data across relational databases, APIs, SFTP, cloud storage, enterprise applications, and structured/semi-structured file feeds, standardizing source data into governed analytical layers.</p><p> Develop and optimize Spark/PySpark and SQL transformations for large datasets, including complex joins, aggregations, mapping logic, incremental processing, reconciliation, and analytical outputs.</p><p> Build data warehouse structures across staging, integration, curated, and reporting layers, including fact/dimension models, lookup rules, reusable transformations, and reporting-ready datasets.</p><p> Implement data-quality, governance, and traceability controls including schema validation, primary-key checks, duplicate detection, missing-reference checks, count comparison, reconciliation, audit fields, and source-to-target documentation.</p><p> Optimize pipeline and warehouse performance through SQL query tuning, Spark job optimization, partition-aware processing, Parquet-based storage, transformation redesign, and removal of redundant processing.</p><p> Operate production workflows with scheduling, dependencies, retries, logging, alerting, controlled reruns, and recovery procedures; investigate incidents and resolve data-availability or correctness issues.</p><p> Collaborate with data scientists, analysts, BI teams, architects, QA, and business stakeholders to understand data requirements and translate them into maintainable pipeline and modelling solutions.</p><p> Apply Jenkins/GitHub Actions CI/CD, Git-based code review, automated testing, release coordination, and engineering documentation across DEV, QA, and PROD.</p>
PROJECTS
Cloud Data Engineering & Integration
<ul><li>Built reusable ingestion workflows using NiFi, Python, Airflow/MWAA, PySpark, AWS S3, EMR, Glue, Athena, Redshift, and PostgreSQL.</li><li>Integrated APIs, operational databases, SFTP, and cloud/file sources; transformed incoming data into standardized Parquet-based datasets for scalable downstream processing.</li><li>Implemented validation, reconciliation, monitoring, retries, and incident-support controls for regulated healthcare/pharma analytics workloads.</li></ul><p></p>