Data Engineer with 1.11 hands on experience building ETL/ELT pipelines, data lake solutions, and Big Data workflows on Azure and AWS. Working knowledge of Azure Databricks, PySpark, Spark SQL, Delta Lake, ADF, Medallion …
Data Engineer with 1.11 hands on experience building ETL/ELT pipelines, data lake solutions, and Big Data workflows on Azure and AWS. Working knowledge of Azure Databricks, PySpark, Spark SQL, Delta Lake, ADF, Medallion Architecture, Snowflake, and DBT for end-to-end data ingestion and transformation. Background in data modelling, pipeline orchestration, CI/CD, and BI reporting (Power BI); comfortable working across analytics and engineering teams.
<p>Built ETL/ELT pipelines using Azure Data Factory and Azure Databricks (PySpark) to ingest data from RDBMS, REST APIs, flat files, and cloud storage (ADLS Gen2, AWS S3), cutting manual ingestion effort by [20]%.<br>
Implemented Medallion Architecture (Bronze/Silver/Gold) on Delta Lake with CDC for incremental loads, producing analytics-ready datasets for downstream BI.<br>
Designed Star/Snowflake schema Fact and Dimension tables; applied indexing, partitioning, and Spark tuning to improve query and job performance.<br>
Built transformation workflows using PySpark, Spark SQL, Snowflake, DBT, and AWS Glue/Lambda across structured and semi-structured sources.<br>
Enforced data quality checks and RBAC/Key Vault-based security; set up CI/CD via Azure DevOps with pipeline monitoring in Azure Monitor and Log Analytics.<br>
Modelled graph based healthcare relationships in Neo4j identified Azure cost optimisation opportunities.</p>
<p>Analysed production, inventory, and quality data; ran root-cause analysis on batch variances and deviations, presenting corrective actions to plant leadership.<br>
Built Power BI dashboards (DAX, Power Query) and automated daily MIS reports tracking production targets vs. actuals, speeding up KPI visibility for operational decisions.</p>
The AI-first Recruitment Operating System that unifies and automates the entire hiring lifecycle for modern enterprises worldwide.
Dr Job FZ LLC. 2026 © All Rights Reserved
