نبذة عني
Data Engineer with 1.10+ years of experience at IBM in designing, developing, and optimizing scalable data pipelines. Skilled in Python, PySpark, SQL, AWS, Snowflake, Azure Data Factory, Databricks, and ETL/ELT developme…
Data Engineer with 1.10+ years of experience at IBM in designing, developing, and optimizing scalable data pipelines. Skilled in Python, PySpark, SQL, AWS, Snowflake, Azure Data Factory, Databricks, and ETL/ELT development.
الخبرة
Data Engineer
<p>Designed and developed scalable ETL pipelines using PySpark and AWS Glue.<br>
Built data ingestion frameworks to load data from APIs and databases into AWS S3 data lake.<br>
Performed data cleansing, transformation, enrichment, and validation for enterprise datasets.<br>
Loaded processed datasets into Snowflake to support reporting and analytics workloads.<br>
Implemented workflow orchestration using Azure Data Factory for reliable pipeline execution.<br>
Applied data quality checks to ensure consistency, accuracy, and integrity of data.<br>
Optimized ETL jobs and PySpark workloads to improve performance and scalability.<br>
Collaborated with business and technical teams to gather requirements and deliver data solutions.<br>
Worked on schema evolution handling, partitioning strategies, and large-scale data processing.</p>