Dynamic Senior Data Engineer with over 4 years of experience in building scalable ETL pipelines and optimising data infrastructure using Databricks and big data technologies. Skilled in SQL, Python, and PySpark, successf…
Dynamic Senior Data Engineer with over 4 years of experience in building scalable ETL pipelines and optimising data infrastructure using Databricks and big data technologies. Skilled in SQL, Python, and PySpark, successfully enhanced operational efficiency with advanced tools while ensuring data accuracy. Proven track record of supporting migrations and developing data reconciliation tools. Ready to leverage expertise to drive impactful data solutions.
Designed and implemented scalable ETL pipelines to transform and consolidate diverse data into a unified database using Databricks., Created utilities for continuous data accuracy checks across various platforms., Performed in-depth analytics on a range of datasets utilizing SQL, Python, and PySpark., Incorporated advanced tools like Lakehouse Monitoring, SonarQube, and the Data Reconciliation Tool to enhance operational efficiency.
Designed, implemented and maintained data pipelines and ETL processes to support the data platform’s operational efficiency., Developed Data Reconciliation Tools to compare source and target system data, generating comprehensive reports for validation and accuracy., Worked with cloud-based big data technologies, including Snowflake and Azure services such as Azure Databricks, Azure SQL, ADLS Gen2, ADF and Azure Synapse Analytics., Built and optimized data pipelines using Hadoop tools like Apache Spark, Hive, Impala, and HDFS, ensuring high-performance data transformation and cleansing., Applied object-oriented programming principles in Python to streamline data operations and enhance code maintainability., Supported the migration from Teradata to Google BigQuery, leveraging Google Cloud.
نظام التوظيف التشغيلي المعتمد على الذكاء الاصطناعي أولاً، الذي يوحّد ويؤتمت دورة التوظيف بالكامل للمؤسسات الحديثة حول العالم.
د.جوب منطقة حرة ذ.م.م. 2026 © جميع الحقوق محفوظة
