5+ years of experience in developing and integrating data driven solutions using Big Data technologies like Spark, Hive, Hadoop,PySpark. Experience in
Azure Cloud and understanding of Google Cloud Platform services - Big…
5+ years of experience in developing and integrating data driven solutions using Big Data technologies like Spark, Hive, Hadoop,PySpark. Experience in
Azure Cloud and understanding of Google Cloud Platform services - Big Query, Cloud Storage, Dataproc, Pub/Sub and Dataflow. Experience in creating
CI/CD pipelines using Jenkins. Onsite experience and interaction with key stakeholders in Middle-East, UAE.
Worked as a Data Engineer for driving the digital transformation journey at ENBD
Responsible for driving digital transformation journey of client by providing technical leadership for Batch and API solutions.
Interacting and decoding functional requirements into technical design documents ensuring they are in compliance with business specifications.
Worked extensively on writing data ingestion and transformation pipelines into Hadoop using Sqoop, Hive, PySpark and Shell Scripts.
Performance tuning for faster query response time and processing using NoSQL HBase, for efficient API calls.
Automation of shell scripts using Jenkins pipelines and scheduling ETL jobs for daily data loads using Apache Oozie.
Design and creation of ADF pipelines for migrating legacy data from SAP systems to Azure Data Lake and BLOB storage.
Use of Azure SQL stored procedures for calculating and storing the business logic and evoking them into the data pipelines in the transformation layer.
Pushing transformed data to Azure SQL tables for publishing multiple dashboards using Power BI.
Implementation of logging framework using ELK stack for storing and monitoring different applications logs in logstash to ease its access, debugging and performance tuning.
Coding in Spark RDD's and DataFrames using PySpark for migrating critical data processing from hive.
Involvement in gathering business requirements and providing technical support during UAT and SIT phases.
Experience in writing complex and advanced SQL queries using analytical functions.
Prepared couple of dashboards using Power BI.
Actively involved in writing and automating scripts for data import/export from multiple databases like MySQL, SQL Server, Oracle, PostgreSQL to HDFS using Sqoop import/export.
نظام التوظيف التشغيلي المعتمد على الذكاء الاصطناعي أولاً، الذي يوحّد ويؤتمت دورة التوظيف بالكامل للمؤسسات الحديثة حول العالم.
د.جوب منطقة حرة ذ.م.م. 2026 © جميع الحقوق محفوظة
