Experienced Data Engineer with 7+ years of expertise in designing and implementing scalable data solutions.
Proven track record in building data warehouses from scratch and developing efficient ELT pipelines for both
bat…
Experienced Data Engineer with 7+ years of expertise in designing and implementing scalable data solutions.
Proven track record in building data warehouses from scratch and developing efficient ELT pipelines for both
batch and stream processing.
Specialized in optimizing data infrastructure and creating robust data architectures that drive business
intelligence. Passionate about staying current with emerging technologies and implementing cutting-edge data
engineering tools to deliver high-performance solutions.
<p>Data pipeline migration from existing ELT (shell script) into Apache Airflow Jobs<br>
Develop ELT system for batch and stream<br>
Setup and Deploy Data Stream CDC with Kafka and Open source data catalog<br>
Implement Data Engineering Portal to manage all DE apps<br>
Manage and optimize Datawarehouse performance<br>
Implement server and app monitoring with Grafana on Data Stream server</p>
Data pipeline migration from existing ELT (shell script) into Apache Airflow Jobs, Develop ELT system for batch and stream, Setup and Deploy Data Stream CDC with Kafka and Open source data catalog, Implement Data Engineering Portal to manage all DE apps, Manage and optimize Datawarehouse performance, Implement server and app monitoring with Grafana on Data Stream server
<p>Help build Datawarehouse in Bigquery<br>
Implement standard good code quality in Apache Airflow tasks for others DE to follow<br>
Create Airflow job unit test using pytest<br>
Develop stream processing in Flink using python then kafka as message broker<br>
Build a dashboard to manage submit, stop & resubmit Flink job<br>
Help data science to build internal Mlflow dashboard<br>
Display experiments and model registry<br>
Deploy Mlflow model registry as API based</p>
<p>Build a data pipeline using Airflow and running on GKE<br>
Read data source from Mysql(replica) and prepare Mysql also as Datawarehouse<br>
Create various tasks like read & write Gsheet data<br>
Read marketing app API</p>
<p>Build (semi) data stream from external data with golang into AWS Redshift<br>
Build & config efficient Airflow docker for ETL setup DBT with start project for star schema<br>
Create unit test on existing Airflow Jobs and setup open source metadata data catalog</p>
<p>Design & Develop New ETL program using python project and ndscheduller for auto running job<br>
Data Pipeline or Extraction from Mysql, Mongodb, Elasticsearch, Dynamodb, Bigquery, Google Analytics, Gsheet and others API Third-party<br>
Automate report via email<br>
Export file gdocs<br>
Push data to SAP<br>
Using Datalake technology with Qubole Service Hive, Sqoop, Spark & Presto<br>
Implement Apache Airflow for new scheduler</p>
Help build Datawarehouse in Bigquery, implement standard good code quality in Apache Airflow tasks for others DE to follow and create Airflow job unit test using pytest, Develop stream processing in Flink using python then kafka as message broker, and build a dashboard to manage (submit, stop & resubmit) flink job, Help data science to build internal Mlflow dashboard (display experiments, model registry, and deploy Mlflow model registry as API based)
Build a data pipeline using Airflow and running on GKE, Read data source from Mysql(replica) and prepare Mysql also as Datawarehouse, Create various tasks like read & write Gsheet data, read marketing app API
Build (semi) data stream from external data with golang into AWS Redshift, Build & config efficient Airflow docker for ETL setup DBT with start project for star schema, Create unit test on existing Airflow Jobs and setup open source metadata data catalog
Design & Develop New ETL program using python project and ndscheduller for auto running job (replacing cron job), Data Pipeline or Extraction from Mysql, Mongodb, Elasticsearch, Dynamodb, Bigquery, Google Analytics, Gsheet and others API Third-party, Automate report via email, export file gdocs, push data to SAP, Using Datalake technology with Qubole Service Hive, Sqoop, Spark & Presto, Implement Apache Airflow for new scheduler
The AI-first Recruitment Operating System that unifies and automates the entire hiring lifecycle for modern enterprises worldwide.
Dr Job FZ LLC. 2026 © All Rights Reserved
