Ibnu Bayhaqi

Ibnu Bayhaqi

Senior Database Engineer
Indonesia
Indonesian (Bahasa), English

About Me

Experienced Data Engineer with 7+ years of expertise in designing and implementing scalable data solutions.
Proven track record in building data warehouses from scratch and developing efficient ELT pipelines for both
bat…

Experience

Senior Data Engineer

Sekolah.mu (Education Technology and Jobs Provider)
Aug 2026 - Present · 1 month

Data pipeline migration from existing ELT (shell script) into Apache Airflow Jobs
Develop ELT system for batch and stream
Setup and Deploy Data Stream CDC with Kafka and Open source data catalog
Implement Data Engineering Portal to manage all DE apps
Manage and optimize Datawarehouse performance
Implement server and app monitoring with Grafana on Data Stream server

Senior Data Engineer

Sekolah.mu (Education Technology and Jobs Provider)
Aug 2025 - Present · 10 months

Data pipeline migration from existing ELT (shell script) into Apache Airflow Jobs, Develop ELT system for batch and stream, Setup and Deploy Data Stream CDC with Kafka and Open source data catalog, Implement Data Engineering Portal to manage all DE apps, Manage and optimize Datawarehouse performance, Implement server and app monitoring with Grafana on Data Stream server

Senior Data Engineer

Cashbac (Rewards System)
Sep 2026 - Oct 2026 · 1 month

Help build Datawarehouse in Bigquery
Implement standard good code quality in Apache Airflow tasks for others DE to follow
Create Airflow job unit test using pytest
Develop stream processing in Flink using python then kafka as message broker
Build a dashboard to manage submit, stop & resubmit Flink job
Help data science to build internal Mlflow dashboard
Display experiments and model registry
Deploy Mlflow model registry as API based

Senior Data Engineer

mClinica (Health Drugs Broker)
Jul 2026 - Sep 2026 · 2 months

Build a data pipeline using Airflow and running on GKE
Read data source from Mysql(replica) and prepare Mysql also as Datawarehouse
Create various tasks like read & write Gsheet data
Read marketing app API

Senior Data Engineer

CrediBook (SME Marketplace)
Oct 2026 - Jun 2026 · 4 months

Build (semi) data stream from external data with golang into AWS Redshift
Build & config efficient Airflow docker for ETL setup DBT with start project for star schema
Create unit test on existing Airflow Jobs and setup open source metadata data catalog

Data Engineer

Ralali.com (B2B Marketplace)
Jun 2026 - Apr 2026 · 2 months

Design & Develop New ETL program using python project and ndscheduller for auto running job
Data Pipeline or Extraction from Mysql, Mongodb, Elasticsearch, Dynamodb, Bigquery, Google Analytics, Gsheet and others API Third-party
Automate report via email
Export file gdocs
Push data to SAP
Using Datalake technology with Qubole Service Hive, Sqoop, Spark & Presto
Implement Apache Airflow for new scheduler

Senior Data Engineer

Cashbac (Rewards System)
Sep 2025 - Oct 2025 · 1 month

Help build Datawarehouse in Bigquery, implement standard good code quality in Apache Airflow tasks for others DE to follow and create Airflow job unit test using pytest, Develop stream processing in Flink using python then kafka as message broker, and build a dashboard to manage (submit, stop & resubmit) flink job, Help data science to build internal Mlflow dashboard (display experiments, model registry, and deploy Mlflow model registry as API based)

Senior Data Engineer

mClinica (Health Drugs Broker)
Jul 2025 - Sep 2025 · 2 months

Build a data pipeline using Airflow and running on GKE, Read data source from Mysql(replica) and prepare Mysql also as Datawarehouse, Create various tasks like read & write Gsheet data, read marketing app API

Senior Data Engineer

CrediBook (SME Marketplace)
Oct 2025 - Jun 2025 · 3 months

Build (semi) data stream from external data with golang into AWS Redshift, Build & config efficient Airflow docker for ETL setup DBT with start project for star schema, Create unit test on existing Airflow Jobs and setup open source metadata data catalog

Data Engineer

Ralali.com (B2B Marketplace)
Jun 2025 - Apr 2025 · 1 month

Design & Develop New ETL program using python project and ndscheduller for auto running job (replacing cron job), Data Pipeline or Extraction from Mysql, Mongodb, Elasticsearch, Dynamodb, Bigquery, Google Analytics, Gsheet and others API Third-party, Automate report via email, export file gdocs, push data to SAP, Using Datalake technology with Qubole Service Hive, Sqoop, Spark & Presto, Implement Apache Airflow for new scheduler

Skills

MySQL PostgreSQL Python Structured Query Language (SQL) Docker Elasticsearch Go Kubernetes Redshift Bash TimescaleDB BigQuery Apache Airflow DBT Apache Kafka Apache Flink Debezium Gitlab CI/CD Nats Grafana AWS GCP Vue.js FastAPI Java Pytest Golang Hive Sqoop Spark Presto Mlflow GKE MongoDB Dynamodb Google Analytics SAP
Report this Profile?