I am a Data Engineer with experience in processing and analyzing data to derive meaningful information. I have proficiency in languages such as Python & SQL, and hands-on experience with cloud platforms like GCP (includi…
I am a Data Engineer with experience in processing and analyzing data to derive meaningful information. I have proficiency in languages such as Python & SQL, and hands-on experience with cloud platforms like GCP (including BigQuery, Cloud Run, Cloud Functions, Airflow and more). I have particularly used Airflow to create ETL processes (using SQL and Python) that insert data into Snowflake, Fivetran for EL, and MonteCarlo for monitoring Data Quality and Lineage. I love team collaboration, innovation and continuous learning.
<p>Developed and maintained Airflow DAGs in Python for ETL processes.<br>
Integrated APIs to gather data from various systems.<br>
Connected to Snowflake for data storage and retrieval.<br>
Applied software engineering best practices to deliver clean, high quality, transformed data to stakeholder from multiple teams in the company.<br>
Managed and granted access to resources using Snowflake and Terraform.<br>
Ensured the proper functioning of ETL processes by constantly monitoring them.<br>
Managed alerts when ETL processes failed or exhibited unexpected behavior.</p>
<p>Implemented a data quality engine for BigQuery tables using user-defined SQL rules and schedules.<br>
Ensured reliable data processes with real-time Slack notifications.<br>
Utilized Cloud Scheduler, Cloud Run, AI Platform Jobs, BigQuery, and Cloud Storage.<br>
Developed a Slack bot with Python and the Slack SDK to enhance team communication.<br>
The bot gathered daily insights from team members on mood, tasks, and challenges.<br>
Posted summaries to a shared Slack channel.<br>
Integrated Slack, Cloud Functions, BigQuery, and Cloud Scheduler jobs.<br>
Created a Feature Store in BigQuery using Table Valued Functions (TVFs) to centralize features for data models.<br>
Managed the store in a Bitbucket repository with Terraform modules and SQL files.</p>
<p>Applied a simple Fault Tree Analysis algorithm in Python, enhancing analytical processes and system reliability.<br>
Contributed to data cleansing procedures by systematically addressing null values, duplicates, noisy data, and outliers.<br>
Optimized data quality and integrity.<br>
Interpreted and analyzed data from industrial equipment using Python.<br>
Utilized NumPy, Pandas, and Matplotlib for effective data visualization.</p>
The AI-first Recruitment Operating System that unifies and automates the entire hiring lifecycle for modern enterprises worldwide.
Dr Job FZ LLC. 2026 © All Rights Reserved
