About Me
Junior Data Engineer with 1.5 years of experience, skilled in Python, SQL, Pandas/Polars, and ETL pipeline development. Hands-on experience in AWS, Airflow, data modelling, and building scalable data processing workflows…
Junior Data Engineer with 1.5 years of experience, skilled in Python, SQL, Pandas/Polars, and ETL pipeline development. Hands-on experience in AWS, Airflow, data modelling, and building scalable data processing workflows at UST Global. Improved ETL performance and optimized large datasets through efficient transformations and SQL query tuning
Experience
Software Developer 1
Designed and implemented data processing workflows using Python, Pandas/Polars, and SQL
Built scalable ETL pipelines for large datasets
Worked with AWS S3 for ingestion and storage workflows
Integrated backend data flows using Apache Camel
Participated in daily standups, sprint planning, and Agile ceremonies
Collaborated with analysts and QA to ensure high data accuracy
Reduced data processing time by 32% using Polars-based vectorized transformations
Improved ETL runtime by 20% by optimizing SQL queries and batch logic
Software Developer 1
Designed and implemented data processing workflows using Python, Pandas/Polars, and SQL, Built scalable ETL pipelines for large datasets, Worked with AWS S3 for ingestion and storage workflows, Integrated backend data flows using Apache Camel, Participated in daily standups, sprint planning, and Agile ceremonies, Collaborated with analysts and QA to ensure high data accuracy
Data Engineering Intern
Built ETL workflows using Python, SQL, Pandas/Polars
Processed multi-million-row datasets efficiently using Polars
Automated ingestion pipelines for CSV and API data sources
Loaded cleaned datasets into AWS S3 and relational databases
Assisted senior engineers with data modelling and table design
Improved data quality by implementing validation rules
Data Engineering Intern
Built ETL workflows using Python, SQL, Pandas/Polars, Processed multi-million-row datasets efficiently using Polars, Automated ingestion pipelines for CSV and API data sources, Loaded cleaned datasets into AWS S3 and relational databases, Assisted senior engineers with data modelling and table design, Improved data quality by implementing validation rules