About Me
Data Engineer with experience in data analysis, data engineering, and data science across Involve Asia Technologies Sdn. Bhd, Mandrill Tech Sdn. Bhd, and Setel Ventures Sdn. Bhd. Skilled in Python, Pyspark, SQL, DBT, Git…
Data Engineer with experience in data analysis, data engineering, and data science across Involve Asia Technologies Sdn. Bhd, Mandrill Tech Sdn. Bhd, and Setel Ventures Sdn. Bhd. Skilled in Python, Pyspark, SQL, DBT, Git, web scraping, AWS Textract, and analytics tools including SAS Enterprise Miner, Power BI, and Holistics.
Experience
Data Engineer
Conducted comprehensive data analysis with Pyspark to assess revenue and conversion performance, enabling strategic insights crucial for evaluating the viability of launching new product features
Enhanced data accuracy and data reliability in finance team performance dashboards by leveraging the API of the online accounting software instead of web scraping
Data Scientist
Web scraped leading automotive websites to produce rich dataset with valuable insights of market trends and consumer preferences via Python and Javascript
Undertook in-depth research to extract meaningful attributes in dataset creation, and develop corresponding taxonomies to ensure standardized data structures for improved accessibility and analysis
Implemented Optical Character Recognition (OCR) effort on online utility bills using AWS Textract and Python
Implemented filtering and scoring rules for a rule-based, personalised product recommendation system based on user eligibility and preferences
Data Engineer Intern
Planned, executed and tested migration effort of Data Science team's feature store from a notebook environment (Hex) to productionized DBT via SQL, resulting in higher robustness and reliability in Setel's machine learning infrastructure
Automated an output exporting pipeline for Setel's fraud detection machine learning model via Python, Holistics API and Google Sheets API
Documented technical knowledge and best practices of DBT and Git in Setel's Data Engineering processes knowledge bank using Confluence
Delivered presentations of undertaken projects to perform knowledge transfer to Setel's Data Analytics & AI team