About Me
Data Engineer with experience in data analysis, data engineering, and data science across Involve Asia Technologies Sdn. Bhd, Mandrill Tech Sdn. Bhd, and Setel Ventures Sdn. Bhd. Skilled in Python, Pyspark, SQL, DBT, Git…
Data Engineer with experience in data analysis, data engineering, and data science across Involve Asia Technologies Sdn. Bhd, Mandrill Tech Sdn. Bhd, and Setel Ventures Sdn. Bhd. Skilled in Python, Pyspark, SQL, DBT, Git, web scraping, AWS Textract, and analytics tools including SAS Enterprise Miner, Power BI, and Holistics.
Experience
Data Engineer
<p>Conducted comprehensive data analysis with Pyspark to assess revenue and conversion performance, enabling strategic insights crucial for evaluating the viability of launching new product features<br>
Enhanced data accuracy and data reliability in finance team performance dashboards by leveraging the API of the online accounting software instead of web scraping</p>
Data Scientist
<p>Web scraped leading automotive websites to produce rich dataset with valuable insights of market trends and consumer preferences via Python and Javascript<br>
Undertook in-depth research to extract meaningful attributes in dataset creation, and develop corresponding taxonomies to ensure standardized data structures for improved accessibility and analysis<br>
Implemented Optical Character Recognition (OCR) effort on online utility bills using AWS Textract and Python<br>
Implemented filtering and scoring rules for a rule-based, personalised product recommendation system based on user eligibility and preferences</p>
Data Engineer Intern
<p>Planned, executed and tested migration effort of Data Science team's feature store from a notebook environment (Hex) to productionized DBT via SQL, resulting in higher robustness and reliability in Setel's machine learning infrastructure<br>
Automated an output exporting pipeline for Setel's fraud detection machine learning model via Python, Holistics API and Google Sheets API<br>
Documented technical knowledge and best practices of DBT and Git in Setel's Data Engineering processes knowledge bank using Confluence<br>
Delivered presentations of undertaken projects to perform knowledge transfer to Setel's Data Analytics & AI team</p>