نبذة عني
Data Engineer with experience in building data pipelines, ETL processes, data modeling, and data visualization projects. Skilled in Python, SQL, JavaScript, AWS, Tableau, MongoDB, PySpark, and Flask, with project experie…
Data Engineer with experience in building data pipelines, ETL processes, data modeling, and data visualization projects. Skilled in Python, SQL, JavaScript, AWS, Tableau, MongoDB, PySpark, and Flask, with project experience involving PostgreSQL, Pandas, Plotly, Matplotlib, and web scraping.
الخبرة
Employee Reference Database
Designed, built, and created a complex employee data pipeline using SQL (Postgres).
The pipeline holds information on over 300,000 unique employees.
Developed the ERD, database schema, and all tables within the pipeline.
Queried information about employee characteristics, demographics, department info, etc.
PostgreSQL and pgAdmin4
Crowdfunding ETL
Developed an ETL pipeline using Python, Pandas, and Python dictionary methods to extract and transform a company’s crowdfunding data.
Transformed and cleaned the data.
Created four CSV files used to develop an ERD and a table schema.
Developed a fully functional data pipeline for the company using the files our team developed.
Python, SQL, Microsoft Excel
Science Lab Website
Used JavaScript to develop a website with an interactive dashboard to explore the Belly Button Biodiversity dataset, which catalogues the microbes that colonise human canals.
Used Plotly to create various interactive visualisations for the website and dashboard.
Deployed the app using a hosting service.
JavaScript, CSS, Plotly
Happiness Dashboard
Worked on a team to run an in depth analysis on the 2015-2022 World Happiness Reports, and created a fun and interactive dashboard to visualise the data for the year of 2021 in The World Happiness Report.
Used Python (Pandas) to clean and merge the data sets for each year (2015-2022).
Used web scraping to attain necessary data for the visualisations.
Developed hypotheses.
Used Python (Matplotlib) and JavaScript to create plots/visualisations.
Deployed an API using Flask.
Wrote an analysis report.
Python, Pandas, Matplotlib, Flask, CSS, HTML, JavaScript