Data Engineer Internship 6 months
Share
Job Location:
Monthly Salary:
Posted on:
6 hours ago
Vacancies:
1 Vacancy
Job Summary
This 6-month internship focuses on designing and implementing a robust data pipeline from raw data ingestion to clean structured datasets and visualisation. This will enable the R&D team to improve algorithms and explore predictive analysis using machine learning.
We have a database with the raw data from our users pumping or training sessions. Currently we analyse specific points of interest by opening session graphs in this database manually and coming to a conclusion. The aim of this internship is to create the connection between our database and Big Query to import users raw data and aggregate it to make analysis automatic large-scale faster modifiable and always up to date.
Expected outputs
Scalable and documented data collection and storage pipeline
Automated data cleaning and preprocessing scripts
Centralized dashboards for visualization
Example datasets and analysis notebooks for core projects
Recommendations for future predictive or AI-based studies
Work with Big Query and Metabase
Required Experience:
Intern
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Perifit is the health technology brand for all womankind. From pelvic floors to breastfeeding, and beyond, we’re here to help.
