Riadh balti

Riadh balti

Data Engineer
Saudi Arabia
Arabic, English, French

About Me

Data Engineer with a strong drive for growth and career advancement in the dynamic field of data engineering.

Experience

Data Engineer

Datagram (B2B SAAS E-retail analytics), Datagram France remote
Aug 2022 - Present · 3 years 11 months

Collecting E-retail data to enhances Datagram platform’s Analytics.
Enhanced Spark based ETL jobs, boosting efficiency and ensuring seamless migration across PostgreSQL and Cassandra databases.
Led the implementation of automation utilizing Kafka and Python, resulting in a significant reduction in data processing time.
Implemented robust data quality validation with Great Expectations, ensuring high accuracy across large datasets.
Developed a Monitoring Dashboard for comprehensive data oversight using Apache Superset.

Data Engineer

Datagram
Aug 2022 - Present · 3 years 11 months

• Enhanced Spark based ETL jobs, boosting efficiency and ensuring
seamless migration across PostgreSQL and Cassandra databases.
• Led the implementation of automation utilizing Kafka and Python,
resulting in a significant reduction in data processing time.
• Implemented robust data quality validation with Great Expectations,
ensuring high accuracy across large datasets.
• Developed a Monitoring Dashboard for comprehensive data
oversight using Apache Superset.

Data Engineer / scientist

National water distribution utility- Tunisia, Tunis - Tunisia
Jan 2021 - Jun 2022 · 1 year 5 months

Combine raw data and Prepare database for modeling water supply network through GIS tools.
Daily drinking water demand forecasting, artificial neural network.
water leak detection using machine learning algorithms.

Data scientist intern

DATAVORA, Tunis - Tunisia
Feb 2020 - Nov 2020 · 9 months

Extract the visual attributes using the Resnet-152 network with an attention mechanism.
Extract the textual attributes using GRUs similar to RNN using a pre-trained Skip-Thoughts model recognition for collecting product data from web pages.
Training and validation of the multimodal model, and Classification using the KNN.

Skills

Big Data Data Repository Hadoop Scala Apache Hive Amazon Web Services (AWS) Kafka NoSQL Redshift S3 Python SQL Data Engineering Spark Pandas Docker Cassandra PostgreSQL Great Expectations GitLab CI/CD Lambda RDS Node.js Airflow Keras NumPy Matplotlib Web Scraping Elasticsearch NLTK ETL Git
Report this Profile?