About Me
Data Engineer with a strong drive for growth and career advancement in the dynamic field of data engineering.
Experience
Data Engineer
<p>Collecting E-retail data to enhances Datagram platform’s Analytics.<br>
Enhanced Spark based ETL jobs, boosting efficiency and ensuring seamless migration across PostgreSQL and Cassandra databases.<br>
Led the implementation of automation utilizing Kafka and Python, resulting in a significant reduction in data processing time.<br>
Implemented robust data quality validation with Great Expectations, ensuring high accuracy across large datasets.<br>
Developed a Monitoring Dashboard for comprehensive data oversight using Apache Superset.</p>
Data Engineer
• Enhanced Spark based ETL jobs, boosting efficiency and ensuring
seamless migration across PostgreSQL and Cassandra databases.
• Led the implementation of automation utilizing Kafka and Python,
resulting in a significant reduction in data processing time.
• Implemented robust data quality validation with Great Expectations,
ensuring high accuracy across large datasets.
• Developed a Monitoring Dashboard for comprehensive data
oversight using Apache Superset.
Data Engineer / scientist
<p>Combine raw data and Prepare database for modeling water supply network through GIS tools.<br>
Daily drinking water demand forecasting, artificial neural network.<br>
water leak detection using machine learning algorithms.</p>
Data scientist intern
<p>Extract the visual attributes using the Resnet-152 network with an attention mechanism.<br>
Extract the textual attributes using GRUs similar to RNN using a pre-trained Skip-Thoughts model recognition for collecting product data from web pages.<br>
Training and validation of the multimodal model, and Classification using the KNN.</p>