About Me
Big Data Engineer with over 2+ years of experience specializing in Data Management, Migration, Processing, and Analytics. Expertise in optimizing data workflows, ensuring data quality, and develop…
Big Data Engineer with over 2+ years of experience specializing in Data Management, Migration, Processing, and Analytics. Expertise in optimizing data workflows, ensuring data quality, and developing efficient, scalable solutions for complex environments. Seeking opportunities to contribute in dynamic, innovative settings, leveraging cutting-edge technologies while continuously enhancing technical and analytical skills.
Experience
Digital Specialist Engineer (Cloud Data Professional)
Trained in Scala, Apache Spark, and PySpark within the Hadoop ecosystem as part of Big Data training, with practical hands-on experience applying these technologies in real-world scenarios.
Completed a comprehensive 3-month training program in Snowflake and SQL, focusing on hands-on experimentation with large real-world datasets.
Achieved a score of 90% on the Snowflake assessment.
Received commendations from trainers for exceptional performance.
Actively participated in Scrum ceremonies, including Sprint planning, Sprint review/Demo, and Code review.
Developed advanced SQL queries to optimize data retrieval and enhance application performance.
Collaborated with cross-functional teams to address business requirements and improve functionality.
Contributed as a Python Developer by writing Python scripts to automate SQL queries and generate daily business reports, including email integration for seamless delivery of statistics.
Performed inter-DB reconciliation and data correction.
Resolved critical data discrepancies in large datasets by writing and implementing Snowflake queries in production, leading to enhanced data integrity.
Received commendations from both team lead and client.
Worked on query optimizations on complex SQL queries to enhance performance and improve Tableau reporting accuracy and efficiency.
Involved in creation of tables by implementing cluster keys to improve performance and efficiency during data retrieval and query processing.
Developed data pipelines to transfer data from SAP HANA to Snowflake, ensuring seamless integration and data accuracy.
Troubleshot pipeline errors in production.
Implemented and automated stored procedures using Python scripts to enhance performance and meet business requirements.
Performed different types of unit testing after the data was loaded into the destination.
Designed and developed ETL pipelines using PySpark in Databricks, starting from data extraction based on business-provided datasets.
Performed data cleaning, transformations, and analysis to meet business requirements.
Digital Specialist Engineer(Cloud Data Professional)
Trained in Scala,Apache Spark and Pyspark within the Hadoop ecosystem as part of Big Data training, with practical hands-on experience applying these technologies in real-world scenarios. Completed a comprehensive 3-month training program in Snowflake and SQL , focusing on hands-on experimentation with large real-world datasets. Achieved a score of 90% on the Snowflake assessment, received commendations from trainers for exceptional performance.