About Me
Experienced Azure Data Engineer with around 4 years of expertise in designing, implementing, and optimizing data solutions on the Microsoft Azure platform. Proficient in Azure Data Factory, Azure Databricks, Azure SQL Da…
Experienced Azure Data Engineer with around 4 years of expertise in designing, implementing, and optimizing data solutions on the Microsoft Azure platform. Proficient in Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics. Skilled in data modeling, ETL/ELT processes, and data governance. Collaborative team player with excellent problem-solving and communication skills. Dedicated to staying updated with the latest advancements in Azure technologies and applying them to optimize data workflows and drive organizational success. Committed to delivering high-quality, reliable, and efficient data solutions that empower data-driven decision-making.
Experience
Data Engineer
Orchestrates data acquisition, transformation, analysis, storage, and database management utilizing Azure Databricks and Azure SQL Database, managing over 10 TB of data within Azure Data Factory
Executes data integration, ETL operations, and data modeling in Azure Synapse Analytics, ensuring seamless data migration through DEV, SIT, UAT, and PROD testing environments
Conducts detailed analysis and management of mapping data flows within Data Factory, bolstering low-latency operations in Data Lake Storage and enhancing high-performance processing which improved efficiency by 40%
Participates in team-based initiatives to craft Databricks notebooks in alignment with Azure DevOps requirements
Data Engineer
•Orchestrates data acquisition, transformation, analysis, storage, and database management utilizing Azure Databricks
and Azure SQL Database, managing over 10 TB of data within Azure Data Factory
•Executes data integration, ETL operations, and data modeling in Azure Synapse Analytics, ensuring seamless data
migration through DEV, SIT, UAT, and PROD testing environments
•Conducts detailed analysis and management of mapping data flows within Data Factory, bolstering low-latency
operations in Data Lake Storage and enhancing high-performance processing which improved efficiency by 40%.
•Participates in team-based initiatives to craft Databricks notebooks in alignment with Azure DevOps requirements
Data Engineer
Conducted ETL development and created SQL scripts using Oracle for the generation of transaction reports
Successfully automated the extraction of 5 million records from on-premises data sources using stored procedures
Constructed client-oriented dimensional data models and implemented Agile techniques for effective management of stories and sprint progression
Designed and executed a system architecture for Azure Data Factory solutions, also configuring and deploying schema within Azure Storage Explorer to ensure efficient storage and quick data retrieval
Initiated and facilitated cross-functional team meetings, ensuring timely delivery of project milestones, contributing to the effective application of Agile methodologies, and improving overall team performance and efficiency
Azure Data Engineer
Engineered and set up an efficient data pipeline for processing customer data utilizing Python
Optimized queries using SQL and facilitated the production of visualization dashboards
Collaborated closely with the production team to develop a Machine Learning model, which led to a 16% increase in sales
Managed a team of three interns, creating extensive documentation encompassing detailed analysis, error tracking, and data management
Developed over 50 Tableau dashboards, which saved 15 hours of manual reporting per week