DescriptionWe are seeking a highly skilled Data Engineer with experience to join our Data Management team. The ideal candidate will have a strong background in Azure technologies and advanced Python programming. This role involves designing building and optimizing data pipelines ensuring data security and enabling analytical capabilities across the organization.
In This Role Your Responsibilities Will Be:
- Design develop and maintain scalable and high-performance data pipelines using Azure Data Factory Azure Synapse Analytics and other Azure services.
- Develop and maintain ETL/ELT processes to ensure the quality consistency and accuracy of data.
- Implement data integration solutions across on-premise hybrid and cloud environments.
- Ensure the security availability and performance of enterprise data platforms.
- Work with relational (SQL Server Azure SQL) and non-relational databases (Azure Cosmos DB etc.).
- Build test and deploy data solutions using Azure DevOps version control and CI/CD pipelines.
- Develop and enforce data governance policies and practices to ensure data integrity and security.
- Perform code reviews and ensure the quality of deliverables from the other developers are as per the standards.
- Collaborate with multi-functional teams including designers developers and quality assurance engineers to build refine and improve software products.
- Optimize and fix large datasets using Python and Azure cloud-native technologies.
Who You Are:
A proficient professional characterized by thinking action-first consistently pursuing self-development to improve skills and knowledge. You possess a drive for achieving results demonstrating a dedication to excel in your endeavors. Tech-savvy professional adept at demonstrating technological tools to streamline processes and improve efficiency.
For This Role You Will Need:
- Bachelors degree in computer science or a related field.
- 3-5 years of experience as a Data Engineer including hands on experience of data orchestration using Azure Data Factory Azure Synapse Analytics MS Fabric or similar
- Solid understanding of Python/PySpark programming language and its applications.
- Strong SQL skills including experience with data modeling complex queries and performance optimization.
- Familiarity with version control systems (e.g. Git) and CI/CD pipelines (Azure DevOps).
- Knowledge of Data Lake Architecture Data Warehousing and Data Modeling principles.
- Familiarity with standard processes in data governance lineage security and privacy.
- Strong problem-solving communication and collaboration skills.
- Ability to work independently and manage multiple tasks simultaneously.
Preferred Qualifications That Set You Apart:
- Experience in implementing Medallion Architecture.
- Understanding of Dimensional Modeling and Data Mesh Architecture is an added advantage.
- Experience with RESTful APIs Data APIs and event-driven architecture.
- Expertise in Delta Tables and Delta live tables
- Experience in ODI/OBIEE and PL/SQL would be an added advantage.
- Strong analytical communication and teamwork skills.
- Microsoft Certified: Fabric Data Engineer Associate DP700 Microsoft Certified: Fabric Data Analyst Associate DP600 Microsoft Certified: Azure Data Engineer Associate DP203 Microsoft Certified: Azure Data Fundamentals DP900.
Our Culture & Commitment to You
At Emerson we prioritize a workplace where every employee is valued respected and empowered to grow. We foster an environment that encourages innovation collaboration and diverse perspectivesbecause we know that great ideas come from great teams. Our dedication to ongoing career development and growing an inclusive culture ensures you have the support to thrive. Whether through mentorship training or leadership opportunities we invest in your success so you can make a lasting impact. We believe diverse teams working together are key to driving growth and delivering business results!