Lead Data Engineer
Lead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
As an Azure Data Engineering Lead who will play a pivotal role in designing developing and managing our data engineering solutions on the Microsoft Azure platform. You will lead a team of data engineers to deliver scalable reliable and secure data pipelines that enable datadriven decisionmaking across the organization.
Key Responsibilities:
- Technical Leadership:
- Provide technical leadership and guidance to the data engineering team.
- Design and implement robust and scalable data pipelines using Azure Data Factory Azure Synapse Analytics Databricks and other relevant tools.
- Develop data ingestion transformation and loading processes to extract value from diverse data sources.
- Optimize data pipelines for performance and costefficiency.
- Ensure data quality integrity and security throughout the data lifecycle.
- Collaborate with data scientists analysts and business stakeholders to understand their data needs and translate them into technical solutions.
- Team Management:
- Lead and mentor a team of data engineers.
- Assign tasks monitor progress and provide timely feedback.
- Foster a collaborative and innovative team culture.
- Recruit and onboard new team members.
- Cloud Architecture:
- Design and implement cloudnative data architectures on Azure.
- Leverage Azure Data Lake Storage for efficient data storage and retrieval.
- Utilize Azure Synapse Analytics for unified data ingestion analytics and ETL.
- Explore the capabilities of Microsoft Fabric for a unified data and analytics platform.
- Data Governance:
- Establish and enforce data governance policies and standards.
- Implement data lineage and impact analysis to ensure data traceability.
- Monitor data quality and identify potential issues.
Required Skills and Experience:
- Strong proficiency in Azure Data Factory Azure Synapse Analytics Databricks and Azure Data Lake Storage.
- Experience with SQL Python and PySpark.
- Knowledge of data warehousing data modeling and ETL processes.
- Understanding of cloud computing principles and Azure services.
- Experience with data governance and data quality practices.
- Strong problemsolving and analytical skills.
- Excellent communication and interpersonal skills.
- Ability to lead and mentor a team of data engineers.
Preferred Qualifications:
- Experience with Microsoft Fabric.
- Certifications in Azure Data Engineering or related fields.
- Knowledge of machine learning and AI concepts.
- Experience with DevOps practices and CI/CD pipelines.
If you are passionate about data engineering and want to work with cuttingedge technologies on the Azure platform we encourage you to apply.
Employment Type
Full-Time
