Data Engineering Leader (Azure)

Role: Data Engineering Leader

Experience: 17 years

Role Summary:

Lead the organizations data engineering function and build scalable reliable data platforms and pipelines. The role combines technical leadership architecture people management and stakeholder management.

Key Responsibilities

• Lead and mentor Data Engineers Senior Engineers and Data Architects.
• Design and implement scalable data platforms data lakes and data warehouses.
• Define data engineering architecture standards and best practices.
• Build and optimize ETL/ELT pipelines for large-scale data.
• Work with Cloud platforms such as AWS Azure or GCP.
• Partner with Data Science Analytics Product and Business teams.
• Ensure data quality governance security and reliability.
• Drive modernization of legacy data platforms.
• Manage technical roadmap delivery and engineering performance.
• Evaluate and introduce new data/AI technologies.

Key Technical Skills

Data Engineering

• Python / Java / Scala
• SQL
• ETL/ELT
• Apache Spark
• Kafka
• Airflow

Cloud

• AWS / Azure / GCP
• S3 / ADLS
• Databricks
• Snowflake
• Redshift / BigQuery

Data Architecture

• Data Lake
• Data Warehouse
• Lakehouse
• Data Modelling
• Distributed Systems

Leadership

• Team management
• Hiring and mentoring
• Stakeholder management
• Architecture decisions
• Project/program delivery