Tech Lead in Data Engineering
Tech Lead in Data Engineering
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Tech Lead Data Engineering
Position Overview:
As a Tech Lead in Data Engineering you will serve as a key technical advisor to stakeholders own end-to-end data engineering initiatives manage technical debt and mentor junior engineers. You will play a critical role in designing architecting and building robust scalable data solutions.
This role requires a strong software engineering mindset with proven experience writing production-grade Python code and solid expertise in Azure Databricks (PySpark) and SQL.
Key Requirements:
- Lead the design and development of batch and real-time data pipelines using tools like Databricks PySpark and DBT.
- Optimize data storage formats (e.g. Delta Lake Parquet) and implement data quality checks.
- Collaborate with data scientists and analysts to provide seamless access to data for analytics and machine learning.
- Manage Azure cloud infrastructure and ensure compliance with data privacy regulations.
- Mentor junior team members and promote best practices in data engineering.
Requirements:
- Masters or PhD in a related field.
- Python: minimum of 5 years of production-level coding experience
- SQL: advanced level
- Azure (Data Factory managed services): minimum of 2 years of experience
- Databricks with PySpark: minimum of 3 years of experience
- Fluent English
- Proven experience in building production pipelines making technical decisions and mentoring other engineer.
- Strong skills in data architecture ETL processes and cloud infrastructure management.
- Experience with CI/CD tools and data security best practices.
Employment Type
Full Time
