An exciting opportunity has become available for an experienced Lead Data Engineer to join a forwardthinking investment and technologydriven environment on a 12month contract based onsite in Centurion. This role is ideal for a seniorlevel data engineering professional ready to take on a pivotal leadership position in driving modern data solutions team performance and enterprisewide data initiatives.
Duties & Responsibilities
Role Overview:
As the Lead Data Engineer you will be responsible for leading the design development and optimization of data warehouse solutions and modern data engineering practices. Youll lead a team of skilled SQL developers oversee the development of scalable ETL pipelines and robust data infrastructure and ensure that data solutions support strategic datadriven decisionmaking across the organization.
Key Responsibilities:
Lead and mentor a team of SQL developers focused on warehouse and data lake development
Drive the design and implementation of scalable efficient ETL/ELT processes and data models
Oversee team performance delivery timelines and capacity planning
Ensure adherence to best practices in SQL development and data engineering standards
Collaborate with data architects analysts and crossfunctional teams to deliver highquality data solutions
Optimize and maintain SQL queries stored procedures and backend database performance
Automate deployment pipelines using GitLab CI/CD
Stay updated on industry trends and emerging technologies to recommend and implement innovative data solutions
Provide coaching training and ongoing support to team members to foster technical growth
Minimum Requirements:
Bachelors degree in Computer Science Engineering or related field
8 years of experience in data engineering and SQL development roles
3 years in a leadership or team lead capacity
8 years handson SQL development including data warehousing ETL and performance tuning
6 years of experience with Python for data processing and ETL pipeline development
Proficiency with SQL Server Oracle PostgreSQL
Strong understanding of ETL tools such as SSIS
Deep knowledge of data warehousing principles and distributed computing
Advantageous Skills & Tools:
Experience with AWSnative data tools (e.g. Glue Parquet)
Familiarity with Informatica Talend or other ETL platforms
Exposure to big data technologies such as Hadoop Spark Kafka
Experience with GitLab CI/CD automation workflows
Programming knowledge in C# Java or Scala
Certifications in cloud or data engineering (e.g. AWS Certified Data Analytics)
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.