Senior Data Engineer – Channel & Data Insights
Job Location:
Hourly Salary:
Experience Required:
Posted:
Application Deadline:
Vacancies:
Job Summary
Our client is seeking a Senior Data Engineer to join the Channel & Data Insights team of a leading organisation in South Africa.
In this role you will design build and optimise robust data platforms and pipelines that power critical channel and business insights. Working primarily on the Microsoft Azure data estate (including Microsoft Fabric) you will deliver scalable ETL/ELT solutions modern data models and reliable data products that enable decision-making across the business.
- Design develop and maintain scalable data platforms and pipelines using Microsoft Fabric (Lakehouse Warehouse Data Pipelines notebooks semantic models) Azure Data Factory Databricks ADLS Gen2 Azure Synapse Analytics Event Hubs and Stream Analytics.
- Implement robust ETL/ELT processes and modern data modelling approaches (Kimball and/or Data Vault 2.0) to support analytical and operational reporting needs.
- Develop and optimize data transformations and processing logic using T-SQL Python and Apache Spark.
- Build and maintain CI/CD pipelines and Infrastructure-as-Code solutions (Bicep ARM PowerShell/CLI) via Azure DevOps to ensure reliable repeatable deployments.
- Apply data governance practices using tools such as Databricks Unity Catalog and/or Microsoft Purview to support data quality lineage security and compliance.
- Collaborate closely with data analysts product owners and business stakeholders to translate requirements into technical solutions and deliver measurable insights.
- Monitor troubleshoot and continuously improve platform performance reliability and cost efficiency in an Agile delivery environment.
- Contribute to best-practice standards documentation and knowledge sharing within the data engineering team.
Required Skills:
1215 years of technology delivery experience including at least 5 years in senior program or tribe-level delivery leadership. Proven leadership of scaled agile delivery using SAFe Spotify tribe/squad model or equivalent enterprise operating model across multiple concurrent squads. Strong telecommunications domain depth across BSS and OSS (billing charging CRM order management); experience with customer experience standards sales & distribution channels and enterprise digital delivery. Track record of scaling engineering hubs in emerging markets (recruitment ramp-up vendor-to-internal capability transition multi-country synchronization). Experience delivering fixed or converged broadband propositions and exposure to AI/Data platform delivery at production scale. Bachelors degree in Engineering Computer Science or related discipline; postgraduate qualification and certifications such as SAFe PMP or PgMP are advantageous. Advanced proficiency with delivery tooling (Jira or Azure DevOps flow metrics dependency boards); working fluency in at least one major cloud platform (Azure AWS or GCP). Demonstrated ability to lead multi-site multi-time-zone teams in emerging-market conditions; strong executive stakeholder management vendor escalation and commercial/financial control (budget ownership capacity planning cost-to-serve reporting).
