Enter a job title or keyword
Big Data Engineer
Job Location:
Job Location:
Johannesburg - South Africa
Monthly Salary:
Not provided by the employer
Monthly Salary:
Posted:
3 July 2026 (30+ days ago)
Posted:
Application Deadline:
30 September 2026
Application Deadline:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Our client in the Connectivity Services sector is looking for a Big Data Engineer on a contract duration of 6 months.
Role Purpose
The Big Data Engineer is responsible for designing developing and maintaining scalable big data pipelines that ingest transform and process large volumes of structured and unstructured data. The role supports the delivery of advanced analytics machine learning and customer insight solutions by building reliable high-performance data platforms and datasets that enable DataCos commercial and monetisation objectives.Key Responsibilities
- Design develop and maintain high-volume data ingestion transformation and processing pipelines using big data technologies.
- Build scalable audience builder pipelines customer segmentation layers and ADR-ready datasets to support analytics and monetisation use cases.
- Develop batch and streaming data pipelines for processing data from telecommunications networks CRM systems digital platforms and external data sources.
- Apply data quality controls validation cleansing and enrichment logic to ensure trusted production-ready datasets.
- Optimise pipeline performance scalability and reliability to support high-volume data processing.
- Collaborate with Solution Architects Data Scientists Product Owners and Data Analysts to deliver data products and machine learning solutions.
- Integrate data from multiple enterprise systems using ETL/ELT frameworks APIs and event-driven technologies.
- Support deployment monitoring troubleshooting and continuous improvement of data pipelines.
- Ensure compliance with data governance security privacy and enterprise architecture standards.
- Produce technical documentation and participate in Agile delivery ceremonies.
Qualifications & Experience
- Bachelors degree in Computer Science Information Technology Data Engineering or a related field.
- 58 years experience in Big Data Engineering or Data Engineering.
- Hands-on experience with Apache Spark Hadoop and distributed data processing frameworks.
- Strong SQL and programming skills in Python Scala or Java.
- Experience with ETL/ELT development data lakes data warehouses and cloud data platforms (AWS Azure or Google Cloud Platform).
- Experience with streaming technologies such as Apache Kafka is advantageous.
- Experience working with telecommunications customer analytics or digital platforms is preferred.
Key Competencies
- Big Data engineering
- Apache Spark and Hadoop
- ETL/ELT development
- Data pipeline development and optimisation
- SQL Python Scala or Java
- Data modelling and transformation
- Cloud data platforms
- Performance tuning and troubleshooting
- Data quality and governance
- Agile delivery and collaboration
Required Experience:
IC
About Company
With 15 years of experience in the Telecommunications and Financial Services industry in Africa and the Middle East, we are experts at supporting our clients through their digital transformation journeys. We believe in blending traditional methods with cutting-edge strategies to drive ... View more
