Big Data Engineer (Senior)
Cape Town - South Africa
Job Summary
Our client is seeking a Senior Big Data Engineer to build and optimise large-scale data platforms that support advanced analytics machine learning and enterprise data products. This is an exciting opportunity to work on high-volume data processing solutions within a cloud-first environment while collaborating with multidisciplinary engineering teams.
Key Responsibilities
- Design develop and maintain high-volume data ingestion and transformation pipelines.
- Build scalable feature stores analytical datasets and data processing frameworks.
- Optimise data workflows for performance scalability and reliability.
- Develop ETL/ELT solutions supporting enterprise data products.
- Collaborate with architects data scientists and platform engineers.
- Implement data quality validation and governance processes.
- Support cloud-native data engineering initiatives and platform optimisation.
- Produce technical documentation and support operational excellence.
Requirements
- Bachelors degree in Computer Science Engineering Information Systems or a related field.
- 10 years experience in data engineering or big data development.
- Strong experience with Spark Hadoop or similar distributed data processing technologies.
- Experience building enterprise-scale data pipelines.
- Strong SQL and programming skills (Python Scala or Java).
- Experience working with cloud-based data platforms.
- Excellent analytical and problem-solving skills.
Advantageous
- Experience with Azure Databricks or comparable cloud data platforms.
- Experience with Kafka or streaming technologies.
- Cloud certifications.
- Telecommunications financial services or enterprise analytics experience.
Personal Attributes
- Detail-oriented with a passion for data engineering.
- Strong collaboration and communication skills.
- Self-driven and adaptable.
- Able to manage multiple priorities effectively.
- Committed to delivering high-quality scalable data solutions.
Only shortlisted candidates will be contacted.
Submit your CV to or call .
Visit our website for more exciting career opportunities: will only be conducted with short listed candidates. Should you not hear from us within 4 days please consider your application unsuccessful.
Required Experience:
Senior IC