Were looking for a Senior Data Engineer with just the right amount of quirk craft and computational wizardry to help us take things up a notch (or twelve).
You will work within a team solving complex problems to deliver real business value across a wide range of industries such as mining telcos retail and financial services. You will help develop best practices and drive improvements in data engineering across the
Business!!
Duties & Responsibilities
Requirements:
- Graduate or Postgraduate degree in Computer Science Information Technology
- Statistics Engineering or related technical field
- 8 years of relational SQL database
- Solid understanding of Apache Spark as a distributed data processing framework
- Experience in designing implementing and performance tuning solutions in Apache Spark
- Experience in complex data warehouse and data lake design
- Experience in building optimising and manging data pipelines for large and complex datasets
- Experience using Azure cloud data platform technologies:
- Azure Storage / Data Lake
- Azure SQL Database
- Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics to implement data pipelines and analytical solutions
- Experience in Python would be beneficial
- Experience with streaming technologies such as Spark streaming or Kafka would be beneficial
- A relevant data engineering certification would be beneficial
Reference Number for this position is GZ60673 which is a permanent REMOTE position offering a cost to company salary of R1.1m per annum negotiable on experience and ability. Contact Garth on or call him on to discuss this and other opportunities.
Are you ready for a change of scenery The e-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the e-Merge website for more great positions.
Do you have a friend who is a developer or technology specialist We pay cash for successful referrals!
Required Experience:
Senior IC
IntroductionWere looking for a Senior Data Engineer with just the right amount of quirk craft and computational wizardry to help us take things up a notch (or twelve).You will work within a team solving complex problems to deliver real business value across a wide range of industries such as mining ...
Were looking for a Senior Data Engineer with just the right amount of quirk craft and computational wizardry to help us take things up a notch (or twelve).
You will work within a team solving complex problems to deliver real business value across a wide range of industries such as mining telcos retail and financial services. You will help develop best practices and drive improvements in data engineering across the
Business!!
Duties & Responsibilities
Requirements:
- Graduate or Postgraduate degree in Computer Science Information Technology
- Statistics Engineering or related technical field
- 8 years of relational SQL database
- Solid understanding of Apache Spark as a distributed data processing framework
- Experience in designing implementing and performance tuning solutions in Apache Spark
- Experience in complex data warehouse and data lake design
- Experience in building optimising and manging data pipelines for large and complex datasets
- Experience using Azure cloud data platform technologies:
- Azure Storage / Data Lake
- Azure SQL Database
- Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics to implement data pipelines and analytical solutions
- Experience in Python would be beneficial
- Experience with streaming technologies such as Spark streaming or Kafka would be beneficial
- A relevant data engineering certification would be beneficial
Reference Number for this position is GZ60673 which is a permanent REMOTE position offering a cost to company salary of R1.1m per annum negotiable on experience and ability. Contact Garth on or call him on to discuss this and other opportunities.
Are you ready for a change of scenery The e-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the e-Merge website for more great positions.
Do you have a friend who is a developer or technology specialist We pay cash for successful referrals!
Required Experience:
Senior IC
View more
View less