Senior Data Engineer

Outsidecapital

Not Interested
Bookmark
Report This Job

profile Job Location:

Johannesburg - South Africa

profile Monthly Salary: Not Disclosed
Posted on: 20 hours ago
Vacancies: 1 Vacancy

Job Summary

Job Description

Our client is a rapidly scaling high-growth data-tech business that designs and builds cutting-edge data-driven solutions for the retail and consumer industries. They combine complex geo-spatial data consumer insights and advanced analytics to help leading brands make critical location strategy and marketing decisions. Operating as an agile entrepreneurial and non-corporate division within a highly established and respected global group they are embarking on an ambitious 3x growth plan over the next four years.

Performance Objectives for Year One:

  • Architect and Deploy Scalable Pipelines: Within the first 6 months design build and operationalize robust end-to-end ETL/ELT pipelines to acquire transform and load massive volumes of consumer and geo-spatial data.
  • Drive End-to-End Automation: Re-engineer and automate existing data acquisition ingestion and modeling processes across batch and hybrid landscapes significantly reducing manual intervention and increasing system efficiency by year-end.
  • Establish Data Quality Frameworks: Implement rigorous data validation cleansing and integrity checks to ensure 100% data reliability and accuracy for downstream analytics and client-facing products.
  • Lead Cross-Functional Integration: Partner closely with data scientists analysts and business leaders to translate complex commercial requirements into clean organized and highly accessible database designs and data models.
  • Modernize the Data Ecosystem: Proactively evaluate and integrate emerging technologies data streaming tools and APIs into the current Microsoft-centric (SQL/SSIS) environment to future-proof the data architecture.

Required Experience:

Senior IC

Job DescriptionOur client is a rapidly scaling high-growth data-tech business that designs and builds cutting-edge data-driven solutions for the retail and consumer industries. They combine complex geo-spatial data consumer insights and advanced analytics to help leading brands make critical locatio...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala

About Company

Company Logo

OutsideCapital Recruitment Agency is a level BBBEE2 executive search and recruitment advisor able to assist you with all your business needs.

View Profile View Profile