Senior Data Engineer

Future Fit

Not Interested
Bookmark
Report This Job

profile Job Location:

Johannesburg - South Africa

profile Monthly Salary: Not Disclosed
Posted on: 10 hours ago
Vacancies: 1 Vacancy

Job Summary

Job Title: Senior Data Engineer

Job Type: Contract Remote

Location: South Africa

Department: Data & Analytics

Reports To: Head of Data Science / Director of Analytics / CTO

Key Responsibilities:

  • Lead the design development and maintenance of scalable data pipelines and systems.
  • Implement and oversee data integration solutions to consolidate data from various sources.
  • Optimize data architecture and data flow for performance reliability and scalability.
  • Collaborate with data analysts scientists and other stakeholders to understand data requirements and deliver solutions.
  • Ensure data quality and integrity through rigorous testing validation and monitoring.
  • Develop and maintain ETL processes to extract transform and load data.
  • Monitor troubleshoot and improve data systems to ensure smooth operation.
  • Stay updated with the latest industry trends and technologies to continuously enhance data infrastructure.
  • Mentor and guide junior data engineers and other team members.

Qualifications:

  • Bachelors or Masters degree in Computer Science Engineering Information Technology or a related field.
  • Extensive experience as a Data Engineer or in a similar role with a proven track record of building and maintaining data infrastructure.
  • Proficiency in advanced data engineering tools and technologies (e.g. SQL (Python AI/ML libraries) Hadoop Apache Spark Git and Github Google Colab AutoML platforms)
  • Strong understanding of database management systems data warehousing and big data technologies.
  • Experience with cloud platforms (e.g. AWS Azure Google Cloud) is highly desirable.
  • Excellent problem-solving skills and attention to detail.

Skills:

  • Ability to design and implement complex data systems.
  • Proficiency in programming languages such as Python Java or Scala.
  • Experience with big data technologies and frameworks.
  • Knowledge of data modelling and database design.
  • Ability to work independently and lead a team.
  • Strong analytical and troubleshooting skills.
  • Leadership and mentoring abilities.

Benefits:

  • Competitive salary.
  • Opportunities for professional development and growth.
  • Remote working hours
  • Leadership opportunities within the data engineering team
Job Title: Senior Data Engineer Job Type: Contract Remote Location: South Africa Department: Data & Analytics Reports To: Head of Data Science / Director of Analytics / CTO Key Responsibilities: Lead the design development and maintenance of scalable data pipelines and systems. Implement and overs...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala