Intermediate HiveNiFi Engineer

Our Story

At (formerly SovTech) we believe the future of software lies in the talent innovation and creativity found on the African continent. For over a decade we have been pioneering world-class software development for a global audience. We are the leading custom software development company from Africa that like any great tech company was founded in a garage. has now grown to more than 350 of the best AI-powered software engineering experts building world-class platforms for growing businesses across four cities on three continents.

Looking ahead we remain committed to growing Africas tech ecosystems. Africa is home to the worlds youngest population with over 50% of Africans under the age of 25. Recent estimates indicate there are over 700000 professional software developers across Africa today. That number is projected to double by 2025. We believe in the future of African tech talent and the impact it will have on scaling global companies.

Accelerating business growth with expert tech talent

Trusted by 400 companies helps businesses scale with our cloud-based engineering subscription platform offering consistent cost-effective AI-powered experts teams and reliable developer analytics.

Our Culture

Our culture is underpinned by 8 core values.

Earths leading software company from Africa- thats where were going.

Why Join Us

Be part of a dynamic people-first team thats showcasing and advancing Africas tech landscape on the global scale. At we celebrate your individuality empower your decision-making and create meaningful experiences. Together were driving innovation and building exceptional teams Take a look at some of the highlights:

Embrace Our African Talent Footprint Flexibility and Autonomy

• At we champion an empowered workplace where you shape the culture influence decisions on tech stacks and take charge of user testingall while working from wherever you thrive best across our interconnected Guilds.

• Our distributed teams span South Africa Nigeria Kenya Zimbabwe and other parts of the continent showcasing the diversity and brilliance of African talent.

The Vibes

• Annual Foos-Fest : Showcase your skills at our legendary Foosball Festival and take home quirky sought-after awards.

• AI-Powered Hackathons : Collaborate with your team to create innovative market-ready products in just 24 hoursall while enjoying live music and family-friendly fun.

• Year-End Celebrations : Reflect and connect at our unforgettable year-end events a decade-old tradition we continue to cherish.

• Popcorn Fridays Dev Chats and Braais : Bond with colleagues over insightful discussions and sizzling good vibes.

• Fluid Clubs : Join like-minded peers in activities like hiking running and more to foster shared interests beyond work.

• Weekly All-Hands : Stay inspired and in the loop with our weekly All-Hands sessions that bring us together as one team.

• Explore Week : Our annual tradition encourages you to work from anywhere around the globe for one exciting weekfreedom meets inspiration!

Rewards & Recognition

• Stacos (our company currency) : Reward and recognise your peers with Stacos and exchange them for cool vouchers to celebrate accomplishments big and small.

• Commission Incentives : Unlock attractive rewards for successful business development leads and employee referrals.

Continued Career Growth & Support

• Internal AI Platforms : We empower our teams with access to both closed and open source LLMs that make work easier and empower your professional growth. We love AI!

• High-Performance Culture : Stay aligned and on track with OKRs (Objectives and Key Results) and structured annual reviews.

• Personalized Mentorship : Receive dedicated guidance from leadership and the Talent SuccessTeam through one-on-one sessions and quarterly check-ins tailored to your career aspirations.

Transforming How We Work

• Our teams embrace cutting-edge AI platforms agents and tools creating smarter workflows and accelerating career development with AI.

• OpenAI Anthropic Llama - we use them all so choose what suits you best!

• You dont need your own licenses - we cover the costs and have our own internal AI platforms that gives you access to them all in a secure environment.

Outstanding Employee Benefits*

• Discovery Medical Aid : Prioritizing your health with the best care.

• Half-Day Birthday Leave : Celebrate your special day with an afternoon off!

• Family responsibility & Parental Benefits : Providing full support for a meaningful work-life balance.

*Please note: Benefits may vary depending on employment type

Join us and be part of a dynamic supportive team thats making waves across Africa.

Location: Midrand

Contract Type: Independent Contractor Agreement

Engagement: Length 12 months

Years of Experience: 35 years in data engineering or analytics roles

Qualifications: Bachelors or Masters degree in Computer Science Software Engineering or a related field.

Certifications: Advantageous

Work Model Hybrid

Key Skills

Strong experience with Apache NiFi (design optimization troubleshooting).

Proficiency in HiveQL and PL/SQL-like logic for big data analytics.

Solid understanding of HDFS Impala and Cloudera ecosystem.

Familiarity with telecom data structures (PGW MSC CDRs etc.) is a plus.

Knowledge of data modeling principles and performance tuning.

NiFi Pipeline Management & Optimization

Design configure and optimize Apache NiFi flows for high-volume data ingestion.

Implement best practices for NiFi performance tuning error handling and scalability.

Monitor and troubleshoot NiFi processors controllers and data provenance.

Ensure secure data transfer and compliance with telecom data standards.

Data Analytics & Modeling

Develop and maintain PL/SQL-like logic in Hive for data aggregation and transformation.

Create analytical models to support telecom KPIs (e.g. usage quality of service revenue).

Optimize Hive queries for performance and scalability in large datasets.

Collaborate with data scientists and business analysts to design reusable semantic layers.

Data Quality & Governance

Implement data validation cleansing and enrichment processes.

Ensure consistency and accuracy across multiple data sources.

Collaboration & Documentation

Work closely with architects and senior engineers to align with the overall data strategy.

Document workflows data models and optimization techniques.

Accountability

Ensure code is version-controlled and committed to the repository as per company standards.

Complete all required documentation on time and upload to the required directories.

Adhere to development timelines.

Maintain and contribute to system standards.

Submit timesheets by the close of business on Fridays.

Ensure all project deliverables are delivered timeously with the Team Leader/PM.

Technical Skills

Strong experience with Apache NiFi (design optimization troubleshooting).

Proficiency in HiveQL and PL/SQL-like logic for big data analytics.

Solid understanding of HDFS Impala and Cloudera ecosystem.

Familiarity with telecom data structures (PGW MSC CDRs etc.) is a plus.

Knowledge of data modeling principles and performance tuning.

Experience

35 years in data engineering or analytics roles.

Experience in telecom or similar high-volume data environments.

Exposure to ETL tools data governance frameworks and cloud platforms (AWS Azure or GCP).

Soft Skills

Strong analytical and problem-solving ability.

Excellent attention to detail and data accuracy.

Ability to work independently and collaboratively within a cross-functional team.

Effective communication skillsable to translate technical detail into business understanding.

Curiosity and willingness to learn new technologies and tools.

Accountability ownership and a proactive attitude in resolving challenges.

Nice to Have

Exposure to telecoms data such as subscriber offer or network performance datasets.

Familiarity with Agile delivery practices Git and CI/CD workflows.