Enter a job title or keyword

GenAI LLM Engineer

A 1 L


Job Location:

Johannesburg - South Africa

Monthly Salary: Not provided by the employer
Posted: 11 July 2026 (30+ days ago)
Application Deadline: 8 October 2026
Vacancies: 1 Vacancy

Job Summary

Our client in the Telecoms sector is looking for a GenAI / LLM Engineer on a contract duration of 6 months.

Role Purpose
The GenAI / LLM Engineer is responsible for designing developing and deploying Generative AI solutions that enable intelligent conversational access to enterprise data products. The role builds and optimises Large Language Model (LLM) applications Retrieval-Augmented Generation (RAG) solutions and AI agents that transform data catalogues and analytical products into conversational agent-callable services supporting DataCos digital analytics and monetisation strategy.




Key Responsibilities
  • Design develop and deploy Generative AI and LLM-powered applications for enterprise data products.
  • Build Retrieval-Augmented Generation (RAG) solutions that enable secure context-aware access to enterprise knowledge and data assets.
  • Develop conversational interfaces and AI assistants that allow users to interact with data products using natural language.
  • Design AI agents and agent-callable services that integrate with enterprise applications APIs and data platforms.
  • Develop prompt engineering strategies orchestration workflows and LLM evaluation frameworks to improve response quality and reliability.
  • Integrate LLM solutions with enterprise data platforms data catalogues analytics environments and machine learning services.
  • Optimise model performance latency scalability and operational efficiency for production environments.
  • Implement AI governance responsible AI practices security controls and data privacy requirements.
  • Collaborate with Data Scientists Data Engineers Platform Engineers Solution Architects and Product Owners to deliver AI-enabled products.
  • Monitor solution performance continuously improve AI capabilities and maintain technical documentation.
Qualifications & Experience
  • Bachelors degree in Computer Science Artificial Intelligence Data Science Information Technology or a related discipline.
  • 58 years experience in software engineering machine learning engineering or AI solution development.
  • Hands-on experience developing applications using Large Language Models (LLMs) and Generative AI technologies.
  • Experience implementing Retrieval-Augmented Generation (RAG) vector databases and semantic search solutions.
  • Strong programming skills in Python and experience with AI frameworks such as LangChain LangGraph LlamaIndex or similar orchestration frameworks.
  • Experience integrating REST APIs cloud AI services and enterprise data platforms.
  • Knowledge of Azure AI Azure OpenAI Databricks AI OpenAI or equivalent enterprise AI platforms is highly desirable.
  • Experience with MLOps model deployment and monitoring is advantageous.
Key Competencies
  • Generative AI and Large Language Models (LLMs)
  • Retrieval-Augmented Generation (RAG)
  • AI agents and agentic workflows
  • Prompt engineering and LLM optimisation
  • Python development
  • Vector databases and semantic search
  • API integration and microservices
  • Responsible AI security and governance
  • Cloud AI platforms (Azure AI Databricks AI or equivalent)
  • Agile delivery and cross-functional collaboration



Required Experience:

IC


About Company

Company Logo

With 15 years of experience in the Telecommunications and Financial Services industry in Africa and the Middle East, we are experts at supporting our clients through their digital transformation journeys. We believe in blending traditional methods with cutting-edge strategies to drive ... View more

View Profile View Profile