LLM Engineer

LLM Engineer

We are seeking a highly skilled LLM Engineer with a minimum of 5 years of experience in software development and 12 years in LLM solution development. The ideal candidate will have strong experience working with Python LLM solution patterns and tools (RAG Vector DB Agentic workflows LoRA etc. cloud platforms (AWS Azure GCP) and DevOps tools. They will be responsible for designing and developing scalable software solutions leading architecture design and ensuring the performance and reliability of our systems.

Responsibilities:

• Take ownership of architecture design and development of scalable and distributed software systems.
• Translate business to technical requirements
• Own technical ensuring code quality adherence to deadlines and efficient resource allocation
• Data driven decision making skills with focus on achieving product goals
• Design develop and deploy LLM based pipelines involving patterns like RAG Agentic workflows PEFT (e.g. LORA QLORA etc.
• Responsible for the complete software development lifecycle including requirements analysis design coding testing and deployment.
• Utilize AWS services/ Azure services like IAM Monitoring Load Balancing Autoscaling Database Networking storage ECR AKS ACR etc.
• Implement DevOps practices using tools like Docker Kubernetes to ensure continuous integration and delivery. Develop DevOps scripts for automation and monitoring.
• Collaborate with crossfunctional teams conduct code reviews and provide guidance on software design and best practices.

Qualifications (essentials in bold):

• Bachelors degree in computer science Information Technology or a related field (or equivalent work experience).
• At least 5 years of experience in software development with relevant work experience in LLM app development.
• Strong coding skills with proficiency in Python and Javascript
• Experience with API frameworks both stateless and stateful such as Fast API Django
• Well versed in implementation of web sockets gRPC access management using JWT (Azure AD IDM preferred)
• Proficient in cloud platforms specifically AWS Azure or GCP
• Knowledge and handson experience with frontend development (React JS Next JS Tailwind CSS) preferred
• Strong experience in LLM patterns like RAG Vector DB Hybrid Search Agent development Agentic workflows prompt engineering etc.
• Strong experience with LLM APIs (Open AI Anthropic AWS Bedrock) SDKs (Langchain DSPy)
• Handson experience with DevOps tools including Docker Kubernetes and AWS services (Redshift RDS S3.
• Experience in production deployments involving thousands of users
• Strong understanding of scalable application design principles and experience with security best practices and compliance with privacy regulations.
• Good knowledge of software engineering practices like version control (GIT) DevOps (Azure DevOps preferred) and Agile or Scrum.
• Strong communication skills with the ability to effectively convey complex technical concepts to a diverse audience.
• Experience of SDLC and best practices while development
• Experience with Agile methodology for continuous product development and delivery

Fluency in English is required additional fluency in at least one European or Asian language is desirable.