Lead consultant GenAI LLM Ops Engineer

Ready to shape the future of work
At Genpact we dont just adapt to changewe drive it. AI and digital innovation are redefining industries and were leading the charge. Genpacts AI Gigafactory our industry-first accelerator is an example of how were scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at scale. From large-scale models to agentic AI our breakthrough solutions tackle companies most complex challenges.
If you thrive in a fast-moving tech-driven environment love solving real-world problems and want to be part of a team thats shaping the future this is your moment.
Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge operational excellence and cutting-edge solutions we help companies across industries get ahead and stay ahead. Powered by curiosity courage and innovation our teams implement data technology and AI to create tomorrow today. Get to know us at and on LinkedIn X YouTube and Facebook.

Inviting applications for the role of Lead consultant - GenAI LLM Ops Engineer were looking for an LLM Ops Engineer to build operate and scale our Large Language Model platforms and applications. Youll own the end-to-end operational lifecyclefrom model deployment and orchestration to reliability observability safety cost optimization and performance tuning. Youll partner closely with Data Science MLOps Security and Product teams to deliver robust compliant and efficient LLM-powered experiences.
Responsibilities
Architect secure reusable and modular infrastructure-as-code (IaC) frameworks for GenAI and LLM operations
Design deploy and maintain LLM serving infrastructure (e.g. Azure OpenAI self-hosted OSS models vector databases).
Implement model orchestration (routing ensemble strategies fallbacks retries cache layers).
Build CI/CD pipelines for prompt catalogs model configurations guardrails and evaluation suites.
Define and track LLM-specific SLOs (latency response quality safety violations hallucination rate).
Implement telemetry (traces logs metrics prompt/response analytics) and A/B experiments.
Establish alerting & incident response playbooks.
Lead the development and standardization of CI/CD pipelines for AI/ML model deployment
Ensure security privacy and regulatory compliance (data residency consent auditability).
Manage prompt governance (versioning approval of workflow change logs rollback).
Define and enforce best practices for model versioning governance and lifecycle management
Troubleshoot and resolve issues related to LLM deployment scaling and performance
Stay updated with advancements in MLOps LLMs and GenAI technologies

Qualifications we seek in you!
Minimum Qualifications
Bachelors degree in computer science Engineering or a related field
Proven experience in MLOps DevOps or AI/ML infrastructure roles
Hands-on experience with CI/CD pipelines containerization and orchestration tools (e.g. Docker Kubernetes)
Proficiency in scripting and programming languages such as Python Bash or similar
Experience with cloud platforms (AWS Azure GCP) and infrastructure-as-code tools (Terraform CloudFormation)
Strong understanding of machine learning model lifecycle management and operationalization
Knowledge of data privacy security and compliance standards in AI/ML environments

Preferred Qualifications
Masters degree in a relevant field
Experience with large language models (LLMs) and generative AI frameworks
Familiarity with monitoring logging and observability tools for AI/ML workloads
Experience collaborating with cross-functional teams in enterprise environments
Excellent problem-solving communication and documentation skills
Prior experience mentoring or leading technical teams
Why join Genpact
Be a transformation leader Work at the cutting edge of AI automation and digital innovation
Make an impact Drive change for global enterprises and solve business challenges that matter
Accelerate your career Get hands-on experience mentorship and continuous learning opportunities
Work with the best Join 140000 bold thinkers and problem-solvers who push boundaries every day
Thrive in a values-driven culture Our courage curiosity and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
Come join the tech shapers and growth makers at Genpact and take your career in the only direction that matters: Up.
Lets build tomorrow together.

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race color religion or belief sex age national origin citizenship status marital status military/veteran status genetic information sexual orientation gender identity physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity customer focus and innovation.
Furthermore please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a starter kit paying to apply or purchasing equipment or training.s