Senior AI Engineer – LLM & Generative AI

Bengaluru - India

Monthly Salary: Not Disclosed

Posted on: 16 hours ago

Vacancies: 1 Vacancy

Job Summary

Senior AI Engineer LLM & Generative AI

Location: India

Type: Full-time

Company: Zscaler

About Zscaler For over a decade Zscaler has been at the forefront of transforming the security industry. Our 100% cloud-native platform delivers the entire security stack as a service through 150 global data centers securely connecting users to their applications regardless of device location or network. We protect more than 7000 companies and detect over 150 million threats daily across 185 countries. Our culture is built on innovation collaboration and a passion for solving hard problems. If you are excited about AI Large Language Models (LLMs) and Generative AI and want to work on systems that bring intelligence and automation to enterprise-scale platforms - wed love to meet you. Role Overview We are seeking a Senior AI Engineer with practical experience in LLMs LangChain or similar frameworks and Retrieval-Augmented Generation (RAG) this role you will help design and deploy intelligent secure and scalable AI solutions that enhance Zscalers products and internal automation tools. The position emphasizes AI backend development and orchestration using Python cloud deployment (AWS preferred GCP optional) and integration of LLM-based services with light front-end development for chat interfaces copilots and dashboards.

Responsibilities

AI Solution Development: Build and maintain production-grade AI systems using LLMs LangChain and RAG pipelines to solve enterprise-scale problems.

Model Integration: Implement fine-tune and evaluate LLMs using frameworks such as LangChain LlamaIndex Hugging Face or OpenAI API.

Backend & API Engineering: Develop scalable Python microservices and APIs for inference and knowledge retrieval. Deploy and operate services on AWS (preferred) or GCP using EKS ECS or Cloud Run. Implement observability monitoring and autoscaling for production workloads.

Retrieval-Augmented Generation (RAG): Design and optimize retrieval workflows using vector databases like FAISS Pinecone or Milvus. Integrate both structured and unstructured data into LLM pipelines for grounded responses.

Front-End Integration: Collaborate with UI teams to integrate AI experiences into dashboards or chat UIs using React or TypeScript. Ensure seamless communication between front-end components and AI APIs.

Cloud & DevOps: Containerize and deploy using Docker and Kubernetes. Implement CI/CD pipelines with tools like Jenkins GitHub Actions or Terraform.

Cross-Functional Collaboration: Work closely with product data science and platform teams to deliver robust secure and impactful AI services.

Continuous Innovation: Stay current with LLM RAG and multi-agent system advancements and drive their adoption across products. Qualifications

Must-Have

Solid working experience with Python for AI service development API integration and data processing.

Practical hands-on experience with LangChain RAG pipelines or similar developer frameworks.

Familiarity with LLM integration prompt design and embedding-based retrieval.

Experience deploying applications on AWS (preferred) or GCP particularly with EKS ECS or Cloud Run.

Proficiency with Docker Kubernetes and cloud-native service orchestration.

Experience building RESTful or GraphQL APIs for AI and data services.

Understanding of cloud security scalability and performance optimization principles.

Good-to-Have

Experience developing conversational UIs copilots or AI-enabled dashboards (e.g. Slack apps chat widgets).

Familiarity with React or TypeScript for front-end feature integration.

Exposure to Hugging Face Transformers LlamaIndex or LangGraph ecosystems.

Knowledge of vector databases and data pipeline management.

Understanding of compliance privacy and responsible AI practices in enterprise environments.

Education & Experience

Bachelors or Masters degree in Computer Science Engineering or a related field.

Typically 4 8 years of experience in software or AI engineering including 2 years of hands-on experience with LLMs LangChain or RAG systems. Why Zscaler At Zscaler youll have the opportunity to shape the future of enterprise AI while working with a talented and passionate global team. Youll design intelligent systems that combine AI innovation with Zscalers industry-leading security platform - directly impacting how thousands of organizations operate safely and efficiently. If youre passionate about applied AI scalable cloud systems and turning research into real-world products join Zscaler and help us secure the future with intelligence.

Senior AI Engineer LLM & Generative AI Location: India Type: Full-time Company: Zscaler About Zscaler For over a decade Zscaler has been at the forefront of transforming the security industry. Our 100% cloud-native platform delivers the entire security stack as a service through 150 global da...