AIML Platform Architect

Req number:

Employment type:

Worksite flexibility:

Who we are

CAI is a global services firm with over 9000 associates worldwide and a yearly revenue of $1.3 billion. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients colleagues and communities. As a privately held company we have the freedom and focus to do what is rightwhatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors and we are trailblazers in bringing neurodiversity to the enterprise.

Job Summary

Job Description

We are looking for an AI/ML Platform Architect to lead the design strategy and implementation of cutting-edge AI/ML platforms and solutions. This position will be full-time hybrid and based in Bangalore.

What Youll Do

Enterprise AI Architecture & Strategy

• Define technical vision and architecture for conversational AI platforms AI governance systems and domain-specific agentic solutions

• Design cloud-native microservices-based architectures for GenAI applications using AWS/Azure Kubernetes and API management platforms

• Establish architectural standards for LLM integration (Claude OpenAI) RAG systems vector databases and AI orchestration

• Drive technology selection for frontend (React/Angular) backend (FastAPI ) databases (PostgreSQL MongoDB OpenSearch) and AI frameworks (LangChain LlamaIndex)

AI Governance & Security Architecture

• Design AI governance frameworks including usage tracking cost optimization access control (RBAC/ABAC) and compliance enforcement (SOC 2 GDPR)

• Architect API security patterns (OAuth 2.0 JWT mTLS) data encryption and audit logging for AI platforms

• Define multi-tenancy architecture for SaaS-based AI solutions with role-based access and data isolation

Technical Leadership & Collaboration

• Provide technical leadership to engineering teams (backend frontend AI/ML DevOps) across India CoE and Singapore

• Conduct architecture reviews design reviews and guide implementation decisions for high-impact GenAI projects

• Collaborate with product managers business stakeholders and executive leadership to align technical architecture with business objectives

• Mentor architects and senior engineers on cloud-native design AI/ML best practices and enterprise integration patterns

MLOps & Integration Architecture

• Design MLOps pipelines for AI model deployment versioning monitoring and A/B testing

• Architect enterprise integrations with APIs message brokers (Kafka RabbitMQ) and legacy systems using event-driven patterns

• Define observability and monitoring strategies using Prometheus Grafana Datadog and CloudWatch

What Youll Need

Required:

Enterprise Architecture Expertise

• 15 years in enterprise software architecture with 5 years designing AI/ML platforms or GenAI solutions

• Deep expertise in cloud-native architectures (AWS/Azure) microservices API design and distributed systems

• Strong knowledge of GenAI technologies (LLMs RAG systems vector databases prompt engineering agentic frameworks)

• Proven experience architecting enterprise-scale platforms serving 10000 users with high availability and security requirements

Technical Depth

• Expert-level knowledge of backend frameworks (FastAPI Django) frontend frameworks (React Angular) and database systems (SQL NoSQL vector databases)

• Strong understanding of AI/ML frameworks (LangChain LlamaIndex Hugging Face) model serving (TensorFlow Serving Triton) and MLOps practices

• Proficiency in API management (MuleSoft Apigee Kong) event-driven architectures and message brokers (Kafka RabbitMQ)

• Deep knowledge of security (OAuth 2.0 JWT encryption OWASP) compliance (SOC 2 GDPR) and data privacy

Leadership & Communication

• Proven ability to lead cross-functional teams influence technical decisions and drive architectural alignment

• Excellent communication skills with ability to present complex architectures to executive leadership and non-technical stakeholders

• Experience managing vendor relationships technology partnerships and third-party integrations

• Strong decision-making abilities based on data-driven insights trade-off analysis and business impact

Preferred:

• Certifications: AWS Solutions Architect Professional Azure Solutions Architect Expert TOGAF or equivalent

• Experience with AI governance platforms prompt management systems and LLM observability tools (LangSmith Weights & Biases)

• Knowledge of service mesh (Istio Linkerd) API federation and zero-trust security architectures

• Prior experience in manufacturing engineering or industrial domains is a plus

Physical Demands

• Ability to safely and successfully perform the essential job functions

• Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings etc.

• Ability to conduct repetitive tasks on a computer utilizing a mouse keyboard and monitor

Reasonable accommodation statement

If you require a reasonable accommodation in completing this application interviewing completing any pre-employment testing or otherwise participating in the employment selection process please direct your inquiries to or (888).