AI Architect

AI Architect PC Level

About the team:

At Capco we are dedicated to the financial services industries. Our professionals combine innovative thinking with unrivalled industry and domain expertise to offer our clients consulting expertise complex technology and package integration transformation delivery and managed services to move their organizations forward. Through our collaborative and efficient approach we help our clients successfully innovate increase revenue manage risk and regulatory change reduce costs and enhance controls. Our teams stay at the forefront of industry trends and technologies that are driving innovation. From strategy to launch we are adept at delivering across the full product lifecycle.

About the Job:

As a member of the Capco GenAI Technology Delivery Team in India youll bring practical knowledge of agile development methodologies and engineering best practices. As an AI Architect youll play an integral role using your experience and skills to contribute to the quality and implementation of our projects where you will design govern and continuously improve end-to-end GenAI solutions.

What youll do

• Solution Architect & deliver GenAI chat experiences
  • Design scalable low-latency and use your understanding of the structure of various backend systems such as authentication authorizationenterprise databases enterprise APIs knowledge bases the context of an end-to-end solution.
  • Assess end-to-end bot design and performance.
  • Choose and combine LLM access patterns (direct API fine-tuned models RAG) to meet accuracy cost and governance targets.
  • Develop chatbot solutions by utilizing solid understanding of the architectural principles in chatbots for knowledge management and self-service functionality by invoking APIs for validation request completion etc.
  • Translate business needs into working solutions aligned with enterprise architecture.
• Embed Retrieval-Augmented Generation (RAG)
  • Own schema design for vector stores (Pinecone FAISS pgvector etc OpenSearch) chunking strategies and embedding selection.
• Drive LLMOps / MLOps
  • Define CI/CD pipelines for prompts models and evaluation using MLflow SageMaker Pipelines Kubeflow or equivalent.
  • Instrument solutions with OpenTelemetry and automated eval suites for hallucination toxicity bias and drift.
• Fine-tune & align models
  • Apply parameter-efficient tuning (LoRA QLoRA Adapters) or RLHF where prompt-only falls short perform offline & online A/B tests.
• Ensure privacy security & compliance
  • Embed DPDPA GDPR SOC 2 controls: PII redaction encryption in transit/rest RBAC secure prompt logging.
  • Champion Responsible-AI principlesfairness explainability auditability.
• Optimize performance & cost
  • Profile and tune concurrency GPU/CPU utilization response-time budgets; recommend caching quantization batching while maintaining high accuracy and high security.
• Lead & mentor
  • Run architecture reviews code walkthroughs and knowledge-sharing for engineers across India and global locations.
  • Liaise with product owners and stakeholders to translate business goals into actionable architecture roadmaps.

What youll bring

• 10 years building distributed/cloud systems 3 years in conversational AI or GenAI.
• Deep expertise with Python and Java. including strong API-first design mindset (REST/gRPC/GraphQL).
• Hands-on with any two AWS Azure or GCP plus Docker Kubernetes and IaC (Terraform AWS CDK).
• Proven delivery using LangChain LlamaIndex Hugging Face Transformers and at least one vector store (Pinecone FAISS pgvector OpenSearch etc).
• Demonstrated MLOps / LLMOps practice: CI/CD for models/prompts automated testing canary & rollback lineage tracking.
• Experience fine-tuning or aligning large models (LoRA QLoRA PEFT RLHF) and benchmarking them.
• Track record implementing observability cost-guardrails and guardrails for toxicity/hallucination.
• Understanding of end-to-end solution patterns of chatbot solutions and related trade-offs.
• Familiarity with enterprise compliance frameworks (DPDPA GDPR) and security architecture.
• Strong communication & leadership skills able to influence across functions and mentor engineers.
• Implement current trends and best practices in AI/ML.
• Bachelors degree in computer science engineering information technology artificial intelligence or a related field. (or equivalent professional experience)

Why Capco

A career at Capco is a chance to help reshape the competitive landscape in financial services. We launch new banks transform existing ones and help our clients navigate complex change. As consultants we work on the front-end business design all the way through to technology implementation.

We are the largest Financial Services focused consultancy in the world serving everyone from global banks to emerging FinTechs from strategy through digital transformation design business consulting data and analytics cyber cloud technology architecture and engineering.

Capco is a young and growing firm. We maintain an entrepreneurial spirit and growth mindset and have minimal bureaucracy. We have no internal silos that get in the way of your career opportunities or ability to focus on our clients and make a difference to the business.

We offer the opportunity for everyone to learn rapidly take on tough challenges and get promoted quickly. We take pride in our creative collaborative diverse and inclusive culture where everyone can #BYAW.

Ready to Take the Next Step

If this sounds like you we would love to hear from you. This is an opportunity to make a difference and contribute to a highly successful company with a significant growth trajectory.