AI & GenAI Solution Architect Azure Stack
Job Summary
Job Description: Role: Solutions Architect
Hybrid Role
Primary Skills: Azure Stack Python Microservices Restful services PL/SQLAI LLM Models RAGOCR models
Job description Solution Architect
Key Responsibilities
1. AI & GenAI Solution Architecture
Architect end to end AI and Generative AI solutions on Azure leveraging:
o Azure AI Foundry (projects prompt flows evaluations deployments)
o Azure OpenAI (GPT 4.x embeddings assistants/agents)
o Azure AI Search (vector hybrid semantic search)
Design agentic AI architectures including:
o Multi agent workflows using LangChain and LangGraph
o Tool calling routing memory management and stateful orchestration
Define reference architectures for:
o RAG (Retrieval Augmented Generation)
o Intelligent document processing
o Conversational AI and copilots
o Knowledge assistants and decision support systems
2. LangChain & LangGraph Architecture
Design and govern LLM orchestration frameworks using:
o LangChain chains tools retrievers and memory abstractions
o LangGraph for graph based stateful multi step workflows
Define patterns for:
o Supervisorworker agent models
o Conditional routing and branching logic
o Human in the loop workflows
Establish best practices for:
o Prompt engineering and prompt versioning
o Evaluation testing and regression of LLM outputs
o Agent observability and debugging (logs traces metrics)
3. NLP & Language AI Expertise
Lead solutioning for NLP use cases including:
o Text classification summarization entity extraction sentiment analysis
o Semantic search and knowledge extraction
o Conversational and domain specific language models
Leverage Azure NLP capabilities such as:
o Azure AI Language
o Custom text analytics and domain adaptation
Guide teams on language data preparation embeddings strategy and accuracy tuning
4. Python Based AI Engineering Leadership
Provide architectural guidance for Python based AI development including:
o API and microservice design for AI workloads
o Integration with Azure Functions App Service AKS
Define standards for:
o Code structure modularity and reuse
o Model and prompt lifecycle management
o Performance optimization and cost control
5. Enterprise Security & Governance
Design AI solutions aligned with enterprise and BFSI requirements including:
o Security privacy and data residency
o Azure Entra ID RBAC managed identities
o Private endpoints VNET integration network isolation
Define Responsible AI and governance frameworks:
o Prompt safety content filtering bias mitigation
o Auditability explainability and traceability
Support compliance with internal risk legal and regulatory standards
6. Delivery Stakeholder & Pre Sales Support
Lead architecture workshops and design sessions with:
o Business stakeholders and executives
o Product engineering and data teams
Translate business requirements into:
o Architecture diagrams
o Solution design documents
o Architecture Decision Records (ADRs)
Support RFPs RFIs and client proposals with AI solutioning effort estimates and roadmaps
Required Skills & Experience
Core Technical Skills
10 years in software engineering / solution architecture
5 years architecting solutions on Microsoft Azure
Strong hands on experience with:
o Azure AI Foundry
o Azure OpenAI Service
o Python for AI/ML and backend development
o LangChain and LangGraph
Solid background in NLP concepts and enterprise language AI
Azure Platform Expertise
Azure AI & Data Services:
o Azure AI Foundry Azure AI Search Azure AI Language
o Azure Machine Learning (preferred)
Application & Integration:
o Azure Functions App Service AKS
o Event driven and API based architectures
DevOps & IaC:
o Azure DevOps / GitHub
o Bicep / Terraform (preferred)
Soft Skills & Leadership
Strong communication skills for executive and technical audiences
Ability to lead architecture without formal authority
Experience working in global delivery models
Mentoring engineers and shaping AI engineering standards
Nice to Have
BFSI / regulated industry experience
Experience with:
o MLOps / LLMOps
o Prompt evaluation frameworks
o Observability for AI systems
Microsoft certifications:
o Azure Solutions Architect Expert
o Azure AI Engineer Associate
Required Skills:
Experience (Years): 8-10