Senior Azure GenAI LLM Engineer
Share
Job Location:
Monthly Salary:
Experience Required:
Posted on:
8 hours ago
Vacancies:
1 Vacancy
Job Summary
Role: Senior Azure GenAI / LLM Engineer (Azure stack)
1. Generative AI & LLM Application Development
Build and deploy LLM powered applications using:
o Azure AI Foundry (projects prompt flows evaluations deployments)
o Azure OpenAI (chat embeddings assistants/agents)
Implement use cases such as:
o Conversational AI and copilots
o Knowledge assistants and Q&A systems
o Intelligent document understanding and summarization
Integrate AI capabilities into enterprise applications via APIs and microservices
2. LangChain & LangGraph Implementation
Develop LLM orchestration logic using:
o LangChain chains tools retrievers and memory
o LangGraph for graph based stateful workflows
Implement:
o Multi step reasoning workflows
o Tool calling and function execution
o Supervisor/worker and multi agent patterns
Manage conversational state context windows and memory persistence
3. RAG & NLP Engineering
Build Retrieval Augmented Generation (RAG) pipelines using:
o Azure AI Search (vector and hybrid search)
o Embeddings from Azure OpenAI / Foundry model catalog
Engineer NLP pipelines for:
o Text extraction classification summarization
o Entity recognition and semantic search
Curate chunk embed and validate enterprise knowledge sources for accuracy and freshness
4. Python Based AI Engineering
Develop production grade Python services and libraries for AI workloads
Implement:
o API layers and orchestration services
o Async execution streaming and batching
Optimize:
o Latency cost and token usage
o Prompt structure and context management
Follow engineering best practices for testing versioning and modularity
5. Safety Reliability & Governance
Implement guardrails and safety controls:
o Content filtering and moderation
o Prompt validation and response checks
Build evaluation and feedback loops:
o Accuracy relevance and hallucination detection
o Regression testing for prompts and workflows
Ensure compliance with enterprise security and data handling standards
6. Cloud & DevOps Integration
Deploy AI workloads using:
o Azure App Service Azure Functions or AKS
Integrate with:
o Azure Entra ID (authentication and authorization)
o CI/CD pipelines and observability tools
Support monitoring logging and traceability of AI workflows in production
Required Skills & Experience
Core Skills
58 years of software engineering experience
Strong hands on Python development experience
Practical experience building applications using:
o Azure AI Foundry
o Azure OpenAI Service
o LangChain and LangGraph
Solid understanding of LLMs RAG and NLP concepts
Azure & AI Stack
Azure services:
o Azure AI Foundry
o Azure AI Search
o Azure OpenAI
Experience with:
o Vector databases and embeddings
o REST APIs and microservices
Familiarity with DevOps and cloud native deployment models
Soft Skills
Ability to translate solution designs into working code
Strong problem solving and debugging skills
Effective collaboration with architects and cross functional teams
Clear documentation and communication skills
Nice to Have
BFSI or regulated industry experience
Exposure to:
o MLOps / LLMOps
o Evaluation frameworks and observability tooling
Experience with Responsible AI and governance frameworks
Azure AI or cloud certifications
Required Skills:
Experience (Years): 4-6 Essential Skills: Work with project teams throughout the organization to design implement and manage CDN infrastructure using Akamai to ensure high availability performance and scalability for customer facing applications and business processes. Handle multiple priorities and assignments with excellence and precision. Be a part of a 24/7/365 organization (some after hours support is expected as part of normal on-call rotation). Directly support line of business development teams provide guidance to them on implementation and changes for customer facing applications Develop and maintain security protocols and measures to protect CDN infrastructure from cyber threats. Monitor and analyze network performance identifying and resolving issues to optimize content delivery of critical applications. Collaborate with cross-functional teams to integrate Akamai CDN solutions with existing systems and applications. Collaborate with information security teams to implement DDoS protection strategies and other security measures in the CDN. Provide technical support and guidance to clients and internal teams regarding CDN and security best practices. Work closely with vendor and professional service teams on delivery related activities and strategy. Qualifications: Bachelors degree in Computer Science Information Technology or a related field. OR similar work experience. Strong understanding of network protocols (HTTP/HTTPS DNS TCP/IP). Proven experience as a CDN Engineer or similar role with a strong focus on -depth knowledge of Content Delivery Network technologies including caching load balancing and content optimization. Excellent problem-solving skills and attention to detail. Strong communication and teamwork abilities. Experience supporting 24/7/365 customer facing applications at enterprise scale. Awareness and experience with cybersecurity tools and practices such as firewalls intrusion detection/prevention systems and encryption. Proficiency in scripting and automation (e.g. Python Bash) a plus. Relevant certifications (e.g. CISSP CEH) are a plus but not required.
