Applied AI Engineer II
Job Summary
Microsofts Applied AI Research team and help shape the future of AI-powered security and compliance. We are a high-impact team within Microsoft Purview focused on solving complex enterprise challenges in data security compliance governance and risk management. Our strength lies in turning bold ideas into reality taking innovations from concept to prototype and ultimately into products that deliver value to millions of users. As an AI Engineer you will work on cutting-edge AI technologies including large language models agentic systems reasoning frameworks and advanced machine learning solutions. You will partner with researchers architects engineers and product leaders to design and deliver intelligent experiences that improve how organizations protect and govern their most valuable data. This is an opportunity to own meaningful technical challenges influence platform strategy and contribute directly to the next generation of AI innovations powering Microsoft Purview.
Microsofts mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect integrity and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
- Design build and maintain AI system that hosts ML Models tools/APIs manage state/memory and reliably complete multi-step workflows.
- Own entire ML/DL development cycle through production including deployment monitoring and livesite reliability with an eval-first development lifecycle.
- Define success criteria build evaluation datasets and automated harnesses and run human-in-the-loop reviews where needed.
- Debug AI behavior and performance using log analysis data inspection and model/tool-call traces and translate failure patterns into targeted improvements.
- Establish and track AI quality metrics (e.g. accuracy relevance hallucination rate) and integrate them into CI/CD release gates.
- Optimize runtime performance and economics (token usage inference cost latency caching model selection/routing batching) and implement monitoring and continuous improvement loops (online signals drift detection structured user feedback).
- Partner with product design and domain stakeholders to define use cases acceptance criteria and rollout plans for AI features. Live site responsibility.
Qualifications
- Bachelors Degree in Computer Science Data Science or related technical field Should have atleast 5 years in building and maintaining ML/AI System.
- Hands on experience with MLOPs AIOps 4 years of experience in shipping at least 2 large scale ML/AI-based services or applications on cloud platforms (Azure AWS GCP etc.)
- 4 years technical engineering experience with coding in languages including C# Pythonand Pytorch Proficiency in writing production-quality software code in one or more modern programming languages (Python C#)
- 1-2 years of experience with LLMs and open-source GenAI frameworks such as LangChain LlamaIndex Haystack or equivalents (e.g. Transformers AutoGen DSPy) including agent-based orchestration prompt engineering retrieval-augmented generation (RAG) and fine-tuning and evaluation.
Other Requirements
Ability to meet Microsoft customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:
- This position will be required to pass the Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter.
#MSFTSecurity
This position will be open for a minimum of 5 days with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age ancestry citizenship color family or medical care leave gender identity or expression genetic information immigration status marital status medical condition national origin physical or mental disability political affiliation protected veteran or military status race ethnicity religion sex (including pregnancy) sexual orientation or any other characteristic protected by applicable local laws regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process read more about requesting accommodations.
Required Experience:
IC