Expert Machine Learning Engineer (Agentic AI, SAP BTP)

We help the world run better
At SAP we keep it simple: you bring your best to us and well bring out the best in you. Were builders touching over 20 industries and 80% of global commerce and we need your unique talents to help shape whats next. The work is challenging but it matters. Youll find a place where you can be yourself prioritize your wellbeing and truly belong. Whats in it for you Constant learning skill growth great benefits and a team that wants you to grow and succeed.

PURPOSE AND OBJECTIVES

As a critical part of SAPs AI Transformation journey the mission of the CPIT Order-to-Cash (O2C) Team is to drive the implementation of the companys strategy and achievement of shared businessobjectivesthrough world class end-to-end business processesand systems. Amongst the teams keyobjectivesare to innovate standardize simplify and automate SAPs core business processes andassurecontinuous alignment with the SAP IT portfolio and business all activities closing the loop from strategy to execution is key to driving impact for SAP and for our customers.

About the Role

We are looking for an Expert AI/Agentic Engineer who combines deep hands-on engineering excellence with a strong architectural mindset. You will design build and operate enterprise-grade AI/ML and Generative AI solutions within the SAP ecosystem - spanning intelligent assistants AI copilots agentic workflows and RAG-powered applications. You are first and foremost an engineer who writes production-quality code and you bring the architectural thinking to ensure what you build scales performs and lasts. You will work at the intersection of cutting-edge AI engineering and SAPs technology landscape contributing to systems that deliver measurable business impact.

What You Will Do

AI/GenAI Engineering & Architecture

• Design and build scalable LLM-powered applications intelligent assistants and AI copilots aligned to business transformation goals.
• Architect and implement advanced RAG pipelines knowledge retrieval systems and agentic / multi-agent workflows using commercial and open-source models.
• Write clean well-tested production-grade code across the full AI application stack - from data ingestion and embedding pipelines to orchestration logic API layers and evaluation harnesses.
• Integrate vector databases semantic search prompt orchestration tool/function calling memory and context-aware reasoning into enterprise-grade solutions.
• Optimize prompts inference pipelines and evaluation frameworks; contribute to fine-tuning alignment and model optimization efforts.
• Independently design scalable AI-native application systems - moving quickly from ambiguity to working deployable prototypes and iterating through execution.

SAP Ecosystem Integration

• Build agentic workflows on SAP AI Core and integrate LLM-based features into CAP /Fiori applications with strong coding standards and maintainability.
• Design and implement AI agents for enterprise domains - including formula explanation computation assistance and analytical workflows - using SAP AI Core and Python as the primary stack; CAP/Java as secondary.
• Contribute to the design of ontology-grounded agents that encode business rules formula structures and domain relationships as structured knowledge enabling reliable agent reasoning beyond prompt-only approaches.
• Architect and deploy solutions on SAP BTP with hands-on experience in multi-tenant SaaS patterns (MTX service-manager IAS/AMS).
• Knowledge of SAP Business Data Cloud (BDC) - including data products HANA Data Lake Delta Sharing and the semantic layer - is a strong advantage.

Platform LLMOps & Observability

• Establish and implement LLMOps practices covering deployment monitoring observability governance and guardrails - with hands-on implementation not just design.
• Instrument OTEL tracing across microservice fleets and build Cloud Logging dashboards for cross-service visibility.
• Optimize latency throughput and cost efficiency - including HANA Cloud query optimization and AI Core inference cost management.
• Apply SRE principles in practice: monitoring alerting incident response and root cause analysis.
• Build and own evaluation and benchmarking frameworks that measure AI system quality reliability and performance - including domain-specific test harnesses validating LLM outputs against known good results.

Research Innovation & Collaboration

• Contribute to PoCs accelerators and reusable AI solution ; actively participate in innovation incubation.
• Support publication of technical white papers and assets; contribute to patent ideation where applicable.
• Partner with platform data product and business teams to design robust production-ready solutions.
• Mentor junior engineers conduct rigorous code reviews and raise the engineering bar across the team.

What You Bring

Experience & Education

• 1012 years of hands-on experience in AI/ML Generative AI Data Science and/or Enterprise Architecture with a proven track record of delivering production-grade LLM and AI solutions.
• Degree in Computer Science AI Data Science Engineering or a related field.

Coding & Engineering Expertise (Strong - Non-Negotiable)

• Python (primary expert-level): You write clean modular well-tested Python code for AI pipelines agent frameworks orchestration logic APIs and evaluation systems.
• Java / CAP (secondary): Comfortable integrating AI features into SAP CAP Java microservices; able to read debug and contribute to Java codebases confidently.
• SQL & HANA Cloud: Strong SQL skills including query optimization analytical functions and working with HANA-specific constructs.
• You use AI coding tools to accelerate development but you read challenge and own every line you catch bugs design flaws and wrong architectural calls in AI-generated code.
• Proficiency in building and consuming RESTful and event-driven APIs; strong understanding of asynchronous programming patterns.
• Experience with unit testing integration testing and test harness design for AI systems.
• Comfortable with version control (Git) CI/CD pipelines code review practices and engineering hygiene at scale.

Technical Expertise

AI/ML & GenAI:

• Hands-on experience with LLMs foundation models Agentic AI and deep learning.
• Strong applied skills in prompt engineering RAG AI agents/multi-agent systems embeddings semantic search fine-tuning model evaluation and guardrails.
• Experience building and owning evaluation frameworks for AI systems including domain-specific validation of LLM outputs.

Frameworks & Tools:

• LangChain LlamaIndex Semantic Kernel Hugging Face OpenAI APIs.
• Vector databases: Pinecone Weaviate ChromaDB FAISS or HANA Cloud Vector Engine.
• TensorFlow PyTorch scikit-learn.

Architecture & Platforms:

• Distributed systems microservices/APIs scalable application design with resiliency and fault tolerance.
• Cloud AI platforms: SAP BTP (primary) AWS Azure or GCP.
• Kubernetes/Docker CI/CD for AI systems.

Data Engineering:

• Spark/Databricks data pipeline design and big-data ecosystems.
• HANA Cloud query design and optimization.

SAP Ecosystem Knowledge

• Hands-on experience with SAP AI Core and the SAP Generative AI Hub.
• Practical experience with CAP (Cloud Application Programming Model) in Java or .
• Understanding of SAP BTP services multi-tenancy patterns (MTX) IAS/AMS.
• Knowledge of SAP Business Data Cloud (BDC) - data products object store Delta Sharing semantic layer - is a distinct advantage.

Preferred Qualifications

• Open-source contributions publications or patent filings.
• Hands-on experience in GenAI transformation enterprise search copilots or autonomous agent frameworks.
• Strong understanding of Responsible AI governance and AI security.
• Experience with AI cost management and performance benchmarking in production environments.

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software SAP has evolved to become a market leader in end-to-end business application software and related services for database analytics intelligent technologies and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide we are purpose-driven and future-focused with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries people or platforms we help ensure every challenge gets the solution it deserves. At SAP you can bring out your best.

We win with inclusion
SAPs culture of inclusion focus on health and well-being and flexible working models help ensure that everyone regardless of background feels included and can run at their best. At SAP we believe we are made stronger by the unique capabilities and qualities that each person brings to our company and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application please send an e-mail with your request to Recruiting Operations Team:

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age race religion national origin ethnicity gender (including pregnancy childbirth et al) sexual orientation gender identity or expression protected veteran status or disability in compliance with applicable federal state and local legal requirements.

Successful candidates might be required to undergo a background verification with an external vendor.

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process.

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 459241 Work Area: Software-Design and Development Expected Travel: 0 - 10% Career Status: Professional Employment Type: Regular Full Time Additional Locations: #LI-Hybrid