Senior Developer JavaLLMsRAGAI Agents (7-12 years)

We help the world run better
At SAP we keep it simple: you bring your best to us and well bring out the best in you. Were builders touching over 20 industries and 80% of global commerce and we need your unique talents to help shape whats next. The work is challenging but it matters. Youll find a place where you can be yourself prioritize your wellbeing and truly belong. Whats in it for you Constant learning skill growth great benefits and a team that wants you to grow and succeed.

What youll bring
You have deep experience in distributed systems and scalable application design with strong hands-on skills in LLMs advanced RAG patterns and agentic workflows.
Experience building agentic workflows on SAP AI Core and integrating LLM-based features into CAP Java applications is expected.
Proficiency in system design for scale resiliency and fault tolerance is required.
Strong experience in performance optimization cost management and troubleshooting complex production systems is essential.
A solid understanding of SRE principles observability (logs metrics tracing) and incident management is expected including Open Telemetry instrumentation and SAP Cloud Logging dashboards.
Experience designing evaluation frameworks for AI systems validating model behavior and applying agentic engineering patterns is critical.
You use Claude-style tools to generate code and ideas but you read and challenge their output you know when the AI is making the wrong call in both code and design.
Familiarity with multi-tenant SaaS architecture on SAP BTP (MTX service-manager IAS/AMS) is a strong advantage.
Four values matter at every level:
1. Learning agility (non-negotiable and the most important value) you rapidly pick up new models frameworks SAP Technologies ontologies and industry processes. You enjoy updating your mental model as the landscape shifts which it will frequently.
2. Bias for action you move quickly from ambiguity to a working prototype and learn through execution.
3. Critical thinking you ask the right questions so we stay focused on the objective instead of just managing the day.
4. End-to-end ownership you own the outcome from problem definition through build deployment and evaluation.

What youll build
Youll independently design and architect scalable AI-native application systems and components including advanced RAG pipelines and multi-agent workflows.
Youll design and build AI agents integrated into GHRAs revenue accounting domain including formula explanation disposition computation assistance and production volume analysis using SAP AI Core and CAP Java.
Youll contribute to the design of ontology-grounded agents for the domain encoding accounting rules formula structures and ownership relationships as structured knowledge that agents can reason over reliably rather than relying on prompt-only approaches.
Evaluation and benchmarking frameworks to measure AI system quality reliability and performance are things youll build and own. This includes domain-specific test harnesses that validate LLM outputs against known good formula results and accounting rules and the honest memo that explains why an idea shouldnt ship.
Youll optimize latency throughput and cost efficiency across systems including HANA Cloud query optimization and AI Core inference cost management.
Observability and SRE practices including monitoring alerting incident response and root cause analysis are areas youll implement and improve specifically enabling OTEL tracing across the CAP microservice fleet and building Cloud Logging dashboards for cross-service visibility.
Youll partner with platform data and AI teams to design robust production-ready solutions and improve system integration. System scalability resilience and maintainability are areas youll continuously work to strengthen.

Where you belong
If you need stable well-defined requirements before you can start this role will be uncomfortable. If youd rather supervise an AI than trust it blindly and you want to be the technical bridge between a complex accounting domain and an AI platform keep reading. Youll take end-to-end technical ownership of critical systems and contribute to engineering excellence across the team. Youll be the technical bridge between GHRAs domain logic (royalty production volumes ownership allocation) and the AI platform layer translating accounting business rules into context that agents can reason over reliably. Mentoring less-experienced engineers guiding design and code quality and building strong technical capabilities within the team are all part of the role. The team operates across global cross-functional groups in a culture that values continuous improvement operational excellence and knowledge sharing.

#SAPIndustryAICareers

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software SAP has evolved to become a market leader in end-to-end business application software and related services for database analytics intelligent technologies and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide we are purpose-driven and future-focused with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries people or platforms we help ensure every challenge gets the solution it deserves. At SAP you can bring out your best.

We win with inclusion
SAPs culture of inclusion focus on health and well-being and flexible working models help ensure that everyone regardless of background feels included and can run at their best. At SAP we believe we are made stronger by the unique capabilities and qualities that each person brings to our company and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application please send an e-mail with your request to Recruiting Operations Team:

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age race religion national origin ethnicity gender (including pregnancy childbirth et al) sexual orientation gender identity or expression protected veteran status or disability in compliance with applicable federal state and local legal requirements.

Successful candidates might be required to undergo a background verification with an external vendor.

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process.

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 458790 Work Area: Software-Design and Development Expected Travel: 0 - 10% Career Status: Professional Employment Type: Regular Full Time Additional Locations: #LI-Hybrid