Generative AI Applications Engineer (Agents & RAG)
Fairfield, OH - USA
Job Summary
Build AI that matters. We ship production GenAI apps for confidential federal programs across defense national security public safety civilian and military health where reliability privacy and safetyarentoptional. AFS is a technology company within global Accenture and a Glassdoor Top 100 Best Place to a collaborative inclusive community withhandsongrowth certifications and industry training. We ship in weeks not quarters and measure success with latency reliability safety and cost.
Confidentiality matters:Wedontdiscloseprogram details publicly. If you advancewellshare specifics during the process.
Role Overview
Youllturn mission needs into secure reliable and scalable GenAIapplicationsno model trainingrequired. This is a hands-on role across agentic workflows RAG prompt/policy design LLM evaluation and platform the end-to-end path from usecase evaluation production deployment operational excellence partnering with product security data and SRE to ship features safely and at scale.
WhatYoullDo (Day to Day)
- Design & shipmissiongradeGenAI: Build agentic workflows and RAG systems tailored to mission data and environments; target low hallucination tight p95 latency and predictable cost.
- Agent frameworks & orchestration: Apply patterns fromLangChain/LlamaIndex/Semantic Kernel; design task decompositiontooluse guardrails and recovery/fallback strategies.
- Platform integration (no model training): Implement with AWS Bedrock Azure OpenAI Google Vertex AI Amazon Kendra and managed services (e.g. Document AI Gemini Gemma).
- LLM selection & evaluation: Compare models for quality safety latency cost; author/test prompts & policies; deploy with observability and safe rollback/fallback.
- RAG done right: Build retrieval pipelines & vector search (PineconeWeaviate OpenSearchpgvector FAISS/Chroma); handle data prep chunking metadata andIRstyleevals (e.g. NDCG) to maximize signaltonoise.
- Production rigor: Instrument metrics/logs/traces; run A/B experiments;maintainincident playbooks; and implement safety & compliance guardrails.
- SRE & FinOps for AI: Define SLIs/SLOs (quality/latency/safety/cost) runoncalland postmortems reduce MTTR; meter usage andoptimizetoken/spend.
- Reusable platform components: Ship SDKs CI/CD templates Terraform/IaCmodules evaluation harnesses that accelerate multiple mission team not one-off projects.
- Operate in realworld constraints: Deliver into hybrid restricted or airgapped environments with Zero Trust principles and auditready controls.
YoullThrive Here If youhave
- End-to-end ownership of production systems: integration deployment observability incident response.
- Hands-on experience with LLMstransformerbasedapps and RAG in production.
- Strong Python
- Experience with vector search and retrieval (PineconeWeaviate OpenSearchpgvector FAISS/Chroma) and grounding AI in enterprise/mission data.
- U.S. Citizenship
Nice to Have
- Integration with leading cloud AI servicesoronpreminference stacks
- Background in LLM evaluation prompt authoring/testing A/B experimentation andLLMOps.
- Responsible AIexpertise(privacy security bias transparency humanintheloop) and data governance.
- Experience implementingtoolusingagents for API integration and external data access.
- Containerization & orchestration (Docker Kubernetes VMware) and scripting/automation (Linux Bash PowerShell).
- Prior work in regulated/secure environments (e.g. ATO STIGs Zero Trust) with fast shipping.
- Familiarity with NVIDIA AI Foundations OpenAI ChatGPT andAIassisteddev tools (Cursor Windsurf Claude).
- Contributions to internal frameworks or opensource; mentorship of engineers.
- Clear communication with engineers PMs and security/compliance stakeholders.
As required by local law Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states ofCalifornia Colorado Hawaii Illinois Maryland Massachusetts Minnesota New Jersey New York Washington Vermont the District of Columbia and the city of Cleveland. The base pay range for this position in these locations is shown below. Compensation for roles at Accenture Federal Services varies depending on a wide array of factors including but not limited to office location role skill set and level of experience. Accenture Federal Services offers a wide variety of benefits. You can find more information on benefits here. We accept applications on an on-going basis and there is no fixed deadline to apply.
The pay range for the states of California Colorado Hawaii Illinois Maryland Massachusetts Minnesota New Jersey New York Washington Vermont the District of Columbia and the city of Cleveland is:
$103200 - $203400 USD
Required Experience:
Unclear Seniority
About Company
Visit our Investor Relations section to view prior earnings releases, earnings call replays, transcripts and more.