Enter a job title or keyword

Senior AI Engineer

Rohirrim


Job Location:

McLean, MD - USA

Monthly Salary: Not provided by the employer
Posted: 3 July 2026 (30+ days ago)
Application Deadline: 30 September 2026
Vacancies: 1 Vacancy

Department:

Engineering

Job Summary


Note: This is a Hybrid Role - 3 days per week in our office in McLean VA

What Youll Do
Agent Design & Development
  • Architect and build multi-agent systems and autonomous workflows for document analysis requirement extraction RFP response generation and procurement pipeline automation.
  • Design and implement agentic orchestration using frameworks such as LangGraph AutoGen CrewAI or custom-built solutions tailored to Rohirrims platform requirements.
  • Develop tool-using reasoning and planning capabilities that enable agents to decompose complex acquisition problems into executable subtasks.
  • Build robust human-in-the-loop and approval gates for high-stakes decision points within automated workflows.
Graph RAG & Document Intelligence
  • Design and optimize Retrieval-Augmented Generation (RAG) pipelines to ground agent outputs in authoritative procurement data regulations (FAR/DFARS) past performance records and institutional knowledge.
  • Implement advanced retrieval strategies including hybrid search re-ranking and context-aware chunking across large heterogeneous document corpora.
  • Develop document parsing and structuring pipelines for RFPs SOWs PWS solicitations and other complex government acquisition artifacts.
LLM Integration & Evaluation
  • Select and integrate appropriate LLMs (commercial and open-source) for specific agent tasks balancing capability latency cost and security requirements.
  • Build evaluation frameworks to systematically test agent accuracy hallucination rates and task completion against procurement-specific benchmarks.
  • Implement prompt engineering best practices including structured outputs chain-of-thought reasoning and few-shot prompting optimized for acquisition workflows.
Platform & Infrastructure
  • Collaborate with platform engineers to deploy agents in production with observability logging tracing and graceful failure handling.
  • Contribute to shared tooling internal SDKs and reusable agent components that accelerate development across the engineering team.
  • Participate in architecture reviews code reviews and technical planning sessions with a focus on scalability and maintainability.
What Youll Bring
Required
  • 8 years of software engineering experience with at least 1 year focused on LLM applications AI agents or applied ML systems in production.
  • Strong Python proficiency; experience building production-grade AI/ML pipelines.
  • Hands-on experience with LLM orchestration frameworks (LangChain LangGraph AutoGen or equivalent).
  • Deep understanding of RAG architectures vector databases (Pinecone Weaviate pgvector or similar) and embedding models.
  • Experience integrating APIs from frontier model providers and tuning prompts for structured and reliable results
  • Strong software engineering fundamentals: clean architecture testing observability and version control best practices.
Plusses
  • Experience building AI products for regulated enterprise environments.
  • Familiarity with federal acquisition regulations (FAR DFARS) or proposal management processes.
  • Experience with fine-tuning or instruction-tuning open-source LLMs (LLaMA Mistral etc.).
  • Knowledge of secure-by-design principles and air-gapped or FedRAMP-compliant deployment environments.
  • Active Secret or TS/SCI security clearance (or ability and eligibility to obtain).
  • Experience with cloud infrastructure on AWS Azure or GCP; containerization with Docker/Kubernetes.
Success Profile
  • A collaborative IC that is excellent at giving and receiving technical feedback communicating trade-offs clearly and elevating teammates.
  • Ability to help define how agentic AI gets implemented in a SaaS company

Required Experience:

Senior IC


About Company

Company Logo

Why Join Rohirrim? At Rohirrim, we're at the forefront of innovation in the Gen AI space. Joining our team means being part of a dynamic environment where your leadership and expertise make a tangible impact on our products and team growth. About Us Rohirrim is pioneering the future o ... View more

View Profile View Profile