Software Engineer, Agentic Runtime
Share
Job Location:
San Francisco, CA - USA
Yearly Salary:
$ 140000 - 265000
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
Glean is the Work AI platform that helps everyone work smarter with AI. What began as the industrys most advanced enterprise search has evolved into a full-scale Work AI ecosystem powering intelligent Search an AI Assistant and scalable AI agents on one secure open platform. With over 100 enterprise SaaS connectors flexible LLM choice and robust APIs Glean gives organizations the infrastructure to govern scale and customize AI across their entire business - without vendor lock-in or costly implementation cycles.
At its core Glean is redefining how enterprises find use and act on knowledge. Its Enterprise Graph and Personal Knowledge Graph map the relationships between people content and activity delivering deeply personalized context-aware responses for every employee. This foundation powers Gleans agentic capabilities - AI agents that automate real work across teams by accessing the industrys broadest range of data: enterprise and world structured and unstructured historical and real-time. The result: measurable business impact through faster onboarding hours of productivity gained each week and smarter safer decisions at every level.Recognized by Fast Company as one of the Worlds Most Innovative Companies (Top 10 2025) by CNBCs Disruptor 50 Bloombergs AI Startups to Watch (2026) Forbes AI 50 and Gartners Tech Innovators in Agentic AI Glean continues to accelerate its global impact. With customers across 50 industries and 1000 employees in more than 25 countries were helping the worlds largest organizations make every employee AI-fluent and turning the superintelligent enterprise from concept into reality.
If youre excited to shape how the world works youll help build systems used daily across Microsoft Teams Zoom ServiceNow Zendesk GitHub and many more - deeply embedded where people get things done. Youll ship agentic capabilities on an open extensible stack with the craft and care required for enterprise trust as we bring Work AI to every employee in every company.About the Role:
The Agents Runtime team builds the lowlatency reliable and secure foundation that powers Gleans AI agents and assistant experiences at scale. Youll design and operate core runtime services for multiturn orchestration tool calling model routing memory streaming and safety. Youll work across distributed systems production observability and ML infra integrations to deliver an experience that feels instant accurate and trustworthy while optimizing cost and reliability.
You will:
- Own impactful runtime problems endtoend from architecture and design to production launch and ongoing reliability.
- Build and evolve core services for session lifecycle streaming responses (e.g. gRPC/WebSockets) structured tool execution memory/state and policy/guardrails.
- Design for performance correctness and cost: reduce p50/p95 latency improve tail behavior and optimize token/tool budgets.
- Integrate with leading LLM providers (e.g. OpenAI Anthropic Google Gemini) and internal evaluation frameworks to improve quality and predictability.
- Harden the platform with fault isolation retries timeouts circuitbreaking backpressure and graceful degradation.
- Instrument deep observability (tracing metrics logs) and create playbooks/SLOs for high availability and oncall excellence.
- Collaborate closely with product quality and application teams to prioritize the most impactful roadmap investments.
You are:
- 3 years of software engineering experience building production distributed systems or cloudnative applications.
- BS/BA in Computer Science or related field or equivalent practical experience.
- Strong coding skills in at least one of: Python Go Java or C with a focus on reliability performance and tests.
- Productminded: you prioritize customer impact clear SLAs/SLOs and pragmatic iteration.
- Ownershipdriven with a positive proactive attitude; comfortable leading projects or learning from battletested engineers.
- Experience operating services on Kubernetes and at least one major cloud (e.g. GCP AWS or Azure).
- Familiarity with event/streaming systems (e.g. Pub/Sub Kafka) caching (e.g. Redis) and data stores for lowlatency paths.
- Practical understanding of LLM/agents building blocks: tool/function calling structured outputs streaming and model selection/routing.
- Strong observability and debugging skills: tracing (e.g. OpenTelemetry) metrics dashboards and production forensics.
- Background in one or more areas is a plus: policy/guardrails multitenant isolation ratelimiting concurrency control cost optimization.
Location:
- This role is hybrid (3-4 days a week in one of our SF Bay Area offices)
Compensation & Benefits:
The standard base salary range for this position is $140000 - $265000 annually. Compensation offered will be determined by factors such as location level job-related knowledge skills and experience. Certain roles may be eligible for variable compensation equity and benefits.
We offer a comprehensive benefits package including competitive compensation Medical Vision and Dental coverage generous time-off policy and the opportunity to contribute to your 401k plan to support your long-term goals. When you join youll receive a home office improvement stipend as well as an annual education and wellness stipends to support your growth and wellbeing. We foster a vibrant company culture through regular events and provide healthy lunches daily to keep you fueled and focused.
We are a diverse bunch of people and we want to continue to attract and retain a diverse range of people into our organization. Were committed to an inclusive and diverse company. We do not discriminate based on gender ethnicity sexual orientation religion civil or family status age disability or race.
#LIHYBRID
Required Experience:
Unclear Seniority
Key Skills
- Spring
- .NET
- C/C++
- Go
- React
- OOP
- C#
- Data Structures
- JavaScript
- Software Development
- Java
- Distributed Systems
About Company
Glean was created to deliver healthy and fresh foods - made directly from fruits and vegetables - into your hands! Sweet Potato Flour & Pumpkin Flour now available. Our team is made up of a handful of passionate people who have worked in food and agriculture most of their careers - ... View more
