Software Engineer, Agentic Runtime
Mountain View, CA - USA
Job Summary
- Own impactful runtime problems endtoend from architecture and design to production launch and ongoing reliability.
- Build and evolve core services for session lifecycle streaming responses (e.g. gRPC/WebSockets) structured tool execution memory/state and policy/guardrails.
- Design for performance correctness and cost: reduce p50/p95 latency improve tail behavior and optimize token/tool budgets.
- Integrate with leading LLM providers (e.g. OpenAI Anthropic Google Gemini) and internal evaluation frameworks to improve quality and predictability.
- Harden the platform with fault isolation retries timeouts circuitbreaking backpressure and graceful degradation.
- Instrument deep observability (tracing metrics logs) and create playbooks/SLOs for high availability and oncall excellence.
- Collaborate closely with product quality and application teams to prioritize the most impactful roadmap investments.
- 3 years of software engineering experience building production distributed systems or cloudnative applications.
- BS/BA in Computer Science or related field or equivalent practical experience.
- Strong coding skills in at least one of: Python Go Java Javascript Typescript C with a focus on reliability performance and tests.
- Productminded: you prioritize customer impact clear SLAs/SLOs and pragmatic iteration.
- Ownershipdriven with a positive proactive attitude; comfortable leading projects or learning from battletested engineers.
- Experience operating services on Kubernetes and at least one major cloud (e.g. GCP AWS or Azure).
- Familiarity with event/streaming systems (e.g. Pub/Sub Kafka) caching (e.g. Redis) and data stores for lowlatency paths.
- Practical understanding of LLM/agents building blocks: tool/function calling structured outputs streaming and model selection/routing.
- Strong observability and debugging skills: tracing (e.g. OpenTelemetry) metrics dashboards and production forensics.
- Background in one or more areas is a plus: policy/guardrails multitenant isolation ratelimiting concurrency control cost optimization.
- This role is hybrid (4 days a week in our Mountain View office)
By clicking Submit Application I confirm that I have read the Global Data Privacy Notice and the Applicant Arbitration Agreement and I agree to the terms.
Required Experience:
Unclear Seniority
About Company
Glean was created to deliver healthy and fresh foods - made directly from fruits and vegetables - into your hands! Sweet Potato Flour & Pumpkin Flour now available. Our team is made up of a handful of passionate people who have worked in food and agriculture most of their careers - ... View more