Enter a job title or keyword

Software Engineer, Agent Platform

Retool

Job Location:

San Francisco, CA - USA

Yearly Salary: USD 163800 - 306000

Posted: 20 September 2026 (17 hours ago)

Application Deadline: 18 December 2026

Vacancies: 1 Vacancy

Department:

Engineering

Job Summary

ABOUT RETOOL

Nearly every company in the world runs on custom software for critical operations like tracking performance metrics handling support workflows building admin dashboards and countless processes you might never have thought of. But most companies dont have the resources to properly invest in these tools leading to a lot of old clunky internal software or worse teams still stuck in manual and spreadsheet workflows.

AI has changed who gets to build software. The definition of developer now includes analysts operators and domain experts creating solutions directlyand the tools they reach for are multiplying by the week. Thats both an opportunity and a challenge: as more people build with more AI tools the risk of shipping ungoverned software into production grows just as fast.

At Retool were building the platform that makes all of it safe to ship. Build with any AI tool you want then deploy into one place that connects to your real business data enforces enterprise policies automatically and lets teams create once and reuse everywhere with shared trusted components. The cost of building software has collapsed. The cost of governing it hasntand thats the problem we solve.

Developers and domain experts have already automated over 100 million hours of work on our platform freeing them to focus on creative problem-solving and strategic work that drives real business value. The people closest to the problem can now build the software to solve it safely and within enterprise guardrails.

Lets build the future together.

WHY WERE LOOKING FOR YOU

Were building AI-native products where model behavior is part of the product not just an implementation detail. As LLMs become more capable the bottleneck is no longer access to modelsits making non-deterministic systems reliable evaluable and trustworthy in production.

Were hiring AI Engineers to own that problem end to end. This is not a role for someone who simply integrates AI APIs into features. Its for engineers who take responsibility for how probabilistic systems behave over time how quality is measured in the presence of variance and how capabilities improve without regressing.

If model regressions subtle behavior drift or edge-case failures keep you up at nightand you enjoy that kind of ownershipwe want to talk.

WHAT YOULL DO

As an AI Engineer youll own model-driven behavior in production systems working across product infrastructure and evaluation layers. Your work will directly shape what users experienceand how confidently the team can ship. You might:

Own the behavior of AI-powered features across multiple product surfaces including quality safety variance and failure modes
Design and evolve prompting retrieval routing and tool-use strategies that embrace non-determinism while bounding its downside
Build and maintain evaluation systems that measure model performance using statistical signals distributions and trendsnot just pass/fail tests
Detect diagnose and resolve non-deterministic failures such as hallucinations partial correctness instruction drift or sensitivity to context changes
Define and implement guardrails fallbacks and degradation paths that keep systems useful even when models behave unexpectedly
Partner with product and infra teams to decide when probabilistic behavior is good enough to shipand when it isnt
Influence model selection model behavior and tool design to balance quality cost latency and robustness for real user workflows

Youll work across the stack (e.g. TypeScript React) but your leverage wont come from code volume aloneit will come from shaping runtime behavior with precision measurement and intent.

WHAT THIS ROLE IS (AND IS NOT)

This role is:

Accountable for AI behavior not just system correctness
Grounded in evaluation iteration and regression prevention under non-determinism
Comfortable designing systems where outputs vary confidence is probabilistic and correctness is contextual
Focused on shipping dependable products on top of imperfect components

This role is not:

Adding LLM calls to existing features and moving on
Treating models as black boxes with undefined behavior
Shipping AI features without owning their long-term reliability drift or user trust

THE SKILLSET YOULL BRING

6 years of professional engineering experience with ownership over complex systems in production
Demonstrated experience owning AI/LLM behavior beyond basic integration including mitigation of variance and failure modes
Comfort reasoning about probabilistic systems and tradeoffs (quality vs. cost recall vs. precision speed vs. robustness)
Experience designing or maintaining evaluation frameworks golden datasets regression detection or human-in-the-loop feedback loops
Strong product intuitionyou care deeply about what good looks like even when outputs are non-deterministic
Ability to operate independently in ambiguous problem spaces and set quality standards others rely on
Strong opinions weakly heldyou iterate quickly and adjust based on evidence and observed runtime behavior

BONUS POINTS

Experience with RAG agentic systems or tool-using models in production
Familiarity with vector databases embeddings or retrieval pipelines
Exposure to fine-tuning model routing or post-training techniques
Experience building shared AI infrastructure used by multiple teams
History of mentoring engineers on designing for non-determinism and evaluation-driven development

WHO YOULL WORK WITH

Youll join a small senior team focused on advancing AI capabilities across the product. Youll collaborate closely with product engineers infra engineers designers and PMsoften acting as the final owner of AI behavior and quality before features reach users.

Your work will set standards that others build on. If you enjoy being the person teams rely on when AI behavior matters mostand certainty is never guaranteedyoull thrive here.

READY TO BUILD RELIABLE AI SYSTEMS

If youre excited to move beyond demos and take real ownership of non-deterministic behavior in productiondefining quality preventing regressions and turning variability into a strengthwed love to meet you.

Retool offers generous benefits to all employees and hybrid work location. For more information please visit the benefits and perks section of our careers page!

Retool is currently set up to employ all roles in the US and specific roles in the UK. To find roles that can be employed in the UK please refer to our careers page and review the indicated locations.

Required Experience:

Unclear Seniority

Apply Now