We are building a next-generation AI onboarding agent for software companies.
AI-first SaaS product where product quality UX polish and AI behaviour are tightly coupled. Our core engineering team is focused on shipping critical user-facing functionality and AI capabilities.
Whats missing is clear ownership of the systems that determine whether something is safe to ship analytics internal tooling product quality gates and AI evaluation infrastructure.
This role exists to own that entire release readiness layer end-to-end enabling the team to move fast without breaking product quality or AI experience.
**The role is based in Bali and we can offer a relocation package for the right candidate.
**
Tasks
You will be the single owner of our product platform and release-quality systems.
- Product analytics & instrumentation
- Define and maintain a consistent event schema
- Implement analytics across frontend backend and AI agents
- Build internal dashboards for funnels usage drop-offs and failures
- Internal & admin tooling
- Build dashboards and tools for debugging sessions and inspecting AI behaviour
- Replace ad-hoc scripts and database queries with reliable internal systems
- Product quality & release systems
- Own feature flags rollouts and release checks
- Define what is shippable for non-trivial changes
- Act as a release gate owner with authority to block unsafe releases
- AI quality & evaluation
- Version and manage prompts and AI configuration changes
- Define when AI evals are required before shipping
- Build and maintain AI evaluation pipelines and make results visible over time
- Platform health & evolution
- Define system-level health and reliability metrics
- Establish expected variance vs unacceptable deviation for AI systemsReduce platform-level debt that slows shipping and decision-making
Requirements
Required technical stack
- Strong full-stack fundamentals
- Testing & CI: pytest; vitest; Playwright (or equivalent) for E2E and behavioural testing GitHub CI/CD gate design
- Data & Systems: Distributed and asynchronous systems PostgreSQL
- Cloud & Security: AWS logging and metrics (e.g. CloudWatch) Baseline application security testing Familiarity with common API auth and WebSocket risks OWASP ZAP or equivalent tooling
- AI / Agent systems experience:
- Experience testing AI- agent- or other non-deterministic systems
- Familiarity with behavioural regression detection (not brittle assertions)
- Understanding why deterministic testing breaks down and how to design around it
- Experience with LLM or agent observability tools (e.g. LangSmith) is a strong plus
- Experience with vision or multimodal systems is a strong plus
- Experience with real-time systems (voice streaming WebSocket) is a strong plus
What were looking for
- At least 4 years of experience in platform quality or reliability-focused roles
- Strong system-level thinking (not just test scripts)
- Experience testing AI or agent-based systems
- Understands why deterministic testing is hard and how to work around it
- Comfortable turning vague problems into clear shipped systems
- Willing to make and defend platform-level decisions
- Strong product judgement and pragmatism
Nice to have
- Experience designing internal platforms used by other engineers
- Exposure to ISO / SOC / enterprise readiness environments
Benefits
We offer competitive salary high autonomy and try to accommodate everything you need to succeed in your return we expect dedication sustained effort and passion. Were on the mission of our lifetimes and every person on the team is a crucial part of our success.
If youre looking for an easy 9-5 job we are not for you. If you want to build a generation-defining company and a product that will be used by millions of people every day then please apply.
Our Operating Principles:
- Always Be Hustlin Move fast outwork the competition stay scrappy.
- Relentlessly Curious - Reason from first principles question assumptions and explore better ways.
- Super Pumped Show relentless enthusiasm and drive.
- Make Magic Create experiences that delight customers.
- Obsess Over the Details Perfect the product experience no matter how small.
- Big Bold Bets Think big take risks and go after huge transformative opportunities.
- Ownership is Key - Own the outcome not just the task.
We are building a next-generation AI onboarding agent for software companies.AI-first SaaS product where product quality UX polish and AI behaviour are tightly coupled. Our core engineering team is focused on shipping critical user-facing functionality and AI capabilities.Whats missing is clear owne...
We are building a next-generation AI onboarding agent for software companies.
AI-first SaaS product where product quality UX polish and AI behaviour are tightly coupled. Our core engineering team is focused on shipping critical user-facing functionality and AI capabilities.
Whats missing is clear ownership of the systems that determine whether something is safe to ship analytics internal tooling product quality gates and AI evaluation infrastructure.
This role exists to own that entire release readiness layer end-to-end enabling the team to move fast without breaking product quality or AI experience.
**The role is based in Bali and we can offer a relocation package for the right candidate.
**
Tasks
You will be the single owner of our product platform and release-quality systems.
- Product analytics & instrumentation
- Define and maintain a consistent event schema
- Implement analytics across frontend backend and AI agents
- Build internal dashboards for funnels usage drop-offs and failures
- Internal & admin tooling
- Build dashboards and tools for debugging sessions and inspecting AI behaviour
- Replace ad-hoc scripts and database queries with reliable internal systems
- Product quality & release systems
- Own feature flags rollouts and release checks
- Define what is shippable for non-trivial changes
- Act as a release gate owner with authority to block unsafe releases
- AI quality & evaluation
- Version and manage prompts and AI configuration changes
- Define when AI evals are required before shipping
- Build and maintain AI evaluation pipelines and make results visible over time
- Platform health & evolution
- Define system-level health and reliability metrics
- Establish expected variance vs unacceptable deviation for AI systemsReduce platform-level debt that slows shipping and decision-making
Requirements
Required technical stack
- Strong full-stack fundamentals
- Testing & CI: pytest; vitest; Playwright (or equivalent) for E2E and behavioural testing GitHub CI/CD gate design
- Data & Systems: Distributed and asynchronous systems PostgreSQL
- Cloud & Security: AWS logging and metrics (e.g. CloudWatch) Baseline application security testing Familiarity with common API auth and WebSocket risks OWASP ZAP or equivalent tooling
- AI / Agent systems experience:
- Experience testing AI- agent- or other non-deterministic systems
- Familiarity with behavioural regression detection (not brittle assertions)
- Understanding why deterministic testing breaks down and how to design around it
- Experience with LLM or agent observability tools (e.g. LangSmith) is a strong plus
- Experience with vision or multimodal systems is a strong plus
- Experience with real-time systems (voice streaming WebSocket) is a strong plus
What were looking for
- At least 4 years of experience in platform quality or reliability-focused roles
- Strong system-level thinking (not just test scripts)
- Experience testing AI or agent-based systems
- Understands why deterministic testing is hard and how to work around it
- Comfortable turning vague problems into clear shipped systems
- Willing to make and defend platform-level decisions
- Strong product judgement and pragmatism
Nice to have
- Experience designing internal platforms used by other engineers
- Exposure to ISO / SOC / enterprise readiness environments
Benefits
We offer competitive salary high autonomy and try to accommodate everything you need to succeed in your return we expect dedication sustained effort and passion. Were on the mission of our lifetimes and every person on the team is a crucial part of our success.
If youre looking for an easy 9-5 job we are not for you. If you want to build a generation-defining company and a product that will be used by millions of people every day then please apply.
Our Operating Principles:
- Always Be Hustlin Move fast outwork the competition stay scrappy.
- Relentlessly Curious - Reason from first principles question assumptions and explore better ways.
- Super Pumped Show relentless enthusiasm and drive.
- Make Magic Create experiences that delight customers.
- Obsess Over the Details Perfect the product experience no matter how small.
- Big Bold Bets Think big take risks and go after huge transformative opportunities.
- Ownership is Key - Own the outcome not just the task.
View more
View less