SDET (AI Platform & Quality Engineering)
Share
Job Location:
Monthly Salary:
Posted on:
2 days ago
Vacancies:
1 Vacancy
Job Summary
About InvoiceCloud:
InvoiceCloud is a fast-growing fintech leader recognized with 20 major awards in 2025 including USA TODAY and Boston Globe Top Workplaces multiple SaaS Awards wins for Best Solution for Finance and FinTech and national customer service honors from Stevie and the Business Intelligence Group. Judges also highlighted our mission to reduce digital exclusion and restore simplicity and dignity to how people pay for essential services as well as our leadership in AI maturity and responsible innovation. Its an award-winning purpose-driven environment where top talent thrives. To learn more .
- Owns end-to-end AI quality strategy for LLM RAG and AI-powered platform features.
- Establishes disciplined validation routines to ensureproductionreadiness and release confidence.
- Ensures compliance with data governance privacy security and responsible AI standards.
- Drives CI/CD quality automationissuetriage drift detection and resolution.
- Maintains accountability for AI correctness observability and long-term test sustainability.
- Builds automated regression suites benchmarking tools andevaluationworkflows for AI systems.
- Defines and tracks quality KPIs related to accuracy performance latency safety and reliability.
- Implements continuous validation andmonitoringto reduce manual testing and release friction.
- Partners with engineering teams to improve testability telemetry and quality insights across pipelines.
- Usesautomation and data-driven signals to accelerate feedback loops and reduce time-to-value.
- Designs and implements automation for prompt testing semantic scoring and safety checks.
- Usesmodern AI frameworks (Azure OpenAILangChain Semantic Kernel vector databases) to create reusable quality tooling.
- Experiments withnew approachesto AI validation observability and model evaluation.
- Applies emerging AI quality techniques to strengthen platform scalability and reliability.
- Leverages AI-assisted tools to enhance test coverage insight generation and development speed.
- Validates AI behaviors that directly improve payer agent and customer service experiences.
- Measures business impact through accuracy call deflection reduced handle time and outcome quality.
- Advocates for safe transparent and trustworthy AI behaviors across the platform.
- Partners with product teams to ensure AI quality aligns with real user needs and expectations.
- Ensures AI systems behave predictably and responsibly in customer-facing scenarios.
- Experience in test automation or SDET roles within SaaS or distributed systems
- Hands-on experiencevalidatingAI/ML NLP or analytics-driven applications
- Strongproficiencyin Python and CI/CD automation practices
- Familiarity with Azure OpenAILangChain Semantic Kernel or vector search technologies
- Knowledge of responsible AI practices privacy RBAC and security testing
- Ability to define quality metrics automate validation and support production monitoring
- Strong analytical communication and cross-team collaboration skills
InvoiceCloud is committed to providing equal employment opportunities to all employees and applicants. We do not tolerate discrimination or harassment of any kind based on race color religion age sex nationality disability genetic information veteran or military status sexual orientation gender identity or expression or any other characteristic protected under applicable laws.
This commitment applies to all aspects of employment including recruitment hiring placement promotion termination layoff recall transfer leave compensation and training.
If you require a disability-related or religious accommodation during the application or recruitment process and wish to discuss possible adjustments please contact .
Click here to review InvoiceClouds Job Applicant Privacy Policy.
For recruitment agencies: InvoiceCloud does not accept unsolicited resumes from agencies. Please do not forward resumes to our job aliases employees or any other company location. InvoiceCloud is not responsible for any fees associated with unsolicited submissions.
Required Experience:
IC
Key Skills
- React Native
- AI
- Enterprise Software
- React
- Node.js
- Redis
- AWS
- Software Development
- IOS
- Team Management
- Product Development
- Mobile Applications
About Company
Invoice Cloud provides simple online electronic bill payment solutions that improve customer engagement and increase e-payment adoption. Schedule A Demo Today.
