Senior QA (Gen AI Must have) Exp 5+ Years

Its fun to work in a company where people truly BELIEVE in what they are doing!

Were committed to bringing passion and customer focus to the business.

Role: Senior QA (Gen AI - Must Have)

Experience: 5 Years

Detailed JD :

• Design automate and execute API test suites (functional contract performance resilience)
• Define LLM evaluation strategies (performance testing golden sets guardrails hallucination/consistency checks relevance & latency KPIs); build automated eval pipelines tied to releases.
• Create PDLM deliverables: verification plans/protocols test reports risk-based coverage V&V trace matrices to requirements and use cases.
• Integrate test infrastructure with Azure DevOps (CI/CD test orchestration quality gates dashboards); enforce build-time gates for API and LLM quality.
• Partner with Product Clinical and R&D to refine requirements and acceptance criteria; ensure summaries render correctly for different user roles and workflows.

What is required from candidate

• 5 years in backend/API test automation (REST JSON auth) performance testing and CI/CD.
• Hands-on with Python/TypeScript Postman/Newman or REST-assured PyTest/Jest k6/JMeter Docker.
• Experience validating ML/LLM systems (eval datasets metrics prompt/response testing safety/guardrails).
• Strong documentation and traceability discipline for regulated product lifecycles (PDLM/QMS).
• Bonus: Azure DevOps pipelines FHIR/HL7 familiarity healthcare data privacy/security.
• Bonus: Frontend testing capabilities are preferred but not part of the PDLM requirements.

#LI-MA1

If you like wild growth and working with happy enthusiastic over-achievers youll enjoy your career with us!

Hiring Related Queries

India:

Outside India:

Please share resume via job postings

Not the right fit Let us know youre interested in a future opportunity by clickingIntroduce Yourselfin the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!