Software Engineer SQA - AI/ML Products
Software Engineer SQA - AI/ML Products
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Additional Locations:India-Haryana Gurgaon
Diversity - Innovation - Caring - Global Collaboration - Winning Spirit - High Performance
At Boston Scientific well give you the opportunity to harness all thats within you by working in teams of diverse and high-performing employees tackling some of the most important health industry challenges. With access to the latest tools information and training well help you in advancing your skills and career. Here youll be supported in progressing whatever your ambitions.
Software Engineer SQA AI/ML Products
Join Boston Scientific at the forefront of innovation as we embrace AI to transform healthcare and deliver cuttingedge solutions. We are seeking a Software Quality Assurance (SQA) Engineer who will champion the reliability and usability of AIdriven features ensuring that machinelearning models and LLM pipelines deliver safe accurate and coherent outcomes.
Your responsibilities will include:
- Develop and execute comprehensive test plans for AI/ML features including chatbots recommendation engines RAG search and copilots.
- Design and maintain automation frameworks (Selenium Cypress Playwright PyTest) for UI API and modellevel testing.
- Implement evaluation harnesses using LangSmith RAGAS LangTest and custom scripts to score relevance hallucination fairness and toxicity.
- Validate RAG pipelines endtoend: embeddings retrieval quality prompt integrity and response grounding.
- Monitor postdeployment AI performance for drift regression and latency; partner with MLOps teams to triage incidents.
- Collaborate with product managers data scientists and engineers to define expected outcomes and edgecase scenarios.
- Document test results file defects and drive rootcause analysis to closure.
Required Qualifications:
- 6 years of software quality assurance or testautomation experience including AI/ML products.
- Proficiency in Python or JavaScript and experience with RESTful API testing (Postman Swagger).
- Handson with automation tools such as Selenium Cypress Playwright or PyTest.
- Knowledge of LLM evaluation frameworks (LangSmith RAGAS) and vector database APIs.
- Strong foundation in QA processes: test planning regression testing CI/CD integration and defect lifecycle management.
Preferred Qualifications:
- Experience testing RAG or agentic AI workflows at scale.
- Familiarity with monitoring solutions for model drift and data drift (Vertex AI Azure Monitor Fiddler).
- Exposure to ethicalAI or biastesting methodologies.
- Background in healthcare or other regulated domains.
Requisition ID:608453
As a leader in medical science for more than 40 years we are committed to solving the challenges that matter most united by a deep caring for human life. Our mission to advance science for life is about transforming lives through innovative medical solutions that improve patient lives create value for our customers and support our employees and the communities in which we operate. Now more than ever we have a responsibility to apply those values to everything we do as a global business and as a global corporate citizen.
So choosing a career with Boston Scientific (NYSE: BSX) isnt just business its personal. And if youre a natural problem-solver with the imagination determination and spirit to make a meaningful difference to people worldwide we encourage you to apply and look forward to connecting with you!
Employment Type
Full Time
