Senior AI Test Engineer (API & AI Validation)

Senior AI Test Engineer (API & AI Validation)

Job Title: Senior AI Test Engineer (API & AI Validation)

Experience: 1012 Years Employment Type: Subcontractor Job

Summary: We are seeking an experienced Senior AI Test Engineer with 1012 years of experience in Quality Engineering including hands-on expertise in API testing and AI application validation. The ideal candidate should have strong experience testing AI/LLM-powered applications validating REST APIs designing automation frameworks and ensuring the quality reliability security and performance of modern AI-enabled systems. This role requires a blend of traditional testing expertise and knowledge of AI-specific validation techniques including prompt testing model evaluation hallucination detection and retrieval validation.

Key Responsibilities:- Define and implement end-to-end test strategies for AI-enabled applications.- Design and execute comprehensive test plans for Generative AI LLM RAG and AI Agent workflows.- Perform functional integration regression system and UAT testing.- Validate RESTful APIs using tools such as Postman Swagger REST Assured or similar frameworks.- Develop and maintain API automation frameworks.- Validate AI model responses for:- Accuracy- Relevance- Consistency- Hallucinations- Bias- Toxicity- Test prompt engineering scenarios and optimize prompt quality.- Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy.- Verify AI guardrails content moderation and responsible AI compliance.- Perform database validation using SQL.- Conduct performance and load testing for APIs and AI services.- Collaborate with Product Owners Architects Data Scientists ML Engineers and Developers.