Senior Test Engineer
Share
Job Location:
Monthly Salary:
Posted on:
9 hours ago
Vacancies:
1 Vacancy
Job Summary
Req number:
R7121Employment type:
Full timeWorksite flexibility:
HybridWho we are
CAI is a global services firm with over 9000 associates worldwide and a yearly revenue of $1.3 billion. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients colleagues and communities. As a privately held company we have the freedom and focus to do what is rightwhatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors and we are trailblazers in bringing neurodiversity to the enterprise.
Job Summary
As the Senior Test Engineer you will be responsible for leading the design and implementation of advanced testing strategies frameworks and tools to ensure the quality and reliability of GenAI platforms and applications.Job Description
We are looking for a Senior Test Engineer to lead test automation and strategy initiatives for GenAI platforms. This position will be full-time and hybrid in Bangalore.
What Youll Do
Test Strategy & Automation Leadership
- Design and implement comprehensive test strategies covering functional integration regression performance and security testing for GenAI platforms
- Architect and maintain scalable test automation frameworks using Selenium Cypress Playwright or Pytest with CI/CD integration (GitLab CI Jenkins GitHub Actions)
- Develop API automation suites for backend microservices using REST Assured Pytest or Postman/Newman
- Provide technical mentorship to junior test engineers conduct code reviews and establish QA best practices across AI CoE
GenAI & Advanced Testing
- Design specialized test scenarios for GenAI features including prompt validation RAG (Retrieval-Augmented Generation) accuracy LLM response quality and conversational flows
- Validate AI model integrations (Claude OpenAI APIs) vector database operations (OpenSearch Pinecone) and agentic workflows
- Perform AI governance testing including RBAC usage tracking and compliance validation
- Conduct performance testing (JMeter Locust K6) and security testing (OAuth 2.0 JWT API security OWASP Top 10)
Quality Metrics & Release Management
- Establish quality metrics dashboards and reporting for test coverage defect density and release readiness
- Lead defect triage meetings root cause analysis and drive corrective actions with development teams
- Test cloud deployments on AWS/Azure for reliability and disaster recovery scenarios
- Coordinate UAT with business stakeholders and ensure compliance with security standards (SOC 2 GDPR)
What Youll Need
Required
- 4-8 years of hands-on experience in software testing with 2 years in test automation and API testing
- Deep expertise in test automation frameworks (Selenium Cypress Playwright Pytest) and design patterns (Page Object Model BDD)
- Strong proficiency in API testing (REST GraphQL) using Postman REST Assured or Pytest
- Expert-level proficiency in Python or JavaScript for test automation and scripting
Advanced Technical Skills
- Experience with performance testing tools (JMeter Locust K6) and analyzing performance metrics
- Knowledge of security testing practices OWASP Top 10 and API security validation
- Strong understanding of microservices architecture distributed systems and cloud-native applications
- Experience with databases (PostgreSQL MongoDB) and writing complex SQL queries for data validation
- Hands-on experience testing applications on AWS/Azure (Lambda ECS S3 RDS API Gateway)
CI/CD & DevOps
- Proficiency with CI/CD tools (GitLab CI Jenkins GitHub Actions) and version control (Git)
- Familiarity with Docker/Kubernetes and testing containerized applications
- Knowledge of monitoring tools (CloudWatch Datadog ELK stack) for production validation
Leadership & Collaboration
- Proven ability to mentor junior engineers and provide technical guidance
- Strong analytical and problem-solving skills with ability to troubleshoot complex issues
- Excellent communication skills to interact with developers architects product managers and business stakeholders
- Experience working in Agile/Scrum environments with cross-functional teams
Preferred
- Experience testing GenAI applications (LLMs RAG systems conversational AI agentic workflows)
- Understanding of MLOps and testing AI model deployment pipelines
- Experience with BDD/TDD frameworks (Cucumber Behave) and contract testing (Pact) for microservices
- ISTQB Advanced Level AWS/Azure certifications or security certifications (CEH CompTIA Security)
Physical Demands
- Ability to safely and successfully perform the essential job functions
- Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings etc.
- Ability to conduct repetitive tasks on a computer utilizing a mouse keyboard and monitor
Reasonable accommodation statement
If you require a reasonable accommodation in completing this application interviewing completing any pre-employment testing or otherwise participating in the employment selection process please direct your inquiries to or (888).
Required Experience:
Senior IC
Key Skills
- Continuous Integration
- Jenkins
- Test Cases
- Performance Testing
- C/C++
- LabView
- Jira
- Software Testing
- System Testing
- Test Automation
- Selenium
- Cerner
About Company
CAI helps organizations leverage technology, people, and processes to solve business problems, enable savings, and spur innovation.
