AI Test Automation Lead (LLM)

ROLE: AI Test Automation Lead (LLM / GenAI Driven QA)

LOCATION: Bishops Gate NJ or West Chester PA- ONSITE

Job Summary

We are looking for an experienced AI Test Automation Lead to drive the transformation of our QA ecosystem by leveraging AI/ML and LLM-based testing approaches.

This role goes beyond traditional automation focusing on AI-assisted test generation intelligent validation and agentic workflows to improve test efficiency coverage and quality. The ideal candidate will have strong experience in automation frameworks microservices testing and DevOps practices along with exposure to AI/GenAI technologies.

Key Responsibilities

Automation Strategy & Leadership

• Define and lead the automation testing strategy across applications
• Design scalable and maintainable automation frameworks
• Mentor and guide QA teams on best practices and modern testing approaches

AI-Driven Testing & Innovation

• Implement AI-assisted test generation using LLMs
• Build agentic workflows for intelligent test case creation and execution
• Design test validation strategies using LLM-based evaluation systems
• Reduce manual testing effort through AI-powered automation

Test Development & Execution

• Develop automated test scripts for:
  • Functional testing
  • API testing
  • Microservices testing
• Ensure high test coverage and system reliability

Microservices & API Testing

• Validate distributed systems and microservices architectures
• Perform API testing using tools like:
  • REST Assured
  • Postman
• Ensure seamless integration testing across services

DevOps & CI/CD Integration

• Integrate automation with CI/CD pipelines:
  • Jenkins
  • GitHub Actions
  • Azure DevOps
• Enable continuous testing and deployment workflows

Collaboration & Delivery

• Work closely with:
  • Developers
  • Product teams
  • Architects
• Participate in:
  • Design discussions
  • Code reviews
  • Production support

Required Skills

Core Automation Skills

• Strong experience in:
  • Automation frameworks (Selenium Playwright Cypress)
  • Programming (Java Python or TypeScript)
• Experience in API and microservices testing