AI Test Lead

AI Test Lead
Atlanta GA - Hybrid
Long Term Contract
Tax Term: W2
Exp: 12 years

Key Responsibilities
Define and own the AI testing strategy for applications and models.
Lead AI application testing across functional integration and user-facing behavior.
Perform model testing and validation (accuracy robustness bias drift hallucination and performance).
Leverage AI-powered testing tools to design automate and accelerate test coverage.
Establish test frameworks quality gates and acceptance criteria for AI features.
Collaborate with data science engineering and product teams to embed quality early.
Report on quality metrics risks and readiness for release.

Required Skills & Experience
8 years in software QA/testing with 2 years hands-on testing AI/ML applications and models.
Hands-on with AI-based testing tools and test automation.
Ability to create and drive AI testing strategy from the ground up.
Strong understanding of model evaluation metrics and AI failure modes.
Proven experience leading QA teams and mentoring testers.
Nice to Have
Experience testing LLM / GenAI applications (prompt testing RAG evaluation).
Familiarity with CI/CD and MLOps pipelines.

Required Skills:

AI