Job Title-AI Quality Engineer
Location - Saint Louis MO
Number of days onsite-3 Days
Rate :: 45-50/hr on w2 $57-60/hr on Max
and VMS #: 21179-1
Must Have Skills
Drift Detection
Java
Selenium
Cucumber
Cloud
Google Apps
UiPath
AI/ML
Google kubernates Engineering
Recommended Qualification and Experience:
- Experience - 5 years in Software Quality Engineering with at least 2 years focused on AI/ML UiPath automation testing.
- Understanding of OCR (Optical Character Recognition) NLP (Natural Language Processing) and LLM architectures if Value Add Experience
- Possesses prior experience in Java OR Python scripting as well as experience with Salesforce and GCP (Google Cloud Platform)
Proficient in system integrations utilizing technologies such as SQL REST APIs and Google Kubernetes Engine
Role : AI Quality Engineer
- We are looking for a highly experienced and certified AI Quality Engineer who will drive transformation within our team.
- The ideal candidate will oversee the validation and lifecycle of our generative and predictive models.
- Your mission is to ensure our AI systems are not just smart but are enough for production.
- What Youll DoThe responsibilities of an AI Quality Engineer are split between testing the AI itself AI-Driven Automation and using effective Prompt engineering to improve testing and Quality processes.
- This role also involves engaging and collaborating with cross-functional teams
- Your key responsibilities will include
- Define and execute end-to-end testing and validation frameworks for AI services encompassing machine learning models agentic workflows and automation solutions.
- Focus on rigorous model and data validation real-time observability and the implementation of autonomous test generation
- Data Quality Auditing: Validating training and testing datasets for bias noise and completeness
- Model Performance Testing: Defining and tracking metrics beyond simple such as Precision-Recall curves F1-score and Mean Absolute Error (MAE).
- Adversarial Testing: Intentionally providing &apos prompt injections or perturbed images to see if the model breaks or leaks sensitive data
- Drift Detection: Monitoring production models for concept drift (changes in real-world data patterns) and data
- Fairness Monitoring: Ensuring the models outputs remain ethical and do not discriminate against specific demographics over time
- You will be the primary gatekeeper for AI Governance and compliance ensuring the model adheres to Equifax AI standards.
- Design comprehensive test cases and strategic test plans to validate RPA solutions (UiPath) for both new implementations and existing systems.
- Document detected defects and manage their lifecycle through to resolution if !supportListsValidate the Hand-off points where an AI Agent triggers an PRA bot to perform a structural task.
Job Title-AI Quality Engineer Location - Saint Louis MO Number of days onsite-3 Days Rate :: 45-50/hr on w2 $57-60/hr on Max and VMS #: 21179-1 Must Have Skills Drift Detection Java Selenium Cucumber Cloud Google Apps UiPath AI/ML Google kubernates Engineering Recommended Qualification and Expe...
Job Title-AI Quality Engineer
Location - Saint Louis MO
Number of days onsite-3 Days
Rate :: 45-50/hr on w2 $57-60/hr on Max
and VMS #: 21179-1
Must Have Skills
Drift Detection
Java
Selenium
Cucumber
Cloud
Google Apps
UiPath
AI/ML
Google kubernates Engineering
Recommended Qualification and Experience:
- Experience - 5 years in Software Quality Engineering with at least 2 years focused on AI/ML UiPath automation testing.
- Understanding of OCR (Optical Character Recognition) NLP (Natural Language Processing) and LLM architectures if Value Add Experience
- Possesses prior experience in Java OR Python scripting as well as experience with Salesforce and GCP (Google Cloud Platform)
Proficient in system integrations utilizing technologies such as SQL REST APIs and Google Kubernetes Engine
Role : AI Quality Engineer
- We are looking for a highly experienced and certified AI Quality Engineer who will drive transformation within our team.
- The ideal candidate will oversee the validation and lifecycle of our generative and predictive models.
- Your mission is to ensure our AI systems are not just smart but are enough for production.
- What Youll DoThe responsibilities of an AI Quality Engineer are split between testing the AI itself AI-Driven Automation and using effective Prompt engineering to improve testing and Quality processes.
- This role also involves engaging and collaborating with cross-functional teams
- Your key responsibilities will include
- Define and execute end-to-end testing and validation frameworks for AI services encompassing machine learning models agentic workflows and automation solutions.
- Focus on rigorous model and data validation real-time observability and the implementation of autonomous test generation
- Data Quality Auditing: Validating training and testing datasets for bias noise and completeness
- Model Performance Testing: Defining and tracking metrics beyond simple such as Precision-Recall curves F1-score and Mean Absolute Error (MAE).
- Adversarial Testing: Intentionally providing &apos prompt injections or perturbed images to see if the model breaks or leaks sensitive data
- Drift Detection: Monitoring production models for concept drift (changes in real-world data patterns) and data
- Fairness Monitoring: Ensuring the models outputs remain ethical and do not discriminate against specific demographics over time
- You will be the primary gatekeeper for AI Governance and compliance ensuring the model adheres to Equifax AI standards.
- Design comprehensive test cases and strategic test plans to validate RPA solutions (UiPath) for both new implementations and existing systems.
- Document detected defects and manage their lifecycle through to resolution if !supportListsValidate the Hand-off points where an AI Agent triggers an PRA bot to perform a structural task.
View more
View less