Senior Quality Auditor, Artificial General Intelligence
Share
Job Location:
Monthly Salary:
Posted on:
2 days ago
Vacancies:
1 Vacancy
Job Summary
The Senior Quality Auditor serves as a specialist who becomes the organizations deepest expert on 1-2 complex machine learning data workflows while maintaining hands-on audit execution. This role within the Machine Learning Data Operations job family leads Quality Audit Design (QuAD) teams for high-complexity workflows handles the most ambiguous audit scenarios and generates workflow-specific quality analysis that drives customer insights and workflow optimization.
Key job responsibilities
Workflow Expertise Development
- Become the organizations deepest expert on 1-2 assigned complex workflows through intensive pilot participation and continuous learning
- Participate in workflow pilots as an annotator to build foundational knowledge before production begins
- Develop comprehensive understanding of workflow conventions edge cases and quality requirements
Team Leadership
- Lead QuAD teams of 3-5 Quality Auditors for Template 2 (High-Engagement Support) workflows
- Provide day-to-day leadership and make real-time quality decisions during iteration phases
- Handle escalations from team members and serve as the go-to expert for workflow-specific questions
- Mentor and develop Quality Auditor team members through coaching feedback and knowledge sharing
Audit Execution
- Execute audits on the most ambiguous and complex scenarios reducing escalations to Quality Specialists
- Maintain 60-70% hands-on audit execution to preserve expertise required for real-time decision-making
- Validate team audit decisions and ensure consistency across QuAD team members
- Support Template 1 workflows by auditing high-complexity scenarios requiring specialized judgment
Analysis & Insights
- Generate workflow-specific deep dives and thematic analysis providing insights beyond conventions adherence scores
- Identify error patterns convention evolution and areas of ambiguity within assigned workflows
- Provide actionable recommendations for workflow optimization and quality improvement
- Partner with DSLs and customers on workflow-specific quality insights
Strategic Collaboration
- Provide input to audit strategy design led by Quality Specialist I
- Collaborate with Quality Specialists on cross-workflow patterns and tactical improvements
- Participate in workflow design discussions with customers and stakeholders
- Support new-tool onboarding for operationalized and bootstrapped interfaces
- Track record of generating actionable insights from quality data.
- Bachelors degree or equivalent
- 2-4 years of experience in quality assurance data operations or a related field
- Experience working with machine learning data workflows or similar technical domains
- Hands-on experience in leadership and mentoring
- Strategic thinking about workflow optimization and process improvement
- Effective stakeholder communication skills with the ability to influence decision-makers and customers
- Domain expertise in STEM language or technical domains highly valued.
- Familiarity with audit methodologies and quality frameworks
- Experience participating in pilot phases and workflow development
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.
Key job responsibilities
Workflow Expertise Development
- Become the organizations deepest expert on 1-2 assigned complex workflows through intensive pilot participation and continuous learning
- Participate in workflow pilots as an annotator to build foundational knowledge before production begins
- Develop comprehensive understanding of workflow conventions edge cases and quality requirements
Team Leadership
- Lead QuAD teams of 3-5 Quality Auditors for Template 2 (High-Engagement Support) workflows
- Provide day-to-day leadership and make real-time quality decisions during iteration phases
- Handle escalations from team members and serve as the go-to expert for workflow-specific questions
- Mentor and develop Quality Auditor team members through coaching feedback and knowledge sharing
Audit Execution
- Execute audits on the most ambiguous and complex scenarios reducing escalations to Quality Specialists
- Maintain 60-70% hands-on audit execution to preserve expertise required for real-time decision-making
- Validate team audit decisions and ensure consistency across QuAD team members
- Support Template 1 workflows by auditing high-complexity scenarios requiring specialized judgment
Analysis & Insights
- Generate workflow-specific deep dives and thematic analysis providing insights beyond conventions adherence scores
- Identify error patterns convention evolution and areas of ambiguity within assigned workflows
- Provide actionable recommendations for workflow optimization and quality improvement
- Partner with DSLs and customers on workflow-specific quality insights
Strategic Collaboration
- Provide input to audit strategy design led by Quality Specialist I
- Collaborate with Quality Specialists on cross-workflow patterns and tactical improvements
- Participate in workflow design discussions with customers and stakeholders
- Support new-tool onboarding for operationalized and bootstrapped interfaces
- Track record of generating actionable insights from quality data.
- Bachelors degree or equivalent
- 2-4 years of experience in quality assurance data operations or a related field
- Experience working with machine learning data workflows or similar technical domains
- Hands-on experience in leadership and mentoring
- Strategic thinking about workflow optimization and process improvement
- Effective stakeholder communication skills with the ability to influence decision-makers and customers
- Domain expertise in STEM language or technical domains highly valued.
- Familiarity with audit methodologies and quality frameworks
- Experience participating in pilot phases and workflow development
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.
Required Experience:
Senior IC
Key Skills
- Quality Assurance
- Quality Inspection
- Calipers
- ISO 9001
- Quality Audits
- Process Mapping
- Fair Housing Regulations
- Quality Control
- Underwriting
- cGMP
- As9100
- Manufacturing
About Company
Free shipping on millions of items. Get the best of Shopping and Entertainment with Prime. Enjoy low prices and great deals on the largest selection of everyday essentials and other products, including fashion, home, beauty, electronics, Alexa Devices, sporting goods, toys, automotive ... View more
