ML Quality Process Lead - Portuguese Customer Engagement Technology

The Customer Engagement Technology (CET) organization powers customer service by developing elegant customer and CS Associate (CSA) facing products globally. These products offer effortless selfservice and automation solutions to our customers. If customers prefer to interact with a human we enable CSAs to effectively and elegantly solve customers issues using our associatefacing products powered through humancentered design.

We are seeking a ML (Machine Learning) Quality Process Lead who are fluent in Portuguese and English to join the Omni Machine Learning Data Associate (MLDA) team within CET to help manage quality management processes to analyze improve annotation testing and contact reading accuracy to support new feature and product launches for Customer Service Large Language Models (LLMs).

Key job responsibilities
Review annotations by paying close attention to details making necessary adjustments to ensure highquality data that supports ongoing model improvement.
Perform root cause analysis using basic data analysis in Excel and SageMaker (annotation tool) on annotations to identify opportunities for improving data accuracy.
Provide support for ML model training data annotations assisting annotators in maintaining highquality work by enforcing best practices.
Improve Standard Operating Procedures (SOPs) by sharing findings from reviews or deep dives ensuring a consistent standard of excellence across the team.
Review LLM testing results provided by testers paying close attention to details to ensure their accuracy and identify areas for improvement.
Carefully monitor the accuracy of multiple annotation projects and proactively communicate any blockers or potential delays in the completion of quality checks.

A day in the life
Amazon offers a full range of benefits that support you and eligible family members including domestic partners and their children. Benefits can vary by location the number of regularly scheduled hours you work length of employment and job status such as seasonal or temporary employment. The benefits that generally apply to regular fulltime employees include:
1. Medical Dental and Vision Coverage
2. Maternity and Parental Leave Options
3. Paid Time Off (PTO)
4. 401(k) Plan

About the team
Omni MLDA (Machine Learning Data Associate) is a team that remotely works to develop and finetune generative AI machine learning models and executes testing plans to take the customer service experience to the next level. This is executed by teams of MLDAs working alongside Science and Product/Program Management teams to release localized customerfacing and agentfacing CS solutions while allowing them to focus on the development of their new products. In addition teams with existing CS experiences can rely on the Omni MLDA team to keep their solutions uptodate and push identified technical defects to tech partner teams or defect elimination teams.

Language fluency in Portuguese (Nativelevel) and English.
Experience in creating and managing ML annotation processes testing models and quality assurance methodologies.
Analytical and problemsolving skills to identify patterns inconsistencies and areas for improvement.
Ability to thoroughly investigate and identify misalignment between annotations and SOPs as well as the root causes of inaccuracies.
Strong ownership and accountability to meet SLAs and proactive communication regarding blockers and proposed solutions.
Ability to collaborate closely with crossfunctional teams understand project/stakeholder requirements and align annotation efforts and model testing accordingly.

Bachelors Degree
Experience in annotation
Familiarity in using Excel
Experience with project management and stakeholder management

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race national origin gender gender identity sexual orientation protected veteran status disability age or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $40400/year in our lowest geographic market up to $86500/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on jobrelated knowledge skills and experience. Amazon is a total compensation company. Dependent on the position offered equity signon payments and other forms of compensation may be provided as part of a total compensation package in addition to a full range of medical financial and/or other benefits. For more information please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.