The AGI Data Services organization is responsible for procuring data needed for building and validating largelanguage models. The vision of the AGIDS Data Quality org is to accurately measure the overall quality and specific utility of every unit of data distributed by the AGIDS organization to our customers; to root cause the reason that quality and utility are low and propose solutions for how to solve; and to manage quality control relationships with delivery channels.
Today AGI Data Services produces tens of millions of units of humancreated data that is used to train and finetune large language models. These data must be evaluated based on whether they were generated following the conventions defined by the workflow on dimensions such as complexity correctness helpfulness and harmfulness. Filtering out high quality data from low quality is of paramount importance as it maximizes our chances of improving performance of the model under test.
To achieve this objective the Data Quality organization is responsible for auditing individual units of data as well as building an automated system using a large language model to predict and filter high quality units of data.
This TPM roles scope includes defining strategy processes and requirements and leading cross functional development teams from design through delivery. You will be accountable for driving the entire product lifecycle from platform product definition through specification coding quality assurance and launch to the world. Most importantly you will influence engineering teams to build the right solutions. You will be also responsible for creating leverage by ensuring capabilities are reusable and scalable to worldwide legislative changes. This position involves regular communication with senior management on status risks and change control. Crossteam coordination project and program management and executive presentation skills are essential.
Key job responsibilities
The Sr. Technical Program Manager will interact with product management program management cross partner teams multiple stakeholders and leadership to deliver complex projects and programs. The person will anticipate bottlenecks provide escalation management make tradeoff decisions and balance business needs versus technical constraints.
The person should have technical skills to provide solutions design build and deliver it. Successful candidates will have a strong technical background be detail driven and have excellent problem solving abilities. You will have a deep understanding of product design and implementation details and will successfully represent the technical team to senior leadership and customers. Your technical expertise and operational excellence will influence the teams decisions and drive secure and robust solutions which have great customer experience. They are responsible for bridging scientists technology process and operations for to achieve the right results. This position defines standards and measurements identifies the inputs that drive the quality of Ground Truth and drives initiatives across a variety of teams to achieve these results.
A day in the life
Collaborate with internal partners to understand their business priorities communicate outcomes and define roadmaps.
Define metrics and performance indicators and establish mechanisms to drive them.
Dive deep into anecdotes and data to find patterns and root causes of problems.
Dive deep into science technology and process to identify problems and create solutions. Tirelessly advocate for improvements to systems and processes that will benefit our product teams / stakeholders and business partners.
Engage with ML Data operations teams to root cause issues and design solutions.
5 years of technical product or program management experience
7 years of working directly with engineering teams experience
3 years of software development experience
5 years of technical program management working directly with software engineering teams experience
Experience managing programs across cross functional teams building processes and coordinating release schedules
5 years of project management disciplines including scope schedule budget quality along with risk and critical path management experience
Experience managing projects across cross functional teams building sustainable processes and coordinating release schedules
Experience defining KPIs/SLAs used to drive multimillion dollar businesses and reporting to senior leadership
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race national origin gender gender identity sexual orientation protected veteran status disability age or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit
for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $133900/year in our lowest geographic market up to $231400/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on jobrelated knowledge skills and experience. Amazon is a total compensation company. Dependent on the position offered equity signon payments and other forms of compensation may be provided as part of a total compensation package in addition to a full range of medical financial and/or other benefits. For more information please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.