Applied Scientist, Artificial General Intelligence, AGI Data Services
Share
Job Location:
Bellevue, WA - USA
Monthly Salary:
Not Disclosed
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
Key job responsibilities
As part of the AGI team an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs quality metrics and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits conduct meta-audits to evaluate auditor performance and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems including designing judge architectures creating evaluation rubrics and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services.
A day in the life
An Applied Scientist with the AGI team will support quality solution design conduct root cause analysis on data quality issues research new auditing methodologies and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development an Applied Scientist will also work closely with talented engineers domain experts and vendor teams to put quality strategies and automated judging systems into practice.
- Masters degree in computer science mathematics statistics machine learning or equivalent quantitative field
- Experience programming in Java C Python or related language
- Experience with SQL and an RDBMS (e.g. Oracle) or Data Warehouse
- Experience implementing algorithms using both toolkits and self-developed code
- Have publications at top-tier peer-reviewed conferences or journals
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience qualifications and location. Amazon also offers comprehensive benefits including health insurance (medical dental vision prescription Basic Life & AD&D insurance and option for Supplemental life plans EAP Mental Health Support Medical Advice Line Flexible Spending Accounts Adoption and Surrogacy Reimbursement coverage) 401(k) matching paid time off and parental leave. Learn more about our benefits at WA BELLEVUE - 136000.00 - 184000.00 USD annually
Required Experience:
IC
Key Skills
- Laboratory Experience
- Immunoassays
- Machine Learning
- Biochemistry
- Assays
- Research Experience
- Spectroscopy
- Research & Development
- cGMP
- Cell Culture
- Molecular Biology
- Data Analysis Skills
About Company
Free shipping on millions of items. Get the best of Shopping and Entertainment with Prime. Enjoy low prices and great deals on the largest selection of everyday essentials and other products, including fashion, home, beauty, electronics, Alexa Devices, sporting goods, toys, automotive ... View more
