Domain Expert Lead- STEM (Contract), AGI Data Services

**This is a 12 month contract opportunity with the possibility to extend based on business needs**

Embark on a transformative journey as our Domain Expert Lead where intellectual rigor meets cutting-edge technological this pivotal role you will serve as a strategic architect of data integrity leveraging your domain expertise to advance AI model training and evaluation. Your domain knowledge and experience will be instrumental in elevating our artificial intelligence capabilities meticulously refining data collection processes and ensuring the highest standards of quality and precision across complex computational landscapes.

Key job responsibilities
Critically analyze and evaluate responses generated by our LLMs across various domains and use cases in your area of expertise.
Develop and write demonstrations to illustrate what good data looks like in terms of meeting benchmarks for quality and efficiency
Participate in the creation of tooling that helps create such data by providing your feedback on what works and what doesnt.
Champion effective knowledge-sharing initiatives by translating domain expertise into actionable insights while cultivating strategic partnerships across multidisciplinary teams.
Provide detailed feedback and explanations for your evaluations helping to refine and improve the LLMs understanding and output
Collaborate with the AI research team to identify areas for improvement in the LLMs capabilities
Stay abreast of the latest developments in how LLMs and GenAI can be applied to your area of expertise to ensure our evaluations remain cutting-edge.


- 1 years of data querying languages (e.g. SQL) scripting languages (e.g. Python) or statistical/mathematical software (e.g. R SAS Matlab etc.) experience
- 2 years of data/research scientist statistician or quantitative analyst in an internet-based company with complex and big data sources experience
- 1 years of creating or contributing to mathematical textbooks research papers or educational content experience
- Masters degree in Science Technology Engineering or Mathematics (STEM) or experience working in Science Technology Engineering or Mathematics (STEM)

- Ph.D. in Science Technology Engineering or Mathematics (STEM)
- Knowledge of statistical packages and business intelligence tools such as SPSS SAS S-PLUS or R
- Knowledge of machine learning concepts and their application to reasoning and problem-solving
- Experience with clustered data processing (e.g. Hadoop Spark Map-reduce and Hive)
- Experience working with or evaluating AI systems
- Experience applying quantitative analysis to solve business problems and making data-driven business decisions
- Experience effectively communicating complex concepts through written and verbal communication

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.

The starting pay for this position is listed below. Final starting pay will be based on factors including experience qualifications and location. Starting Day 1 of employment Amazon offers EAP Mental Health Support Medical Advice Line 401(k) matching. Learn more about our benefits at MA Boston - 108300.00 - 160000.00 USD annually
USA WA Bellevue - 108300.00 - 160000.00 USD annually