Sr. Applied Scientist, Silicon and Systems Group Edge AI
Share
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
Amazon Devices is an inventive research and development company that designs and engineer high-profile devices like Echo Fire Tablets Fire TV and other consumer devices. We are looking for exceptional scientists to join our Applied Science team to advance the state-of-the-art in developing efficient multimodal language models across our product portfolio. Through close hardware-software integration we design and train models for resource efficiency across the hardware and software tech stack.
The Silicon and Solutions Group Edge AI team is looking for a talented Sr. Applied Scientist who will lead our efforts on inventing evaluation methods for multimodal language models and agents for new devices including audio and vision experiences.
Key job responsibilities
- Collaborate with cross-functional engineers and scientists to advance the state of the art in multimodal model evaluations for devices including audio images and videos
- Invent and validate reliability for novel automated evaluation methods for perception tasks such as fine-tuned LLM-as-judge
- Develop and extend our evaluation framework(s) to support expanding capabilities for multimodal language models
- Analyze large offline and online datasets to understand model gaps develop methods to interpret model failures and collaborate with training teams to enhance model capabilities for product use cases
- Work closely with scientists compiler engineers data collection and product teams to advance evaluation methods
- Mentor less experienced Applied Scientists
A day in the life
As a Scientist with the Silicon and Solutions Group Edge AI team youll contribute to innovative methods for evaluating new product experiences and discover ways to enhance our model capabilities and enrich our customer experiences. Youll research new methods for reliably assessing perception capabilities for audio-visual tasks in multimodal language models design and implement new metrics and develop our evaluation framework. Youll collaborate across teams of engineers and scientists to identify and root cause issues in models and their system integration to continuously enhance the end-to-end experience.
About the team
Our Edge AI science team brings together our unique skills and experiences to deliver state-of-the-art multimodal AI models that enable new experiences on Amazon devices. We work at the intersection of hardware software and science to build models designed for our custom silicon.
- PhD in engineering technology computer science machine learning robotics operations research statistics mathematics or equivalent quantitative field
- Experience programming in Java C Python or related language
- Experience with neural deep learning methods and machine learning
- Experience in building machine learning models for business application
- Experience with modeling tools such as R scikit-learn Spark MLLib MxNet Tensorflow numpy scipy etc.
- Experience with large scale distributed systems such as Hadoop Spark etc.
- Experience working with evaluations for large language models (LLMs) and/or vision-language models
Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover invent simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice ( to know more about how we collect use and transfer the personal data of our candidates.
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.
The Silicon and Solutions Group Edge AI team is looking for a talented Sr. Applied Scientist who will lead our efforts on inventing evaluation methods for multimodal language models and agents for new devices including audio and vision experiences.
Key job responsibilities
- Collaborate with cross-functional engineers and scientists to advance the state of the art in multimodal model evaluations for devices including audio images and videos
- Invent and validate reliability for novel automated evaluation methods for perception tasks such as fine-tuned LLM-as-judge
- Develop and extend our evaluation framework(s) to support expanding capabilities for multimodal language models
- Analyze large offline and online datasets to understand model gaps develop methods to interpret model failures and collaborate with training teams to enhance model capabilities for product use cases
- Work closely with scientists compiler engineers data collection and product teams to advance evaluation methods
- Mentor less experienced Applied Scientists
A day in the life
As a Scientist with the Silicon and Solutions Group Edge AI team youll contribute to innovative methods for evaluating new product experiences and discover ways to enhance our model capabilities and enrich our customer experiences. Youll research new methods for reliably assessing perception capabilities for audio-visual tasks in multimodal language models design and implement new metrics and develop our evaluation framework. Youll collaborate across teams of engineers and scientists to identify and root cause issues in models and their system integration to continuously enhance the end-to-end experience.
About the team
Our Edge AI science team brings together our unique skills and experiences to deliver state-of-the-art multimodal AI models that enable new experiences on Amazon devices. We work at the intersection of hardware software and science to build models designed for our custom silicon.
- PhD in engineering technology computer science machine learning robotics operations research statistics mathematics or equivalent quantitative field
- Experience programming in Java C Python or related language
- Experience with neural deep learning methods and machine learning
- Experience in building machine learning models for business application
- Experience with modeling tools such as R scikit-learn Spark MLLib MxNet Tensorflow numpy scipy etc.
- Experience with large scale distributed systems such as Hadoop Spark etc.
- Experience working with evaluations for large language models (LLMs) and/or vision-language models
Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover invent simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice ( to know more about how we collect use and transfer the personal data of our candidates.
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.
Required Experience:
Senior IC
Key Skills
- Laboratory Experience
- Immunoassays
- Machine Learning
- Biochemistry
- Assays
- Research Experience
- Spectroscopy
- Research & Development
- cGMP
- Cell Culture
- Molecular Biology
- Data Analysis Skills
About Company
Free shipping on millions of items. Get the best of Shopping and Entertainment with Prime. Enjoy low prices and great deals on the largest selection of everyday essentials and other products, including fashion, home, beauty, electronics, Alexa Devices, sporting goods, toys, automotive ... View more
