Software Dev Engineer (Contract), Artificial General Intelligence
Share
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Department:
Job Summary
**This is currently a temporary contract opportunity (12 to 24 months duration) based on business needs**
Artificial General Intelligence (AGI) Data Services is at the forefront of AI innovation specializing in the development and refinement of large language models (LLMs). Our mission is to create AI systems that can understand and generate high-quality code revolutionizing the software development landscape.
Key job responsibilities
1. Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigms
2. Exercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated options
3. Make informed decisions on behalf of our customers ensuring that selected code meets industry standards best practices and specific client needs
4. Develop and write coding demonstrations to illustrate what good looks like in AI-generated code setting benchmarks for quality and efficiency
5. Provide detailed feedback and explanations for your evaluations helping to refine and improve the LLMs understanding and output
6. Collaborate with the AI research team to identify areas for improvement in the LLMs coding capabilities
7. Stay abreast of the latest developments in software engineering coding standards and AI to ensure our evaluations are accurate
A day in the life
As a SDE in Amazon AGI you will play a crucial role in assessing and improving our language models coding capabilities. Your expertise will be instrumental in evaluating LLM-generated code responses making high-level judgments and setting the standard for what constitutes excellent AI-assisted coding.
- Bachelors degree or equivalent
- 2 years of non-internship design or architecture (design patterns reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language
- 3 years of full software development life cycle including coding standards code reviews source control management build processes testing and operations experience
- Masters degree in computer science or equivalent
- Knowledge of professional software engineering & best practices for full software development life cycle including coding standards software architectures code reviews source control management continuous deployments testing and operational excellence
- Previous experience working with or evaluating AI systems particularly in the context of code generation
- Understanding of machine learning concepts particularly as they apply to natural language processing and code generation
- Data analysis skills writing script to analyze model performance against human ground truth
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $62.16/hr in our lowest geographic market up to $107.50/hr in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge skills and experience. Amazon is a total compensation company. Dependent on the position offered equity sign-on payments and other forms of compensation may be provided as part of a total compensation package in addition to a full range of medical financial and/or other benefits. For more information please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.
Artificial General Intelligence (AGI) Data Services is at the forefront of AI innovation specializing in the development and refinement of large language models (LLMs). Our mission is to create AI systems that can understand and generate high-quality code revolutionizing the software development landscape.
Key job responsibilities
1. Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigms
2. Exercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated options
3. Make informed decisions on behalf of our customers ensuring that selected code meets industry standards best practices and specific client needs
4. Develop and write coding demonstrations to illustrate what good looks like in AI-generated code setting benchmarks for quality and efficiency
5. Provide detailed feedback and explanations for your evaluations helping to refine and improve the LLMs understanding and output
6. Collaborate with the AI research team to identify areas for improvement in the LLMs coding capabilities
7. Stay abreast of the latest developments in software engineering coding standards and AI to ensure our evaluations are accurate
A day in the life
As a SDE in Amazon AGI you will play a crucial role in assessing and improving our language models coding capabilities. Your expertise will be instrumental in evaluating LLM-generated code responses making high-level judgments and setting the standard for what constitutes excellent AI-assisted coding.
- Bachelors degree or equivalent
- 2 years of non-internship design or architecture (design patterns reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language
- 3 years of full software development life cycle including coding standards code reviews source control management build processes testing and operations experience
- Masters degree in computer science or equivalent
- Knowledge of professional software engineering & best practices for full software development life cycle including coding standards software architectures code reviews source control management continuous deployments testing and operational excellence
- Previous experience working with or evaluating AI systems particularly in the context of code generation
- Understanding of machine learning concepts particularly as they apply to natural language processing and code generation
- Data analysis skills writing script to analyze model performance against human ground truth
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $62.16/hr in our lowest geographic market up to $107.50/hr in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge skills and experience. Amazon is a total compensation company. Dependent on the position offered equity sign-on payments and other forms of compensation may be provided as part of a total compensation package in addition to a full range of medical financial and/or other benefits. For more information please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.
Key Skills
- IVR
- SOAP
- Avaya
- Solaris
- Cost Accounting Standards
- Database Design
- Hibernate
- ITIL
- Weblogic
- Express.js
- Contracts
- ASP
About Company
AmaZone Cafe it is a very cosy place, focus on healthy food, where you can delight with your friends and family and try the best Acai, the famous brazillian fruit.
