SDE I - Systems Runtime and ML Infrastructure AWS Custom Silicon Annapurna Labs

At AWS were pioneering the future of cloud computing and AI acceleration through innovative hardwaresoftware codesign. Our teams within Annapurna Labs and AWS AI are creating the foundation for nextgeneration cloud infrastructure that powers thousands of customers worldwide from cuttingedge startups to global enterprises.

We operate at an unprecedented scale designing custom silicon chips advanced networking solutions and ML accelerators that were unimaginable just a few years ago.

Our work spans from the lowest levels of hardware abstraction to highperformance distributed training systems creating unique opportunities for earlycareer engineers to make significant impact across multiple domains.


Key job responsibilities
Develop and optimize software for custom hardware and ML infrastructure
Collaborate with hardware teams to understand and leverage chip architecture
Implement and improve networking runtime and systemlevel software
Assist in building and maintaining tools for profiling monitoring and debugging ML workloads
Contribute to the development of opensource ML frameworks and infrastructure projects
Participate in code reviews and implement best practices for software development
Learn and apply new technologies to solve complex engineering challenges

About the team
Candidates will be routed to specific teams based on their interests and our current needs during the application process:

The Elastic Network Adapter (ENA) team revolutionizes EC2 core networking enabling enhanced networking capabilities across AWSs most critical compute instances. Here youll work with networking protocols and highperformance drivers that power millions of cloud workloads.

Our AWS Neuron SDK team develops the complete software stack for custom ML accelerators (Inferentia and Trainium) democratizing access to AI infrastructure. This team bridges the gap between popular ML frameworks and custom hardware.

The Machine Learning Server Software team maintains and optimizes the worlds most advanced ML servers focusing on systemlevel software that ensures peak performance of AI workloads. While we dont work directly on ML algorithms we build the critical infrastructure that makes ML possible at scale.

The SoC Hardware Abstraction Layer (HAL) team works at the intersection of hardware and software developing the crucial middleware that manages our custom silicon chips. This team ensures our innovative hardware designs translate into reliable highperformance solutions.


To qualify applicants should have earned (or expect to earn) a Bachelors or Masters degree between December 2022 to September 2025.
Strong programming skills in C/C or Python with solid understanding of data structures and algorithms
Understanding of computer architecture operating systems and Linux environments
Internship or project experience related to systems programming networking or ML




Familiarity with version control systems (e.g. Git) and software development methodologies
Knowledge of ML concepts or frameworks (e.g. PyTorch TensorFlow)
Interest in opensource development or contributions to technical communities

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race national origin gender gender identity sexual orientation protected veteran status disability age or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees supervisors and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees supervisors and staff to ensure exceptional customer service; and follow all federal state and local laws and Company policies. Criminal history may have a direct adverse and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above as well as the abilities to adhere to company policies exercise sound judgment effectively manage stress and work safely and respectfully with others exhibit trustworthiness and professionalism and safeguard business operations and the Companys reputation. Pursuant to the Los Angeles County Fair Chance Ordinance we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $99500/year in our lowest geographic market up to $200000/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on jobrelated knowledge skills and experience. Amazon is a total compensation company. Dependent on the position offered equity signon payments and other forms of compensation may be provided as part of a total compensation package in addition to a full range of medical financial and/or other benefits. For more information please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.