Software Development Engineer I – AIML Network Infrastructure, Annapurna Labs

Were looking for a talented early-career engineer to join our team that owns the network stack for EC2 distributed AI/ML systems. Youll work on software that enables the worlds largest AI models to train across massive GPU clusters developing support for communication libraries and frameworks like NCCL NVSHMEM and NIXL.

This is a ground-floor opportunity to work at the intersection of high-performance computing networking and machine learning infrastructure - building the systems that power the largest AI workloads in the cloud.

Key job responsibilities
- Write high-performance C/C code for network communication libraries running on custom AWS hardware
- Build and maintain infrastructure that monitors functionality and performance of large-scale AI/ML workloads
- Develop automation using Python and AWS tools (CI/CD Grafana Athena) to test benchmark and deliver software to customers
- Design mechanisms to detect functional and performance regressions before they reach production
- Work across many instance types software stacks and Linux environments

- Bachelors or Masters degree in Computer Science Computer Engineering or related field (recent graduates welcome)
- Strong proficiency in C/C
- Solid coursework or project experience in: 1/ Operating Systems (Linux internals kernel concepts memory management) 2/ Parallel Computer Architecture (multi-threading SIMD GPU programming cache coherence) 3/ Distributed Systems (consensus message passing fault tolerance scalability)
- Familiarity with Linux development environments and toolchains

- Internship experience in ML communications HPC networking or RDMA/high-speed interconnects
- Exposure to network programming (sockets MPI collective communication patterns)
- Experience with performance profiling and optimization
- Familiarity with GPU programming (CUDA) or hardware-software co-design
- Contributions to open-source projects in systems networking or HPC

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees supervisors and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees supervisors and staff to ensure exceptional customer service; and follow all federal state and local laws and Company policies. Criminal history may have a direct adverse and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above as well as the abilities to adhere to company policies exercise sound judgment effectively manage stress and work safely and respectfully with others exhibit trustworthiness and professionalism and safeguard business operations and the Companys reputation. Pursuant to the Los Angeles County Fair Chance Ordinance we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience qualifications and location. Amazon also offers comprehensive benefits including health insurance (medical dental vision prescription Basic Life & AD&D insurance and option for Supplemental life plans EAP Mental Health Support Medical Advice Line Flexible Spending Accounts Adoption and Surrogacy Reimbursement coverage) 401(k) matching paid time off and parental leave. Learn more about our benefits at CA Cupertino - 127100.00 - 185000.00 USD annually