Software Development Engineer Testing Infrastructure & Performance, TrainiumNeuron, Annapurna Labs

The Neuron team within Annapurna ML develops the software stack that powers AWSs custom AI training and inference chips (Trainium Inferentia). Our team builds and operates the testing infrastructure and performance characterization systems that ensure every release meets quality and performance bars before reaching customers. We directly enable the velocity and reliability of Neuron software releases.

We are looking for a Software Development Engineer to own and evolve the testing infrastructure and performance pipeline that validates Neuron software across workloads models and hardware configurations. You will build data pipelines that collect process and surface performance metrics and dashboards that give engineers and leadership real-time visibility into regression detection performance trends and release readiness. Your work directly impacts how fast we ship high-quality software to customers running ML workloads on Trainium.


Key job responsibilities
- Design build and maintain automated testing infrastructure (Python) that validates Neuron compiler runtime and framework integrations across hardware targets
- Build and operate data pipelines that ingest performance benchmarks test results and system metrics from distributed test runs into centralized data stores
- Develop performance dashboards that surface regression detection trend analysis and release-readiness signals to engineering teams and leadership
- Create and maintain integration test frameworks that validate end-to-end model compilation execution and performance across Trainium configurations
- Build automated alerting and triage tooling that identifies performance regressions early and routes them to the right owners
- Collaborate with Compiler Runtime and Training teams to define performance benchmarks SLAs and quality gates for release criteria
- Extend testing infrastructure to support new model architectures training workflows and hardware generations as they come online


About the team
Annapurna Labs is a wholly owned subsidiary of AWS focused on developing custom silicon and software including the Nitro Graviton Inferentia and Trainium families. The Neuron team builds the ML compiler runtime and tools that enable customers to train and deploy models on AWS custom silicon. This role sits within the testing and performance infrastructure function supporting Neuron development.

- Bachelors degree or above in computer science or equivalent
- Experience with Python in a production or infrastructure context
- Experience building data pipelines (ETL batch/streaming processing data warehousing)
- Experience with testing frameworks and test automation at scale

- Masters degree in computer science machine learning engineering or related fields or experience with Machine and Deep Learning toolkits such as MXNet TensorFlow Caffe and PyTorch
- Experience building performance dashboards or observability tooling (Grafana QuickSight CloudWatch or similar)
- Experience with distributed systems testing or hardware-in-the-loop test infrastructure
- Experience with AWS services (S3 DynamoDB Lambda Step Functions ECS)
- Familiarity with statistical methods for regression detection or performance analysis

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees supervisors and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees supervisors and staff to ensure exceptional customer service; and follow all federal state and local laws and Company policies. Criminal history may have a direct adverse and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above as well as the abilities to adhere to company policies exercise sound judgment effectively manage stress and work safely and respectfully with others exhibit trustworthiness and professionalism and safeguard business operations and the Companys reputation. Pursuant to the Los Angeles County Fair Chance Ordinance we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience qualifications and location. Amazon also offers comprehensive benefits including health insurance (medical dental vision prescription Basic Life & AD&D insurance and option for Supplemental life plans EAP Mental Health Support Medical Advice Line Flexible Spending Accounts Adoption and Surrogacy Reimbursement coverage) 401(k) matching paid time off and parental leave. Learn more about our benefits at CA Cupertino - 127100.00 - 185000.00 USD annually