AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the EC2 servers that use them.
As the Software Development Manager for the Neuron Testing Infrastructure Team you will be responsible for leading a talented team of engineers to develop and maintain the critical testing service that enables continuous integration and validation across the entire Neuron SDK Development organization. You will oversee the design development and operation of our large-scale EKS-based test execution platform that manages thousands of test runs daily across pre-release hardware multiple EC2 instance types and diverse software configurations.
In this role you will manage the full lifecycle of a high-demand business-critical service that directly impacts the velocity and quality of AWS Neuron releases. You will ensure the platform maintains strict availability goals while scaling to meet growing demand from development teams. Your team will be responsible for integrating new EC2 instance types and pre-released hardware implementing advanced queue management algorithms optimizing resource utilization across large EKS clusters and maintaining operational excellence. You will collaborate with cross-functional teams including compiler runtime and framework teams to ensure their testing needs are met efficiently and reliably.
A successful candidate will have an established background in building and operating large-scale distributed systems on AWS. Experience managing production EKS clusters at scale (500 nodes) is essential along with proven expertise in service reliability queue management systems and high-availability architecture. Direct customer-facing experience supporting internal development teams and a strong motivation to achieve results through operational excellence are critical for success.
- 3 years of engineering team management experience
- 7 years of working directly within engineering teams experience
- 3 years of designing or architecting (design patterns reliability and scaling) of new and existing systems experience
- 8 years of leading the definition and development of multi tier web services experience
- Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle including coding standards code reviews source control management build processes testing certification and livesite operations
- Experience partnering with product or program management teams
- Hands-on experience managing large-scale EKS clusters (500 nodes) in production environments
- Experience with queue management systems and resource scheduling
- Experience in communicating with users other technical teams and senior leadership to collect requirements describe software product features technical designs and product strategy
- Experience in recruiting hiring mentoring/coaching and managing teams of Software Engineers to improve their skills and make them more effective product software engineers
- Experience with logging and monitoring tools such as: AWS CloudWatch Datadog New Relic and Splunk
- Experience with Kubernetes at scale including autoscaling resource optimization and multi-tenant architectures
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit
for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $166400/year in our lowest geographic market up to $287700/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge skills and experience. Amazon is a total compensation company. Dependent on the position offered equity sign-on payments and other forms of compensation may be provided as part of a total compensation package in addition to a full range of medical financial and/or other benefits. For more information please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.