Senior Systems Engineer, Amazon Special Projects

Innovators wanted! Are you an entrepreneur A builder A dreamer This role is part of an Amazon Special Projects team that takes the companys Think Big leadership principle to the highest levels. We focus on creating entirely new products and services with a goal of positively impacting the lives of our customers. No industries or subject areas are out of bounds. We launched products such as Comprehend Medical Echo Frames and Amazon Explore. If youre interested in innovating at scale to address big challenges in the world this is the team for you.
As the Sr. Systems Engineer you will own the agent daemon that runs on compute nodes the runtime sandbox that isolates workloads and the local storage and caching layer that determines which assets are resident and ready to serve. You will build the detection logic that manages node availability and the GPU capability reporting that tells the scheduler exactly what each node can handle. Your work directly determines whether the platform can deliver low-latency ML inference and whether it can do so reliably at scale.

Key job responsibilities
-Design and implement the agent daemon on Linux including GPU discovery availability detection and sandboxed container execution for ML inference workloads.
-Architect the local caching system eviction policies versioned manifests disk budget management and efficient update mechanisms that minimize data transfer for large model files.
-Build VRAM management and graceful workload migration logic.
-Integrate hardware attestation with the security engineer and support diverse hardware configurations and fleet onboarding automation.

About the team
Amazon Special Projects is a small high-autonomy team building new-to-Amazon infrastructure from scratch. The systems component is where software meets hardware: you will build the on-node runtime the agent sandbox GPU manager and local storage layer that makes a compute node reliable secure and performant. This is systems engineering at its most tangible your code runs on real hardware and must be resilient to everything the real world throws at it.

- 6 years of programming with at least one modern language such as C C# Java Python Golang PowerShell Ruby experience
- 6 years of non-internship professional software development experience
- 6 years of designing or architecting (design patterns reliability and scaling) of new and existing systems experience
- Experience leading the design build and deployment of complex and performant (reliable and scalable) software solutions in production
- 6 years of systems design software development operations automation and process improvement experience
- 7 years of experience in systems programming (Rust Go or C)
- Deep knowledge of Linux internals including process scheduling memory management and storage subsystems
- Hands-on experience with container runtimes (Docker containers or custom sandboxes)
- Experience with GPU tooling and management (nvidia-smi NVML CUDA runtime)
- Demonstrated ability to build software that runs reliably on heterogeneous hardware

- Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle including coding standards code reviews source control management build processes testing certification and livesite operations
- Experience taking a leading role in building complex software or computing infrastructure that has been successfully delivered to customers
- Experience designing caching systems with constrained storage budgets (LRU ARC or custom policies)
- Background in edge computing fleet management or embedded systems engineering
- Familiarity with hardware attestation (TPM TEE) from the device side
- Experience with storage performance profiling and optimization across hardware types
- Track record of building daemon/agent software that operates unattended for extended periods

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience qualifications and location. Amazon also offers comprehensive benefits including health insurance (medical dental vision prescription Basic Life & AD&D insurance and option for Supplemental life plans EAP Mental Health Support Medical Advice Line Flexible Spending Accounts Adoption and Surrogacy Reimbursement coverage) 401(k) matching paid time off and parental leave. Learn more about our benefits at WA Seattle - 151200.00 - 204600.00 USD annually