Software Engineer, Trainium

About the Team

Our mission at OpenAI is to discover and enact the path to safe beneficial AGI. To do this we believe that many technical breakthroughs are needed in generative modeling reinforcement learning large-scale optimization active learning and other areas.

The team builds the performance-critical systems that allow OpenAIs models to run efficiently across a diverse set of AI accelerators. We work across the inference stack from low-level kernels and compilers through model execution to unlock the full capabilities of the underlying hardware.

About the Role

As a Software Engineer Trainium you will help bring OpenAIs inference workloads to AWS Trainium and build the software stack required to run cutting-edge frontier models efficiently on the platform.

This is a deeply technical cross-stack role spanning kernels compilers and model execution. You will work on the systems needed to support OpenAIs inference stack on Trainium including developing and optimizing high-performance kernels improving compiler support and enabling efficient execution of the model forward pass.

Youll work closely with engineers across inference compilers kernels and ML systems to identify performance bottlenecks and build the software needed to take full advantage of Trainium. The work may range from low-level hardware-specific optimization to compiler and runtime improvements to integrating new model architectures into the inference stack.

If you enjoy working at the intersection of ML systems compilers kernels and accelerator hardware this role is for you. Were looking for engineers who are self-directed comfortable operating across abstraction layers and excited to solve challenging performance problems for frontier-scale AI systems.

In This Role You Will

• Build and optimize OpenAIs inference stack for AWS Trainium.

• Develop high-performance kernels for critical model operations and workloads.

• Extend and improve compiler support to efficiently target Trainium hardware.

• Build the systems necessary to execute and optimize the model forward pass on Trainium.

• Profile workloads and identify bottlenecks across kernels compiler-generated code runtime and model execution.

• Partner with inference and ML systems teams to bring new models and architectures onto Trainium.

• Work across the hardware/software boundary to unlock performance and capabilities from specialized AI accelerators.

• Own complex performance and systems problems end-to-end from investigation through production deployment.

Were Looking for a Track Record Of

• 3 years of relevant engineering experience ideally in ML systems compilers kernels runtimes or performance engineering.

• Strong systems programming fundamentals and experience writing performance-critical software.

• Experience working with GPU TPU Trainium or other specialized accelerator architectures.

• Ability to reason about performance across multiple layers of the stack from hardware and kernels through compilers and ML frameworks.

• Owning technically ambiguous problems end-to-end and learning new hardware and software domains as needed.

• Bonus: experience with AWS Trainium or the AWS Neuron SDK.

• Bonus: contributions to ML frameworks such as PyTorch or JAX compiler infrastructure such as LLVM MLIR XLA or Triton or experience developing kernels for specialized accelerators.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core and to achieve our mission we must encompass and value the many different perspectives voices and experiences that form the full spectrum of humanity.

We are an equal opportunity employer and we do not discriminate on the basis of race religion color national origin sex sexual orientation age veteran status disability genetic information or other applicable legally protected characteristic.

For additional information please see OpenAIs Affirmative Action and Equal Employment Opportunity Policy Statement.

Background checks for applicants will be administered in accordance with applicable law and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws including the San Francisco Fair Chance Ordinance the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct adverse and negative relationship with the following job duties potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary confidential and non-public addition job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI we believe artificial intelligence has the potential to help people solve immense global challenges and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Required Experience:

IC