Infrastructure Engineer Data Acquisition
Infrastructure Engineer Data Acquisition
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
USD 255000 - 405000
1 Vacancy
Job Description
About the DAQ Team
The Data Acquisition (DAQ) organization is responsible for building and operating the data pipelines crawling storage systems and postprocessing platforms that fuel OpenAIs research and product development. Our Infrastructure teams mission is to enable DAQ developers to move fast with minimal friction providing just enough reliability observability and tooling in a highly dynamic environment. We value broad impact and rapid iteration over polished perfection. As our data needs grow by orders of magnitude this small but spy team ensures that our foundational services can keep pace.
We operate across a wide range of infrastructure concerns including:
Scaling web crawler (from modest usage to many multiples of that in the coming year)
Managing storage and compute for largescale indexing embedding and search workloads
Evolving observability (metrics logs traces) and automation in a flexible 80/20 manner
Adopting bestofbreed tooling and security from other parts of the organization (e.g. Terraform stacks cloud platform practices)
Rather than enforcing rigid SLAs or designing monolithic infrastructure we focus on empowering DAQ teams to build deploy and run their own services. Our environment can be fluid and ad hoc if something solves the problem quickly and reliably enough that is usually the correct approach.
About the Role
Were looking for a handson Infrastructure Engineer with a strong bias toward action. Youll be part of a small group of generalists responsible for everything from adhoc shell scripts to cluster provisioning automation. You will both design and implement systems: we do create architecture but its rarely in the form of a lengthy design doc that goes stalerather we value prototyping iterating and shipping quickly.
In this role you will:
Scale and maintain our data pipelines and compute clusters as DAQ grows by large multiples in the next year
Build out just enough observability (metrics logs tracing) to support developer troubleshooting and performance insights
Help design oncall processes for the infra we own balancing developer velocity with service reliability
Collaborate directly with DAQ teams on deployment approaches ephemeral or ad hoc workloads network/security integrations and more
Prototype and implement solutions for caching load balancing job scheduling and cluster scaling with an emphasis on iteration speed
Improve developer productivity by reducing frictionthrough better tooling automated provisioning and simplified environment setups
Adopt and integrate InfrastructureasCode (IaC) CI and security best practices from other teams tailoring them to DAQs dynamic needs
You might thrive in this role if you are a broad generalist who enjoys a spy resultsoriented culture can dive into anything from container orchestration to networking and loves to unblock fellow engineers by building reliable infrastructure that supports massive growth. Youre comfortable with cloud infrastructure automation observability and are eager to work in a dynamic and fastmoving team environment.
Qualifications
Proven experience in an infrastructure backend role ideally in a fastpaced environment
Comfort with at least one major cloud platform and its associated tooling
Familiarity with containerization and orchestration technologies (Kubernetes or similar)
Some background with IaC (e.g. Terraform CloudFormation)
Handson experience with monitoring/observability stacks
Strong scripting/coding ability to build and automate solutions (your language of choice)
Ability to balance spiness and speed with robust design when needed
Effective communication and collaboration skills; you enjoy enabling others
We are a small team tackling big scaling challenges with lean resourcesthis role is pivotal to enabling the next wave of DAQs growth. If youre excited by a highimpact handson position where youll have broad autonomy and creative freedom to shape infrastructure wed love to hear from you!
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that generalpurpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core and to achieve our mission we must encompass and value the many different perspectives voices and experiences that form the full spectrum of humanity.
We are an equal opportunity employer and do not discriminate on the basis of race religion national origin gender sexual orientation age veteran status disability or any other legally protected status.
OpenAI Affirmative Action and Equal Employment Opportunity Policy Statement
For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance we will consider qualified applicants with arrest and conviction records.
We are committed to providing reasonable accommodations to applicants with disabilities and requests can be made via thislink.
OpenAI Global Applicant Privacy Policy
At OpenAI we believe artificial intelligence has the potential to help people solve immense global challenges and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
Employment Type
Full-Time
