Director Backend Engineering AI Infra

Job Description:Director of Backend Engineering (AI Infrastructure)

Company Introduction

We exist to wow our customers. We know were doing the right thing when we hear our customers say How did I ever live without Coupang Born out of an obsession to make shopping eating and living easier than ever we are collectively disrupting the multi-billion-dollar commerce industry from the ground up and establishing an unparalleled reputation for being leading and reliable force in South Korean commerce.

We are proud to have the best of both worlds a startup culture with the resources of a large global public company. This fuels us to continue our growth and launch new services at the speed we have been since our inception. We are all entrepreneurs surrounded by opportunities to drive new initiatives and innovations. At our core we are bold and ambitious people that like to get our hands dirty and make a hands-on impact. At Coupang you will see yourself your colleagues your team and the company grow every day.

Role Overview

We are seeking a visionary Director of Backend Engineering to lead the teams responsible for the software brain that manages our global AI Physical Infrastructure. You will oversee the development of the SDN orchestrators automated fleet management systems and the high-performance storage backends that power our AI training and inference clusters.

Your mission is to abstract the complexity of specialized hardware (NVIDIA/HPC) into a seamless automated and hyper-reliable cloud platform.

Key Responsibilities

1. Strategic Leadership & Fleet Orchestration

• Software-Defined Infrastructure:Lead the design and delivery of anSDN Orchestratorto automate complex GPU networking (InfiniBand/RoCE/NVLink) and core DC routing.
• Fleet Health Automation:Oversee the development of backend services forGPU Health & Fault Detection automating the lifecycle from burn-in and diagnostics to global RMA workflows.
• Capacity & Traffic Engineering:Drive the backend logic for global traffic routing load balancing (NGINX/Kong) and IPAM to ensure zero-bottleneck training environments.

2. Data & Storage Systems

• HPC Data Pipelines:Collaborate with storage engineers to build backend interfaces forParallel File Systems (Lustre Weka VAST etc.) ensuring high-throughput data delivery to compute nodes.
• Storage Durability:Direct the backend strategy for AI Object Storage focusing on high durability and low-latency retrieval for massive datasets.

3. Engineering Excellence

• Scalable Architecture:Act as the final technical authority for AI Infra Architecture ensuring systems are resilient multi-region and capable of sub-millisecond coordination.
• DevOps & IaC Culture:Champion a Hardware-as-Code mindset utilizingPython Ansible and Terraformto eliminate manual intervention in DC operations.

4. Team Development

• Lead a multi-disciplinary org including Backend Developers SDN Engineers and Infra Ops teams AI Infra Engineering
• Establish 24/7 L1/L2/L3 operational standards to maintain > 99.99% availability of the AI fleet.

Required Qualifications

• Experience:15 years in Backend Engineering with at least 5 years in a leadership role managing complex infrastructure (Cloud FinTech or HPC).
• Deep Infrastructure Knowledge:Proven experience withLinux internals hardware-software interfaces (drivers/firmware) and distributed systems.
• Networking Mastery:Solid understanding ofL2/L3 networking and ideally specialized fabrics likeInfiniBand or RoCE.
• The Stack:Professional proficiency inPython Go or C and deep experience withTerraform Kubernetes and Ansible.
• Large-Scale Data:Experience managing high-performance storage backends (GPFS Lustre or equivalent parallel systems).
• Hardware Savvy:You dont just write code; you understand power envelopes liquid cooling constraints and GPU architecture (NVIDIA/HPE/Dell).

Preferred Skills

• Experience building customSDN controllersor orchestration layers from scratch.
• Direct experience withNVIDIAorGPUDirecttechnologies.
• Previous success in a Hyper-scale environment (AWS Azure GCP Meta AI Cloouds etc.).

Recruitment Process

• Application Review - Phone Interview - Onsite (or Virtual Onsite) Interview Offer

The exact nature of the recruitment process may vary according to the specific job and may be changed due to scheduling or other circumstances.

• Interview schedules and the results will be informed to the applicant via the e-mail address submitted at the application stage.

Details to Consider

• This job posting may be closed prior to the stated end date for application if all openings are filled.
• Coupang has the right to rescind an offer of employment if a candidate is found to have submitted false information as part of the application process.
• Those eligible for employment protection (recipients of veterans benefits the disabled etc.) may receive preferential treatment for employment in accordance with applicable laws.

Privacy Notice

Your personal information will be collected and managed by Coupang as stated in the Application Privacy Notice located below.

Experience:

Director