StaffSr. ML Infrastructure Engineer, Foundation Model Compute Infra

Apple is where individual imaginations gather together committing to the values that lead to great work. Every new product we build service we create or Apple Store experience we deliver is the result of us making each others ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world changing lives for the better. Its the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in we can do the best work of our lives. Here youll do more than join something youll add something!

As a Senior/Staff Engineer on the Foundation Model Compute Infrastructure team you will design and build large-scale infrastructure that powers foundation model training fine-tuning evaluation and inference. You will develop model inference and fine-tuning services onboard and benchmark new accelerators and work closely with foundation model researchers and engineers to improve reliability performance scalability and developer productivity across Apples AI workloads.

Design build and evolve large-scale model serving and fine-tuning services for foundation model workloadsnDevelop reliable infrastructure for model deployment serving autoscaling traffic management job execution container orchestration and serving performance analysisnImprove the performance and usability of model serving and fine-tuning workloads by optimizing latency throughput availability accelerator utilization checkpoint loading compilation caching KV-cache-aware routing and workflows for launching monitoring debugging evaluating and deploying modelsnOnboard and Benchmark new accelerator technologies into Apples compute infrastructurenCollaborate with the Apple Foundation Model team to integrate technologies such as Pathways Ray and Beam or expose them as reliable and scalable servicesnMentor engineers and partner across teams to influence the technical direction of Apples foundation model compute infrastructure

5 years of industry experience building large-scale distributed systems or cloud infrastructurenExperience with distributed ML training or inference systemsnStrong programming skills in Python Go C or similar systems languagesnExperience with accelerator infrastructure such as TPU GPUnExperience with Kubernetes container orchestration or large-scale cluster management systemsnStrong communication and collaboration skills across engineering and research teamsnBachelors degree in Computer Science Engineering or related field

Experience building schedulers resource managers or orchestration systems for distributed workloadsnFamiliarity with frameworks such as JAX PyTorch TensorFlow Ray Pathways or vLLMnExperience operating large-scale multi-tenant infrastructure in cloud or hybrid environmentsnBackground in performance optimization fault tolerance or resource efficiency for large distributed systemsnStrong expertise in distributed systems scalability reliability and performance engineeringnExperience designing backend services or infrastructure platforms operating at production scalenMS or PhD in Computer Science Engineering or related field