System Engineer, GPU Fleet

Fluidstack

Not Interested
Bookmark
Report This Job

profile Job Location:

New York City, NY - USA

profile Monthly Salary: $ 200 - 300
Posted on: 2 days ago
Vacancies: 1 Vacancy

Job Summary

About Fluidstack

At Fluidstack were building the infrastructure for abundant intelligence. We partner with top AI labs governments and enterprises - including Mistral Poolside Black Forest Labs Meta and more - to unlock compute at the speed of light.

Were working with urgency to make AGI a reality. As such our team is highly motivated and committed to delivering world-class infrastructure. We treat our customers outcomes as our own taking pride in the systems we build and the trust we earn. If youre motivated by purpose obsessed with excellence and ready to work very hard to accelerate the future of intelligence join us in building whats next.

About the Role

As a System Engineer GPU Fleet you will manage operate and optimize hyperscale GPU compute infrastructure supporting AI/ML training and inference workloads. Ensure high availability performance and reliability of GPU server fleet through automation monitoring troubleshooting and collaboration with hardware engineering platform teams and datacenter operations.

Focus

  • Operate and maintain large-scale GPU server fleet (H100 B200 GB200) supporting AI/ML workloads; monitor system health performance and utilization to maximize uptime and ensure SLA compliance

  • Perform hands-on troubleshooting and root cause analysis of complex hardware firmware OS and application issues across GPU clusters; coordinate with vendors and hardware teams to resolve systemic failures

  • Develop and maintain automation scripts for provisioning configuration management monitoring and remediation at scale.

  • Build and improve tooling for GPU health checks performance diagnostics driver validation and automated recovery

  • Execute server provisioning configuration firmware updates and OS installation using automation frameworks; manage lifecycle operations including deployment maintenance and decommissioning

  • Participate in 24x7 on-call rotation; respond to production incidents and coordinate resolution with cross-functional teams including datacenter operations network engineering and application teams

  • Lead post-incident reviews document root causes and drive continuous improvement initiatives focused on automation reliability monitoring and operational efficiency


Basic Qualifications

  • Bachelors degree in Computer Science Engineering or related technical field (or equivalent practical experience)

  • 3 years (System Engineer) or 5 years (Senior System Engineer) in Linux system administration datacenter operations or infrastructure engineering

  • Strong Linux/Unix fundamentals including system administration shell scripting (Bash Python) troubleshooting and performance tuning

  • Experience with server hardware architecture troubleshooting techniques and understanding of compute memory storage and networking components

  • Experience in automation and configuration management tools (Ansible Puppet Chef Terraform).

  • Strong analytical and problem-solving skills with ability to diagnose complex technical issues under pressure

  • Excellent communication and collaboration skills; ability to work effectively with cross-functional teams

Preferred Qualifications

  • Experience managing large-scale GPU infrastructure (NVIDIA H100 A100 B200 GB200) in production environments supporting AI/ML workloads

  • Deep knowledge of GPU architecture CUDA toolkit GPU drivers monitoring tools (nvidia-smi DCGM)

  • Experience with HPC cluster management job schedulers (Slurm PBS LSF) and container orchestration (Kubernetes Docker)

  • Proficiency in out-of-band management protocols (IPMI Redfish BMC) and firmware management for server hardware

  • Experience with high-performance networking (InfiniBand RoCE RDMA) and network troubleshooting in GPU cluster environments

  • Familiarity with datacenter operations including rack installations cabling power management and thermal considerations

Salary & Benefits

  • Competitive total compensation package (salary equity).

  • Retirement or pension plan in line with local norms.

  • Health dental and vision insurance.

  • Generous PTO policy in line with local norms.

The base salary range for this position is $200000 - $300000 per year depending on experience skills qualifications and location. This range represents our good faith estimate of the compensation for this role at the time of posting. Total compensation may also include equity in the form of stock options.

We are committed to pay equity and transparency.

Fluidstack is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability and protected veterans status or any other characteristic protected by law. Fluidstack will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

You will receive a confirmation email once your application has successfully been accepted. If there is an error with your submission and you did not receive a confirmation email please email with your resume/CV the role youve applied for and the date you submitted your application-- someone from our recruiting team will be in touch.


Required Experience:

IC

About FluidstackAt Fluidstack were building the infrastructure for abundant intelligence. We partner with top AI labs governments and enterprises - including Mistral Poolside Black Forest Labs Meta and more - to unlock compute at the speed of light.Were working with urgency to make AGI a reality. As...
View more view more

Key Skills

  • AS400
  • Transportation Management Systems
  • Microsoft Outlook
  • Vehicle Maintenance
  • Dispatching
  • Maintenance Management
  • OSHA
  • Maintenance
  • Fleet Management
  • Operating Systems
  • Leadership Experience
  • Logistics