AI Inference Engineer - Large Language Models fmd
AI Inference Engineer - Large Language Models fmd
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Overview:
You will join our product team in a position that sits at the intersection of artificial intelligence research and realworld solutions. We foster a highly collaborative work culture where you can expect to work closely with your teammates and have a high level of communication between teams through methodologies such as pair or mob programming.
Your responsibilities:
Model Inference:Focus on inference optimization to ensure rapid response times and efficient resourceutilizationduring realtime model interactions.
Hardware Optimization:Run models on various hardware platforms from highperformance GPUs to edge devices ensuringoptimalcompatibility and performance.
Experimentation and Testing:Regularly run experiments analyze outcomes and refinethestrategies to achieve peak performance in varying deployment scenarios.
Staying up to date with the current literature onMLSys
Your profile:
You care about making something people want. You want to ship something that will bring value to our users. You want to deliver AI solutions endtoend and not finish building a prototype.
Bachelorsdegreeor higherin computer science or a related field.
You understand how multimodal transformers work.
You understand the characteristics of LLM inference (KV caching flash attention and model parallelization).
You have handson experience with large language models or other complex AI architectures.
You have experience in system design and optimization particularly within AI or deep learning contexts.
You areproficientin Python andhavedeepunderstanding of deep learning frameworkssuch asPyTorch.
A deep understanding of the challenges associated with scaling AI models forlargeuser bases.
Nice if you have:
Previousexperience in a highgrowth tech environment or a role focused on scaling AI solutions.
ExpertisewithCUDAand Tritonprogramming and GPU optimization for neural network inference.
ExperiencewithRust.
Experience in adapting AI models to suit a range of hardware including different accelerators.
Experience in model quantization pruning and other neural network optimization methodologies.
Atrack recordof contributions to opensource projects (please provide links).
SomeTwitter presencediscussing ML Sys topics.
What you can expect from us:
Become part of an AI revolution!
30 days of paid vacation
Access to a variety of fitness & wellness offerings via Wellhub
Mental health support through nilo.health
Substantially subsidized company pension plan for your future security
Subsidized Germanywide transportation ticket
Budget for additional technical equipment
Flexible working hours for better worklife balance and hybrid working model
Virtual Stock Option Plan
Employment Type
Full-Time
