Freelance Infrastructure Engineer (Senior)

Company Intro

AtToloka AIwe create data that powers leading GenAI models and innovations. We work with frontier labs big tech renowned AI startups enterprises and non-profit research organizations worldwide. We use a combination of Experts Crowd Tech Platform to teach AI models to reason and evaluate their efficacy and safety. We have experts in more than 50 different domainsfrom doctors and lawyers to physicists and engineersand boast one of the most diverse global crowdsrepresenting over100 countries and speaking 40 languages. We are a well-funded startup with an enviable portfolio of clients includingAnthropicAmazonMicrosoftpoolsideRecraft andShopify.

Recently we secured strategic investment led byBezos Expeditionswith participation fromMikhail ParakhinCTO of Shopifyand board advisor to leading GenAI companies who now serves as our Chairman of the Board. Our remote-first team is globally distributed around the world:USAUKthe NetherlandsIsraelCzech RepublicSerbia and more. We are headquartered in Amsterdam.

About position

Toloka AIs Machine Learning without exaggeration a key part of Tolokas success. ML Platform can be represented as a suite of tools and services designed to support the entire machine learning lifecycle from data preprocessing to model deployment management and serving.

We are looking for a Senior Infrastructure Engineer who can help us make our platform even better. We expect the candidate to have a startup mindset move fast ready for pivoting while building a reliable infrastructure.

Responsibilities

• Develop ML infrastructure (backend for LLM inference compute and code execute services);
• Implement new tools for our internal clients;
• Maintain the platform;
• Develop technical documentation;
• Gather requirements from our internal ML teams and offer optimal solution balancing different use cases;
• Be the part highly skilled MLOps engineers;
• Collaborate with users of LLM models - Solution Engineers ML Engineers to provide them with the best ml services and tools.

Requirements

• 5 years experience as Software Engineer (primarily Python);
• Experience in infrastructure or backend development;
• Experience with C/C: memory management and debugging understanding of build systems (CMake/Make) ability to work with low-level code;
• Interest in working on internal infrastructure and MLOps;
• Ability to design solutions and maintain ML infrastructure;
• English language - B2 or higher.

Requirements

• Understanding of instruments and practices for LLM training and inferencing;
• Experience with ML infrastructure;
• Familiar with popular DevOps tools: Kubernetes Docker Terraform;
• Knowledge of how to work with Spark (Databricks);
• Experience in working with Airflow (or theres ETL orchestration tools) and DBT;
• Experience integrating Python services with C/C modules is a plus;
• Familiarity with Java or other JVM languages is a plus.

Tools and technologies

• MLFlow HuggingFace vLLM Celery Databricks Airflow dbt Microsoft Azure Airbyte k8s terraform and a lot of custom self-developed tools.

Important Notice Scam Alert Regarding Fake Job Postings

It has come to our attention that an individual or group is fraudulently impersonating Toloka to post fake jobs and solicit personal information from be aware:

• Official Communication:Our recruiting team willonlycontact you from an official email address. We will NEVER use Gmail Yahoo Tolokainc or other personal or seemingly business email accounts.
• Our Process:We willneverask for your bank account details credit card number or any fees as part of the application or interview process.
• Official Listings:All legitimate job openings are posted on our official careers page: to do:If you see a suspicious job posting or have been contacted by someone you suspect is a scammer please do not provide any personal information. Instead report the incident to us directly atand report the profile/post to are taking this matter very seriously and are working with the appropriate parties to resolve it.
  
  Thank you for your vigilance!