drjobs ML Ops Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

London - UK

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Overview

We are seeking a highly skilledML Ops Engineerto join our growing data team. This role is critical in designing and implementing robust scalable and efficient data systems that power analytics machine learning models and business insights. The ideal candidate will have expertise in data pipeline orchestration (e.g. Airflow) data lake and warehouse architecture and developmentinfrastructure as code (IaC)usingTerraformand data extraction from both structured and unstructured data sources (e.g. websites). Knowledge using theMicrosoft Azure ecosystemMLOpsKubernetes and other modern data engineering practices.

Responsibilities

Data Architecture & Development:

  • Devesign and implement scalable secure and high-performance data lake and data warehouse solutions.
  • Lerage best practices in schema design partitioning and optimisation for efficient storage and retrieval.
  • Build and maintain data models to support analytics and machine learning workflows.

Pipeline Orchestration:

  • Develop monitor and optimize ETL/ELT workflows using Apache Airflow.
  • Ensure data pipelines are robust error-tolerant and scalable for real-time and batch processing.

Data Scraping & Unstructured Data Processing:

  • Develop and maintain scalable web scraping solutions to collect data from diverse sources including APIs websites and other unstructured data sources.
  • Extract clean and transform unstructured data such as text images and log files into structured formats suitable for analysis.
  • Use tools and frameworks likeBeautifulSoupScrapy orSeleniumfor web scraping and natural language processing (NLP) techniques for text processing.

Cloud Integration:

  • Design and implement cloud-native data solutions with Microsoft Azure.
  • Optimize costs and performance of cloud-based data solutions.

Infrastructure as Code (IaC):

  • Use Terraform to automate the provisioning and management of cloud infrastructure.
  • Define reusable and modular Terraform configurations to support scalable deployment of resources.

MLOps:

  • Collaborate with data scientists and machine learning engineers to operationalise machine learning models.
  • Implement CI/CD pipelines for machine learning workflows ensuring efficient model deployment and monitoring.

Containerisation and Orchestration:

  • Utilize Kubernetes and containerisation technologies (e.g. Docker) to deploy scalable fault-tolerant data processing systems.
  • Manage infrastructure and resource allocation for containerised data applications.

Cross-Functional Collaboration:

  • Work closely with stakeholders including data scientists software engineers and business analysts to align technical solutions with business needs.
  • Mentor junior engineers and foster a culture of continuous learning within the team.

Skills / Qualifications

Education:

  • Bachelors/Masters/PhD degree in Computer Science Engineering or a related field; or equivalent professional experience.

Experience:

  • 5 years of experience in data engineering or a related field.
  • Strong expertise indata pipeline orchestration toolssuch asApache Airflow.
  • Proven track record of designing and implementingdata lakes and warehouses(experience with Azure is a plus).
  • Demonstrated experience withTerraformfor infrastructure provisioning and management.
  • Solid understanding of MLOps practices including model training deployment and monitoring.
  • Hands-on experience with Kubernetes and containerised environments.

Technical Skills:

  • Proficiency in programming languages such as Python & SQL.
  • Experience with distributed computing frameworks such as Spark.
  • Familiarity with version control systems (e.g. Git) and CI/CD pipelines.

Soft Skills:

  • Strong problem-solving skills and the ability to work in a fast-paced collaborative environment.
  • Excellent communication and documentation skills.
  • Strong analytical mindset with attention to detail.

#LI-DJ1

Diversity Statement

At Element we always take pride in putting our people first. We are an equal opportunity employer that recognizes diversity and inclusion as fundamental to our Vision of becoming the worlds most trusted testing partner.

All suitably qualified candidates will receive consideration for employment on the basis of objective work related criteria and without regard for the following: age disability ethnic origin gender marital status race religion responsibility of dependents sexual orientation or gender identity or other characteristics in accordance with the applicable governing laws or other characteristics in accordance with the applicable governing laws.

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about discussed or disclosed their own pay or the pay of another employee or applicant. However employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information unless the disclosure is (a) in response to a formal complaint or charge (b) in furtherance of an investigation proceeding hearing or action including an investigation conducted by the employer or (c) consistent with the contractors legal duty to furnish information. 41 CFR 60-1.35(c)

If you need an accommodation filling out an application or applying to a job please email

Employment Type

Unclear

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.