drjobs 25-026 DevOps Engineer

25-026 DevOps Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Toronto - Canada

Monthly Salary drjobs

$ 80 - 100

Vacancy

1 Vacancy

Job Description

Job Description


Number of Vacancies: 1
Level: MP4
Hourly Rate: $80 100/hour
Duration: 10 Months
Hours of work: 35
Location: 700 University Avenue Toronto 100 Remote)


Job Overview

We are seeking a skilled DevOps Engineer to support our data analytics developers in deploying maintaining and troubleshooting data pipelines within our Azurebased Data Lake environment. This role will be responsible for managing Cl/CD pipelines ensuring seamless code deployment from development to UAT and production and establishing best practices for DevOps in our data engineering and analytics functions specifically we are standing up a Centre of Advanced Analytics and need dedicated expertise and support. The ideal candidate will bring expertise in cloudbased DevOps data pipeline automation and infrastructure management enabling our team to focus on delivering highquality data products efficiently.


Key Responsibilities:
  • Deployment & Environment Management
  • Design implement and maintain Cl/CD pipelines for deploying data pipelines and analytics models into UAT and Production environments.
  • Support the data development team by automating code deployments reducing manual errors and improving deployment efficiency.
  • Troubleshoot and resolve pipeline failures deployment issues and infrastructure bottlenecks in collaboration with data developers. Manage and optimize data lake infrastructure security and access controls to ensure smooth operations.
  • DevOps Best Practices & Standardization
  • Establish and enforce DevOps standards best practices and documentation to improve efficiency and reliability in data product development.
  • Develop automated testing strategies for data pipelines to validate transformations integrity and performance across environments.
  • Work with crossfunctional teams to implement observability and monitoring solutions for data workflows and deployments. Enhance version control practices and facilitate collaboration using Git Azure DevOps or similar tools.
  • Infrastructure & Performance Optimization
  • Maintain and optimize cloudbased data lake environments (Azure Databricks Synapse) for efficient data processing and analytics.
  • Automate infrastructure provisioning and configuration using Infrastructure as Code (laC) (Terraform ARM Templates etc.. Identify and resolve performance bottlenecks in data processing pipelines.
  • Assist in defining and implementing security access management and governance policies for data and analytics environments.
  • Collaboration & Stakeholder Engagement
  • Act as a liaison between the Data Analytics team and the Data Lake Engineering team to ensure smooth deployments. Work closely with Data Developers Data Engineers and Analytics teams to troubleshoot and optimize workflows.
  • Provide guidance and mentorship to team members on DevOps principles automation and best practices.


Qualifications
  • 3 years of experience in DevOps Cloud Engineering or Data Engineering with a strong focus on Cl/CD and automation.
  • Additional MLOps experience a nice to have.
  • Strong expertise in Cl/CD tools such as Azure DevOps GitHub Actions Jenkins or GitLab Cl/CD.
  • Experience working with Azurebased data platforms such as Azure Data Lake Azure Synapse Azure Databricks. Proficiency in scripting and automation
  • Understanding of monitoring logging and alerting solutions for data pipelines (Azure Monitor). Knowledge of security access management and compliance standards for data environments.
  • Strong problemsolving skills and the ability to debug complex deployment and pipeline issues. Ability to work collaboratively
  • Experience with Databricks workflow automation Delta Lake Azure

Employment Type

Contract

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.