Azure Data Engineer (ADF, Databricks, Spark SQL)


Job Location:

Toronto - Canada

Monthly Salary: K 10 - 10
Experience Required: 5years
Posted on: 6 days ago
Vacancies: 1 Vacancy

Job Summary

Scope of Work:
Responsible for designing developing and maintaining Azure-based data pipelines using ADF and Databricks including ETL/ELT workflows Spark SQL processing and Azure SQL integration while ensuring data quality performance optimization and reliable data delivery.

Works on monitoring troubleshooting and resolving pipeline and cluster issues and collaborates with DevOps teams using Azure DevOps Git CI/CD and monitoring tools like Azure Monitor and Log Analytics to support stable and scalable data operations.

Required Skills
Strong knowledge of Azure services:
Azure Data Factory (ADF)
Azure Databricks
Azure SQL
Spark SQL

Understanding of:
ETL / ELT concepts
Data ingestion patterns
Data warehousing

Experience in:
Troubleshooting pipeline failures
Cluster issues
Performance bottlenecks

Familiarity with:
Azure DevOps
Git version control
CI/CD pipelines
Knowledge of monitoring tools:
Azure Monitor
Log Analytics
Databricks logs


Required Skills:

60-70


Required Education:

Backend Engineer Kotlin Microservices & AKSRole Overview:We are seeking a highly skilled backend developer with strong experience in modern programming languages and frameworks with primary expertise in Kotlin and exposure to Java microservices and cloud Skills:Proficiency in Kotlin with additional experience in Java (Spring Boot Spring Security) and JavaScript () 5 years of backend development experience including: oUnit testing frameworks (e.g.

Scope of Work: Responsible for designing developing and maintaining Azure-based data pipelines using ADF and Databricks including ETL/ELT workflows Spark SQL processing and Azure SQL integration while ensuring data quality performance optimization and reliable data delivery.Works on monitoring troub...