Senior Azure Data Engineer Big Data, Hadoop, Lakehouse Architecture

Toronto - Canada

Monthly Salary: CAD 10 - 10

Experience Required: 5years

Posted on: 5 hours ago

Vacancies: 1 Vacancy

Job Summary

Essential Skills:

Data Engineering

Big Data and Hadoop Ecosystems

Microsoft Azure

Role Description:

Requires experience in: Hadoop Rahona Synapse Data Analytics Lakehouse architecture and Databricks.

Design build and maintain scalable data solutions on Microsoft Azure.

Develop and manage data pipelines using Azure Data Factory Databricks and related services.

Implement data storage solutions such as Azure Data Lake Azure SQL Database and Cosmos DB.

Ensure data quality security and compliance across all Azure data platforms.

Perform data integration transformation and migration tasks from various sources to Azure.

Monitor troubleshoot and optimize data workflows for performance and cost efficiency.

Collaborate with data architects analysts and business stakeholders to understand data requirements.

Automate data processing and reporting tasks using Azure tools and scripting languages.

Document data processes architectures and best practices.

Stay updated with the latest Azure data services and recommend improvements or new technologies as needed.

Experience Required: 6-8

Required Skills:

Essential Skills: Data Engineering Big Data and Hadoop Ecosystems Microsoft Azure Role Description: Requires experience in: Hadoop Rahona Synapse Data Analytics Lakehouse architecture and Databricks. Design build and maintain scalable data solutions on Microsoft Azure. Develop and manage data pipelines using Azure Data Factory Databricks and related services. Implement data storage solutions such as Azure Data Lake Azure SQL Database and Cosmos DB. Ensure data quality security and compliance across all Azure data platforms. Perform data integration transformation and migration tasks from various sources to Azure. Monitor troubleshoot and optimize data workflows for performance and cost efficiency. Collaborate with data architects analysts and business stakeholders to understand data requirements. Automate data processing and reporting tasks using Azure tools and scripting languages. Document data processes architectures and best practices. Stay updated with the latest Azure data services and recommend improvements or new technologies as needed. Experience Required: 6-8