We are looking for a skilled Azure Data Engineer with hands-on experience in building scalable data solutions using Azure Data Factory and Azure Databricks. The candidate will be responsible for developing robust data pipelines optimizing data workflows and supporting analytics solutions in the Azure cloud & Responsibilities: -Design and develop end-to-end data pipelines using Azure Data Factory.-Build scalable data processing solutions using Azure Databricks (PySpark / Spark SQL).-Develop and optimize ETL/ELT workflows for structured and unstructured data.-Integrate data from multiple sources such as APIs databases and cloud platforms.-Implement and manage Azure Data Lake Storage (ADLS Gen2) and data warehouse solutions.-Monitor troubleshoot and optimize pipeline performance and processing efficiency.-Implement data quality checks validation rules and governance standards.-Collaborate with data analysts business stakeholders and DevOps teams for delivery.-Manage CI/CD pipelines and deployments using Azure DevOps.-Ensure data security compliance and cost/performance optimization in & Technical Skills: --5 6 years of experience in Data Engineering.-Strong hands-on expertise in:- Azure Data Factory (pipelines triggers linked services Integration Runtime)-Azure Databricks (PySpark Spark SQL Delta Lake)-Experience with Azure Data Lake Storage (ADLS Gen2).-Strong knowledge of SQL and relational databases.-Proficiency in Python for data processing and automation.-Solid understanding of data warehousing and dimensional modeling.-Experience in large-scale distributed data processing.-Working knowledge of CI/CD Git and Azure DevOps.-Strong analytical and problem-solving skills.
We are looking for a skilled Azure Data Engineer with hands-on experience in building scalable data solutions using Azure Data Factory and Azure Databricks. The candidate will be responsible for developing robust data pipelines optimizing data workflows and supporting analytics solutions in the Azu...
We are looking for a skilled Azure Data Engineer with hands-on experience in building scalable data solutions using Azure Data Factory and Azure Databricks. The candidate will be responsible for developing robust data pipelines optimizing data workflows and supporting analytics solutions in the Azure cloud & Responsibilities: -Design and develop end-to-end data pipelines using Azure Data Factory.-Build scalable data processing solutions using Azure Databricks (PySpark / Spark SQL).-Develop and optimize ETL/ELT workflows for structured and unstructured data.-Integrate data from multiple sources such as APIs databases and cloud platforms.-Implement and manage Azure Data Lake Storage (ADLS Gen2) and data warehouse solutions.-Monitor troubleshoot and optimize pipeline performance and processing efficiency.-Implement data quality checks validation rules and governance standards.-Collaborate with data analysts business stakeholders and DevOps teams for delivery.-Manage CI/CD pipelines and deployments using Azure DevOps.-Ensure data security compliance and cost/performance optimization in & Technical Skills: --5 6 years of experience in Data Engineering.-Strong hands-on expertise in:- Azure Data Factory (pipelines triggers linked services Integration Runtime)-Azure Databricks (PySpark Spark SQL Delta Lake)-Experience with Azure Data Lake Storage (ADLS Gen2).-Strong knowledge of SQL and relational databases.-Proficiency in Python for data processing and automation.-Solid understanding of data warehousing and dimensional modeling.-Experience in large-scale distributed data processing.-Working knowledge of CI/CD Git and Azure DevOps.-Strong analytical and problem-solving skills.
View more
View less