Job Description:
- Design develop and implement scalable data pipelines using Azure Data Factory to ingest data from various sources into Azure Data Lake Storage and other Azure data services.
- Develop and optimize data transformation processes using Azure Databricks with PySpark/Spark and Python ensuring data quality and efficiency.
- Design and implement data warehousing solutions using Azure Synapse Analytics or Azure SQL Database.
- Write complex SQL queries and stored procedures for data manipulation and analysis.
- Collaborate with data architects data scientists and business stakeholders to understand data requirements and translate them into technical solutions.
- Implement data governance data quality and data security best practices within Azure data environments.
- Monitor troubleshoot and optimize data pipelines and data solutions for performance and reliability.
- Automate deployment and operational tasks using Azure DevOps or similar CI/CD tools.
- Stay updated with the latest Azure data technologies and recommend improvements to existing data infrastructure.
Job Description: Design develop and implement scalable data pipelines using Azure Data Factory to ingest data from various sources into Azure Data Lake Storage and other Azure data services. Develop and optimize data transformation processes using Azure Databricks with PySpark/Spark...
Job Description:
- Design develop and implement scalable data pipelines using Azure Data Factory to ingest data from various sources into Azure Data Lake Storage and other Azure data services.
- Develop and optimize data transformation processes using Azure Databricks with PySpark/Spark and Python ensuring data quality and efficiency.
- Design and implement data warehousing solutions using Azure Synapse Analytics or Azure SQL Database.
- Write complex SQL queries and stored procedures for data manipulation and analysis.
- Collaborate with data architects data scientists and business stakeholders to understand data requirements and translate them into technical solutions.
- Implement data governance data quality and data security best practices within Azure data environments.
- Monitor troubleshoot and optimize data pipelines and data solutions for performance and reliability.
- Automate deployment and operational tasks using Azure DevOps or similar CI/CD tools.
- Stay updated with the latest Azure data technologies and recommend improvements to existing data infrastructure.
View more
View less