An enterprise technology division is seeking a highly skilled consultant to lead the enhancement sustainment and strategic development of a large-scale Azure-based data management platform. The role focuses on defining technology roadmaps advancing data modernization initiatives and enabling key data analytics and AI capabilities across the organization.
The consultant will guide how data is ingested governed transformed and delivered at an enterprise level ensuring scalability consistency and trusted data use for integrations analytics reporting operational decision-making and AI workloads. This position requires strong strategic insight paired with hands-on experience in cloud-native data architecture Azure Databricks Delta Lake DataOps and platform optimization.
Tasks
Strategic Leadership & Collaboration
Develop the strategic vision and multi-year roadmap for the enterprise data platform.
Collaborate closely with service owners and senior stakeholders to prioritize capabilities and influence long-term modernization efforts.
Translate business and organizational goals into actionable platform strategies shaping enterprise architecture governance and AI readiness.
Promote enterprise adoption through standardized data products reusable frameworks and self-service capabilities.
**
Technical Architecture & Engineering Execution**
Architect and implement cloud-native data solutions using Azure and Databricks including Delta Lake Unity Catalog and Medallion architectures.
Lead the design and development of scalable data ingestion transformation and orchestration pipelines using Databricks Azure Data Factory Event Hub Functions and APIs.
Define and enforce governance security and compliance frameworks including RBAC/ABAC encryption practices and secure networking models.
Implement DataOps practices and CI/CD automation for Databricks workflows and Azure data pipelines.
Optimize performance reliability and cost efficiency across Databricks clusters ETL workloads and Azure resources.
**
AI Enablement & Automation**
Identify opportunities for AI-driven automation such as automated pipeline generation intelligent observability anomaly detection and generative code scaffolding.
Lead proofs of concept and assessments of new Azure Databricks and AI capabilities and recommend adoption paths.
**
Team Enablement & Mentorship**
Mentor and guide data engineering and platform teams to ensure strong technical standards and continuous improvement.
Provide architectural expertise to teams building data products analytics solutions and AI workloads using the enterprise data platform.
Requirements
- Bachelors degree in Computer Science Information Systems Engineering or a related field (Masters preferred).
- 812 years of experience in data architecture cloud data platforms or enterprise data engineering.
- Proven experience leading large-scale data platform modernization or cloud transformation initiatives.
Strong background in Azure and Databricks ecosystem including:
- Delta Lake Medallion architecture
- Unity Catalog schema management
- Azure Data Factory Event Hub Functions Key Vault
- Cluster configuration performance tuning and optimization
Hands-on experience designing cloud-native data solutions and scalable pipelines.
An enterprise technology division is seeking a highly skilled consultant to lead the enhancement sustainment and strategic development of a large-scale Azure-based data management platform. The role focuses on defining technology roadmaps advancing data modernization initiatives and enabling key dat...
An enterprise technology division is seeking a highly skilled consultant to lead the enhancement sustainment and strategic development of a large-scale Azure-based data management platform. The role focuses on defining technology roadmaps advancing data modernization initiatives and enabling key data analytics and AI capabilities across the organization.
The consultant will guide how data is ingested governed transformed and delivered at an enterprise level ensuring scalability consistency and trusted data use for integrations analytics reporting operational decision-making and AI workloads. This position requires strong strategic insight paired with hands-on experience in cloud-native data architecture Azure Databricks Delta Lake DataOps and platform optimization.
Tasks
Strategic Leadership & Collaboration
Develop the strategic vision and multi-year roadmap for the enterprise data platform.
Collaborate closely with service owners and senior stakeholders to prioritize capabilities and influence long-term modernization efforts.
Translate business and organizational goals into actionable platform strategies shaping enterprise architecture governance and AI readiness.
Promote enterprise adoption through standardized data products reusable frameworks and self-service capabilities.
**
Technical Architecture & Engineering Execution**
Architect and implement cloud-native data solutions using Azure and Databricks including Delta Lake Unity Catalog and Medallion architectures.
Lead the design and development of scalable data ingestion transformation and orchestration pipelines using Databricks Azure Data Factory Event Hub Functions and APIs.
Define and enforce governance security and compliance frameworks including RBAC/ABAC encryption practices and secure networking models.
Implement DataOps practices and CI/CD automation for Databricks workflows and Azure data pipelines.
Optimize performance reliability and cost efficiency across Databricks clusters ETL workloads and Azure resources.
**
AI Enablement & Automation**
Identify opportunities for AI-driven automation such as automated pipeline generation intelligent observability anomaly detection and generative code scaffolding.
Lead proofs of concept and assessments of new Azure Databricks and AI capabilities and recommend adoption paths.
**
Team Enablement & Mentorship**
Mentor and guide data engineering and platform teams to ensure strong technical standards and continuous improvement.
Provide architectural expertise to teams building data products analytics solutions and AI workloads using the enterprise data platform.
Requirements
- Bachelors degree in Computer Science Information Systems Engineering or a related field (Masters preferred).
- 812 years of experience in data architecture cloud data platforms or enterprise data engineering.
- Proven experience leading large-scale data platform modernization or cloud transformation initiatives.
Strong background in Azure and Databricks ecosystem including:
- Delta Lake Medallion architecture
- Unity Catalog schema management
- Azure Data Factory Event Hub Functions Key Vault
- Cluster configuration performance tuning and optimization
Hands-on experience designing cloud-native data solutions and scalable pipelines.
View more
View less