Job Description:
About the job youre considering
We are seeking an accomplishedSenior Data & AI Architectto lead the design and delivery of enterprise-scale data engineering and AI-driven solutions. This role requires deep expertise inAzure cloud architecture Databricks modern data ingestion frameworks Building Canonical Data Models and Medallion architecture along with strong leadership and communication skills. The ideal candidate will define enterprise data standards architect scalable platforms and collaborate across global teams to deliver high-quality data products.
Your role:
- Lead architecture and solution design for large-scaleData & AI platformson Azure.
- Design and implementdata acquisition frameworksusing CDC batch micro-batch and real-time streaming patterns with Spark.
- Architect and manage data storage solutions usingADLS Gen2 domain/sub-domain-based storage and data product containers.
- Build and governMedallion (Bronze/Silver/Gold) data layersfor enterprise analytics and AI use cases.
- Provide hands-on technical leadership usingPython PySpark and Databricks Notebooks.
- Define and enforcedata architecture standards reference architectures and design patterns.
- Design and overseedata governance security and access control models including Unity Catalog.
- IntegrateCI/CD pipelines GitHub workflows and automated deployment practices.
- LeverageAI-based code assistance tools(e.g. GitHub Copilot Databricks Genie) to improve developer productivity and code quality.
- Collaborate effectively withonshore and offshore teams mentoring engineers and architects.
- Communicate technical solutions clearly to business stakeholders architects and leadership.
Skills and experience
- 20 yearsof experience delivering Data & AI-driven projects.
- 10 yearsof experience in solution architecture primarily oncloud platforms.
- 7 yearsof hands-on experience in:
- Data acquisition framework design
- Spark-based ingestion (CDC batch streaming micro-batch)
- Handling structured and unstructured data
- Azure Data Lake Storage (ADLS Gen2) and cloud storage architectures
- Azure cloud platform and Databricks (including Unity Catalog)
- 5 yearsof hands-on experience withPython PySpark Databricks Notebooks GitHub and CI/CD pipelines.
- 2 yearsof experience leveraging AI-powered development tools.
- Strong understanding of enterprise data governance security and access management.
- Experience leading enterprise data modernization initiatives.
- Exposure to AI/ML enablement through data platforms.
- Prior experience in highly regulated or large-scale enterprise environments.
Job Description: About the job youre considering We are seeking an accomplishedSenior Data & AI Architectto lead the design and delivery of enterprise-scale data engineering and AI-driven solutions. This role requires deep expertise inAzure cloud architecture Databricks modern data ingestion framew...
Job Description:
About the job youre considering
We are seeking an accomplishedSenior Data & AI Architectto lead the design and delivery of enterprise-scale data engineering and AI-driven solutions. This role requires deep expertise inAzure cloud architecture Databricks modern data ingestion frameworks Building Canonical Data Models and Medallion architecture along with strong leadership and communication skills. The ideal candidate will define enterprise data standards architect scalable platforms and collaborate across global teams to deliver high-quality data products.
Your role:
- Lead architecture and solution design for large-scaleData & AI platformson Azure.
- Design and implementdata acquisition frameworksusing CDC batch micro-batch and real-time streaming patterns with Spark.
- Architect and manage data storage solutions usingADLS Gen2 domain/sub-domain-based storage and data product containers.
- Build and governMedallion (Bronze/Silver/Gold) data layersfor enterprise analytics and AI use cases.
- Provide hands-on technical leadership usingPython PySpark and Databricks Notebooks.
- Define and enforcedata architecture standards reference architectures and design patterns.
- Design and overseedata governance security and access control models including Unity Catalog.
- IntegrateCI/CD pipelines GitHub workflows and automated deployment practices.
- LeverageAI-based code assistance tools(e.g. GitHub Copilot Databricks Genie) to improve developer productivity and code quality.
- Collaborate effectively withonshore and offshore teams mentoring engineers and architects.
- Communicate technical solutions clearly to business stakeholders architects and leadership.
Skills and experience
- 20 yearsof experience delivering Data & AI-driven projects.
- 10 yearsof experience in solution architecture primarily oncloud platforms.
- 7 yearsof hands-on experience in:
- Data acquisition framework design
- Spark-based ingestion (CDC batch streaming micro-batch)
- Handling structured and unstructured data
- Azure Data Lake Storage (ADLS Gen2) and cloud storage architectures
- Azure cloud platform and Databricks (including Unity Catalog)
- 5 yearsof hands-on experience withPython PySpark Databricks Notebooks GitHub and CI/CD pipelines.
- 2 yearsof experience leveraging AI-powered development tools.
- Strong understanding of enterprise data governance security and access management.
- Experience leading enterprise data modernization initiatives.
- Exposure to AI/ML enablement through data platforms.
- Prior experience in highly regulated or large-scale enterprise environments.
View more
View less