Databricks Arhitect
Job Summary
Job Title: Architect
Location: Chennai
Key Responsibilities
l Architect and implement enterprise-grade Lakehouse solutions using Databricks
l Design and deliver scalable batch and real-time data pipelines using Apache Spark (PySpark/SQL)
l Build ETL/ELT pipelines incremental data loads and metadata-driven ingestion frameworks
l Implement and optimize Databricks components: Delta Lake Delta Live Tables Autoloader Structured Streaming and Workflows
l Design large-scale data warehousing solutions with 3NF and dimensional modeling
l Establish data governance security and data quality frameworks including Unity Catalog
l Lead ML lifecycle management using MLflow and drive AI use cases (RAG AI/BI)
l Manage cloud-native deployments on Microsoft Azure and integrate with enterprise systems (e.g. ServiceNow)
l Drive CI/CD DevOps practices and performance optimization of Spark workloads
l Provide technical leadership mentor teams and ensure successful delivery
l Collaborate with stakeholders to translate business requirements into scalable solutions