Databricks Architect

Our client is seeking an experienced Databricks Platform Architect to design deploy configure and secure enterprise Databricks environments on AWS. This role is primarily focused on Databricks platform architecture Infrastructure-as-Code (Terraform) and enterprise platform engineering. Strong AWS networking expertise is beneficial but is not the primary focus of the role.

• Design configure deploy and secure Databricks platforms on AWS including both Classic and Serverless Workspaces
• Architect enterprise Databricks environments including workspace configuration identity integration cluster policies secret management and platform governance
• Author and maintain Terraform modules to provision and manage Databricks and AWS infrastructure using Infrastructure-as-Code (IaC)
• Implement secure platform architecture including workspace isolation IAM/SSO integration cluster access controls secret scopes and secure connectivity patterns
• Partner with cloud security and platform engineering teams to design validate and deploy scalable Databricks solutions
• Produce architecture documentation diagrams standards and operational runbooks
• Provide technical leadership architecture guidance and best practices for enterprise Databricks platform deployments

• 10 years of experience in Cloud Platform Engineering Data Platform Architecture Infrastructure Engineering or similar roles
• Deep hands-on experience with Databricks Platform Architecture including deployment configuration security and administration
• Experience designing and supporting both Classic and Serverless Databricks Workspaces
• Strong experience with Terraform and Infrastructure-as-Code (IaC)
• Experience with Databricks platform security including:
  • Workspace architecture
  • Identity & SSO integration
  • IAM integration
  • Cluster policies
  • Secret management / Secret Scopes
  • Workspace isolation and governance
• Working knowledge of AWS infrastructure including IAM VPC S3 PrivateLink networking routing and identity integration required to deploy and support Databricks environments
• Strong troubleshooting architecture and technical documentation skills
• Excellent communication skills with the ability to work directly with customers architects and cross-functional engineering teams

• Advanced AWS networking experience (VPC design PrivateLink Security Groups NACLs routing etc.)
• Experience with Databricks security accreditation governance and compliance initiatives
• Experience building reusable Terraform modules and enterprise platform automation
• Experience leading architecture workshops and customer enablement sessions