Databricks on Azure Administrator

Title: Databricks on Azure Administrator

Location: Atlanta GA (Hybrid)

Type: Contract

Job Responsibilities:

• Provision configure and operate Azure Databricks environments across development and production
• Design and maintain PCI DSS compliant data architectures for analytics and data processing workloads
• Implement and enforce enterprise security governance and access controls using Azure IAM and Databricks Unity Catalog
• Manage role-based access data masking lineage and audit logging to meet regulatory and risk requirements
• Standardize environment configuration and promotion using cluster policies CI/CD pipelines and Infrastructure as Code
• Integrate Databricks audit logs and telemetry with Azure Monitor and Log Analytics for compliance-ready observability
• Partner closely with security risk compliance and data engineering teams to support audits and regulatory reviews
• Support incident response root cause analysis and production issue resolution
• Maintain operational documentation runbooks and governance standards
• Work on-site in the Atlanta office 3 days per week to support collaboration with engineering and compliance stakeholders

Basic Qualifications:

• 8 years of experience administering enterprise data platforms in cloud environments
• 5 years of hands-on experience with Azure Databricks in production environments
• 5 years of strong experience with:
• Azure Databricks
• Delta Lake
• Unity Catalog
• 5 years of strong understanding of Azure identity and security services including:
• Azure AD / Entra ID
• Managed Identities
• Azure Key Vault
• 5 years of experience with Azure storage and networking:
• ADLS Gen2
• Private Endpoints

VNET Injection

Travel:

• Minimal travel expected

Degree:

• Bachelors degree in Computer Science Engineering or equivalent work experience

Preferred Skills:

• Experience implementing CI/CD pipelines using Azure DevOps or GitHub Actions
• Hands-on experience with Infrastructure as Code (Terraform and/or ARM templates)
• Proven experience operating in PCI DSS compliant environments
• Prior experience in the payments banking or financial services industry
• Experience supporting regulated or audit-heavy data platforms
• Familiarity with cost management and performance optimization in Databricks
• Experience working directly with security risk and compliance teams
• Strong documentation and operational runbook creation skills
• Exposure to incident management and production support models
• Ability and willingness to work on-site in Atlanta 3 days per week (mandatory)