DevOps Engineer with Databricks

Our Client is seeking a DevOps Engineer to join our growing Platform team. This role will play a key role in building and maintaining secure reliable and scalable infrastructure primarily on Azure. This position will focus on implementing cloud automation CI/CD pipelines Databricks platform enablement and supporting migrations of client workloads across clouds. This is a collaborative position designed for someone who enjoys working closely with developers data engineers and platform team members in addition to managing documentation processes and platform standards for consistent adoption. The ideal candidate is committed to continuous learning and enjoys staying current with evolving DevOps and data platform practices.

DevOps Engineer with Databricks
Location: Indianapolis IN (Hybrid)

Responsibilities

In this role you will support the following:

Cloud Infrastructure & Automation

• Implement and manage Azure cloud infrastructure using Infrastructure-as-Code (Bicep Terraform GitHub Actions)
  
• Develop and maintain CI/CD pipelines to automate builds tests and deployments
  
• Support containerization and orchestration efforts
  

Databricks Platform Engineering

• Build and maintain Databricks infrastructure (workspaces clusters Unity Catalog)
  
• Support migration of client Databricks workspaces from other cloud platforms into Azure
  
• Implement governance policies role-based access control and secure volume management for Databricks
  
• Partner with data teams to ensure scalable compliant and cost-efficient use of Databricks
  

Operations & Reliability

• Monitor infrastructure and Databricks workloads for performance cost and availability
  
• Contribute to disaster recovery backups and high-availability solutions
  
• Maintain observability and alerting frameworks across Azure and Databricks environments
  

Security & Compliance

• Enforce IAM RBAC and least-privilege practices across Azure and Databricks platforms
  
• Implement compliance checks and controls aligned with HITRUST HIPAA and SOC 2 to maintain audit readiness across the platform
  

Qualifications

• Hands-on experience with Microsoft Azure and Databricks
  
• Knowledge of containerization and orchestration
  
• Scripting skills in PowerShell Bash or Python
  
• Knowledge of agile methodologies and practices
  
• Strong problem-solving troubleshooting and collaboration skills
  

Requirements

Required:

• Bachelors degree in computer science engineering or a related field
  
• 3 years of experience as a DevOps Engineer or in a similar software engineering role managing:
  
• Databricks: workspace management Unity Catalog cluster governance and cross-cloud migrations
  
• Git and GitHub workflows
  
• Infrastructure as code (IaC) using Terraform Bicep or similar tools
  

Preferred:

• Certification in cloud platforms