Databricks Administrator
Share
Job Location:
Austin, TX - USA
Monthly Salary:
Not Disclosed
Posted on:
13 days ago
Vacancies:
1 Vacancy
Job Summary
About the Role
We are looking for a skilled and experienced Databricks Administrator to manage optimize and secure enterprise-scale Azure Databricks environments supporting mission-critical financial services workloads. The ideal candidate will be responsible for maintaining high availability performance and governance standards across Databricks workspaces clusters and integrations while driving automation and operational excellence.
Key Responsibilities
-
Environment Administration: Configure manage and maintain Databricks workspaces clusters jobs and notebooks for enterprise data and analytics workloads.
-
Security & Access Management: Implement role-based access controls (RBAC) user provisioning and workspace permissions aligned with corporate and regulatory security standards.
-
Performance Optimization: Monitor cluster utilization troubleshoot performance bottlenecks and ensure cost-efficient resource allocation.
-
Integrations: Manage seamless integration between Databricks and Azure services such as Azure Data Factory (ADF) Synapse Analytics Data Lake Key Vault and SQL Server.
-
Governance & Compliance: Ensure adherence to organizational data governance security and compliance policies within the financial services domain.
-
Automation & DevOps: Automate provisioning monitoring and maintenance tasks using Terraform CI/CD pipelines and REST APIs.
-
Collaboration: Work closely with Data Engineering Analytics and Cybersecurity teams to deliver robust and secure data platforms.
-
Documentation: Develop and maintain operational documentation standard operating procedures (SOPs) and architectural best practices.
Required Qualifications
-
Minimum 6 years of experience in Data Engineering Cloud Administration or Data Platform Management.
-
At least 2 years of hands-on experience in Databricks Administration.
-
Proven expertise in Azure Databricks and related Azure ecosystem services (ADF Synapse Data Lake Key Vault).
-
Strong command of SQL Python and/or PySpark for troubleshooting and validation.
-
In-depth understanding of IAM RBAC and workspace security models.
-
Experience with Terraform CI/CD pipelines and DevOps automation.
-
Knowledge of data governance compliance and security best practices in financial or regulated environments.
-
Excellent analytical troubleshooting and stakeholder communication skills.
Preferred Qualifications
-
Prior experience working in financial services or banking environments.
-
Exposure to Databricks Unity Catalog for governance and access control.
-
Relevant Microsoft Azure Certifications such as:
-
DP-203: Azure Data Engineer Associate
-
AZ-305: Azure Solutions Architect Expert
-
-
Familiarity with monitoring and logging tools such as Azure Monitor Log Analytics or Splunk.
Education
-
Bachelors or masters degree in computer science Data Engineering Information Systems or a related discipline.
Why Join Us
-
Opportunity to work on cutting-edge data platforms within a global financial ecosystem.
-
Exposure to automation governance and AI-driven data engineering initiatives.
-
Collaborative growth-oriented culture with continuous learning and upskilling opportunities.
Key Skills
- Hadoop
- Microsoft Windows Server
- Windows
- Apache
- Linux
- SAN
- Shell Scripting
- System Administration
- Administrative Experience
- Scripting
- Oracle
- Troubleshooting
