Databricks Account Setup & Administrator

Pune - India

Monthly Salary: Not Disclosed

Posted on: 17 hours ago

Vacancies: 1 Vacancy

Job Summary

Job Description: Databricks Account Setup & Administrator

Role Overview

We are seeking a skilled Databricks Administrator to lead the setup configuration and ongoing governance of our Databricks environment. The role involves provisioning workspaces managing user access implementing security and compliance standards and ensuring seamless integration with cloud services AWS.

This position will work closely with Data Engineering Security Cloud Ops and DevOps teams to establish a scalable and well-governed Databricks platform.

Key Responsibilities

1. Databricks Account & Workspace Setup

Create and configure Databricks accounts workspaces and metastore environments.
Configure Unity Catalog cluster policies and workspace-level governance.
Set up organizational structures such as groups folders catalogs schemas and access patterns.

2. Security & Access Management

Implement and manage Identity Federation (SCIM SSO/SAML SCIM provisioning).
Define role-based access controls (RBAC) across users service principals and groups.
Configure secure data access patterns using Unity Catalog IAM roles and cloud storage permissions.
Maintain compliance with data governance frameworks (e.g. GDPR SOC2).

3. Platform Administration

Manage cluster creation policies job clusters and high-concurrency clusters.
Monitor resource utilization jobs and cluster performance.
Set up and maintain audit logging monitoring dashboards and alerting.

4. Integration & Automation

Integrate Databricks with cloud-native services AWS IAM.
Develop automation scripts using Terraform Databricks CLI or REST APIs for account-level configurations.
Collaborate with DevOps to build CI/CD pipelines for notebooks ML models and data workflows.

5. Support & Governance

Establish platform standards best practices and operational runbooks.
Troubleshoot user cluster and job-related issues.
Conduct periodic audits of permissions cluster usage and data access.

Required Skills & Qualifications

minimum of 3 years of experience administering Databricks environments.
Strong knowledge of AWS cloud architecture.
Hands-on experience with Databricks security Unity Catalog and workspace governance.
Proficiency in Terraform Python Shell scripting or Databricks CLI.
Understanding of data engineering concepts (Delta Lake ETL Spark basics).
Experience with IAM SSO SCIM provisioning and RBAC models.

Preferred Qualifications

Databricks Administrator or Data Engineer certification.
Experience with DevOps tools (AWS DevOps GitHub Actions Gitlab).
Prior experience implementing enterprise-scale Databricks platforms.
Knowledge of monitoring tools (CloudWatch Datadog or Grafana).

Soft Skills

Strong communication and cross-functional collaboration.
Ability to document processes and create knowledge bases.
Problem-solving mindset and attention to detail.

Required Experience:

Job Description: Databricks Account Setup & AdministratorRole OverviewWe are seeking a skilled Databricks Administrator to lead the setup configuration and ongoing governance of our Databricks environment. The role involves provisioning workspaces managing user access implementing security and compl...