Databricks Platform Engineer
Databricks Platform Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Title: Databricks Platform Engineer (Azure)
Location: Phoenix AZ / Dallas TX
Type: C2C / W2
Work Mode: Hybrid (4 Days Onsite)
Duration: Long Term Contract
Certification : Preferred
Job Description:
We are seeking a highly skilled Databricks Platform Engineer with expertise in Azure Databricks to join our engineering team in either Phoenix AZ or Dallas TX. This role demands hands-on experience in managing securing and automating Databricks environments with a focus on performance scalability and enterprise-grade deployments.
Key Responsibilities:
- Design build and manage Azure Databricks infrastructure including workspaces clusters jobs and notebooks
- Administer Databricks environments (user management access control workspace configurations)
- Automate operational tasks using Databricks REST APIs and scripting
- Collaborate with platform and security teams to ensure best practices around scalability and compliance
- Optimize compute resources and performance tuning for big data processing
- Develop infrastructure automation using Terraform ARM Templates or other IaC tools
- Support data engineering and machine learning teams by enabling robust and secure environments
Required Skills & Experience:
- 8 years of experience in cloud-based data platform engineering
- Strong hands-on experience with Azure Databricks
- Deep understanding of Databricks architecture (clusters jobs notebooks workspaces)
- Experience with Databricks user and workspace administration
- Proficiency in Python and/or Scala
- Familiarity with Databricks REST APIs and automation techniques
- Experience with CI/CD pipelines and DevOps integration
- Solid knowledge of Azure services such as ADLS ADF Key Vault etc.
Good to Have:
- Experience in integrating Databricks with other Azure services
- Experience in Terraform for Databricks resource provisioning
- Experience with MLflow Unity Catalog or Delta Lake
- Strong communication skills and experience working with cross-functional teams
Certifications:
Databricks Certified Data Engineer Associate or Professional (Preferred)
Employment Type
Full-time
