Senior Databricks Engineer

Cincinnati, OH - USA

Monthly Salary: Not Disclosed

Posted on: 3 hours ago

Vacancies: 1 Vacancy

Job Summary

Hello There

My name is Gunjan Sharma and I serve as the Sr. Technical Recruiter at Kanak-IT INC. I am reaching out to share an excellent career opportunity for the role of Sr. Databricks Engineer with our esteemed client. If you are interested then please share your updated resume.

Role- Sr. Databricks Engineer
Location - Cincinnati OH Locals only (f2f interview)
Duration- 6 months
About the job

We are seeking a Senior Databricks Engineer with deep hands-on experience designing and implementing large-scale data solutions on Azure Databricks. The ideal candidate has real-world experience building and troubleshooting production-grade data pipelines optimizing Spark workloads managing Delta Lake architecture and implementing DevOps best practices using IaC and CI/CD automation.

Key Responsibilities

Design develop and maintain data pipelines and ETL solutions in Azure Databricks using PySpark and Delta Lake.
Implement data integration frameworks and API-based ingestion using tools like Apigee or Kong.
Analyze design and deliver enterprise data architecture solutions focusing on scalability performance and governance.
Implement automation tools and CI/CD pipelines using Jenkins Ansible or Terraform.
Troubleshoot production failures and performance bottlenecks - fix partitioning caching shuffle cluster sizing and Z-ordering issues.
Manage Unity Catalog enforce data security (row/column-level access) and maintain data lineage.
Administer Databricks clusters jobs and SQL warehouses optimizing costs through auto-stop job clusters and Photon usage.
Collaborate with cross-functional teams to drive data strategy and standards across domains.
Create and maintain detailed architectural diagrams interface specs and data flow documentation.
Mentor junior engineers on Databricks Spark optimization and Azure data best practices.

Required Skills & Experience

5 years of experience as a Data Engineer with strong hands-on experience in Azure Databricks and PySpark.
Solid understanding of Delta Lake Z-ordering partitioning OPTIMIZE and ACID transactions.

Thanks & Regards

Gunjan Sharma

Sr. Technical Recruiter

Email:

LinkedIn:

Kanak IT is an equal opportunity employer. We consider all applicants for employment without regard to citizenship immigration status race gender disability or any other protected category.

Hello There My name is Gunjan Sharma and I serve as the Sr. Technical Recruiter at Kanak-IT INC. I am reaching out to share an excellent career opportunity for the role of Sr. Databricks Engineer with our esteemed client. If you are interested then please share your updated resume. Role- Sr. Data...

Hello There

Role- Sr. Databricks Engineer
Location - Cincinnati OH Locals only (f2f interview)
Duration- 6 months
About the job

Key Responsibilities

Design develop and maintain data pipelines and ETL solutions in Azure Databricks using PySpark and Delta Lake.
Implement data integration frameworks and API-based ingestion using tools like Apigee or Kong.
Analyze design and deliver enterprise data architecture solutions focusing on scalability performance and governance.
Implement automation tools and CI/CD pipelines using Jenkins Ansible or Terraform.
Troubleshoot production failures and performance bottlenecks - fix partitioning caching shuffle cluster sizing and Z-ordering issues.
Manage Unity Catalog enforce data security (row/column-level access) and maintain data lineage.
Administer Databricks clusters jobs and SQL warehouses optimizing costs through auto-stop job clusters and Photon usage.
Collaborate with cross-functional teams to drive data strategy and standards across domains.
Create and maintain detailed architectural diagrams interface specs and data flow documentation.
Mentor junior engineers on Databricks Spark optimization and Azure data best practices.

Required Skills & Experience

5 years of experience as a Data Engineer with strong hands-on experience in Azure Databricks and PySpark.
Solid understanding of Delta Lake Z-ordering partitioning OPTIMIZE and ACID transactions.