Databricks Engineer with Java

Role Summary

We are looking for a Databricks Integration Engineer with strong Java development experience to design and build secure scalable connectors that enable enterprise applications to integrate with Databricks platforms The role involves developing applicationtoDatabricks connectivity for data ingestion processing and analytics use cases

Key Responsibilities

Design develop and maintain Javabased connectors for application integration with Databricks via JDBCODBC REST APIs Delta Lake

Enable data ingestion and extraction between enterprise applications and Databricks using batch and streaming approaches

Implement secure authentication and authorization mechanisms OAuth PAT Azure ADAWS IAM tokenbased access

Develop reusable Java libraries and services to abstract Databricks connectivity for upstream applications

Optimize connector performance for highvolume data transfers and lowlatency querying

Handle schema evolution error handling retries and logging in connector implementation

Work closely with data engineering platform and DevOps teams to deploy and monitor integrations

Support CICD pipelines and automated testing for connector releases

Troubleshoot integration issues related to connectivity performance and data consistency

Required Technical Skills

Strong handson experience in Java Java 8 Spring Boot and RESTful services

Experience integrating applications with Databricks using

Databricks JDBC ODBC

Databricks REST APIs

Delta Lake tables

Solid understanding of distributed data systems and big data concepts

Experience with SQL Spark concepts jobs clusters notebooks

Authentication security knowledge

OAuth 20 tokenbased auth

Cloud IAM AWS IAM Azure AD depending on environment

Experience with cloud platforms AWS Azure GCP especially

S3 ADLS GCS

Familiarity with CICD pipelines Git MavenGradle

Strong debugging and performance tuning skills