Databricks Developer
Databricks Developer
Posted on :
16-07-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Monthly Salary
Not Disclosed
Salary Not Disclosed
Vacancy
1 Vacancy
Posted on :
16-07-2025
Job Description
*** This position requires an Active IRS MBI Clearance no exceptions. ***
*** A copy of youMBI letter is required to submit your resume. ***
TriTech Enterprise Systems (TriTech) is seeking an experienced Databricks Developer to support a long term remote position. This candidate must havedeep expertise in Java and Apache Spark along with hands-on experience working with IRS data systems such as IRMF BMF or IMF. The ideal candidate will be responsible for designing developing and optimizing big data pipelines and analytics solutions on the Databricks platform. This role requires a deep understanding of distributed data processing performance tuning and scalable architecture.
Key Responsibilities:
Required Skills & Qualifications:
IRS Data Systems Experience
Programming Language Proficiency
Apache Spark
Big Data Ecosystem
Data Processing and ETL
DevOps / Deployment
Version Control & Build Tools
Testing
Soft Skills / Engineering Practices
Preferred Qualifications:
Nice to have skills:
TriTech is an Equal Opportunity Employer!
*** A copy of youMBI letter is required to submit your resume. ***
TriTech Enterprise Systems (TriTech) is seeking an experienced Databricks Developer to support a long term remote position. This candidate must havedeep expertise in Java and Apache Spark along with hands-on experience working with IRS data systems such as IRMF BMF or IMF. The ideal candidate will be responsible for designing developing and optimizing big data pipelines and analytics solutions on the Databricks platform. This role requires a deep understanding of distributed data processing performance tuning and scalable architecture.
Key Responsibilities:
- Design develop and maintain scalable data pipelines usingApache SparkonDatabricks
- Implement data processing logic inJava 8 leveraging functional programming and OOP best practices
- Integrate with IRS data systems includingIRMFBMF orIMF
- Optimize Spark jobs for performance reliability and cost-efficiency
- Collaborate with cross-functional teams to gather requirements and deliver data solutions
- Ensure compliance with data security privacy and governance standards
- Troubleshoot and debug production issues in distributed data environments
Required Skills & Qualifications:
- Active IRS MBI Clearance Required. IRS issued laptop strongly preferred. Please provide a copy of the candidates active MBI letter.
- Bachelors degree in Computer Science Information Systems or a related field.
- 8 years of professional experience demonstrating the required technical skills and responsibilities listed:
IRS Data Systems Experience
- Hands-on experience working withIRS IRMFBMF orIMFdatasets
- Understanding of IRS data structures compliance and security protocols
Programming Language Proficiency
- Strong expertise inJava 8 or higher
- Experience withfunctional programming(Streams API Lambdas)
- Familiarity withobject-oriented design patternsand best practices
Apache Spark
- Proficient inSpark CoreSpark SQL andDataFrame/Dataset APIs
- Understanding ofRDDsand when to use them
- Experience withSpark StreamingorStructured Streaming
- Skilled inperformance tuningandSpark job optimization
- Ability to useSpark UIfor troubleshooting stages and tasks
Big Data Ecosystem
- Familiarity withHDFSHive orHBase
- Experience integrating withKafkaS3 orAzure Data Lake
- Comfort withParquetAvro orORCfile formats
Data Processing and ETL
- Strong understanding ofbatch and real-timedata processing paradigms
- Experience buildingETL pipelineswith Spark
- Proficient indata cleansing transformation and enrichment
DevOps / Deployment
- Experience withYARNKubernetes orEMRfor Spark deployment
- Familiarity withCI/CD toolslike Jenkins or GitHub Actions
- Monitoring experience withGrafanaPrometheusDatadog orSpark UI logs
Version Control & Build Tools
- Proficient inGit
- Experience withMavenorGradle
Testing
- Unit testing withJUnitorTestNG
- Experience withMockitoor similar mocking frameworks
- Data validation and regression testing for Spark jobs
Soft Skills / Engineering Practices
- Experience working inAgile/Scrumenvironments
- Strong documentation skills (Markdown Confluence etc.)
- Ability to debug and troubleshoot production issues effectively
Preferred Qualifications:
- Experience withScalaorPythonin Spark environments
- Familiarity withDatabricksorGoogle DataProc
- Knowledge ofDelta LakeorApache Iceberg
- Experience withdata modelingand performance design for big data systems
Nice to have skills:
- Experience with Scala or Python in Spark environments
- Familiarity with Databricks or Google DataProc
- Knowledge of Delta Lake or Apache Iceberg
- Data modeling and performance design for big data systems.
TriTech is an Equal Opportunity Employer!
Required Experience:
Senior IC
Employment Type
Full-Time
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
