Databricks Engineer

Adelphi, MD - USA

Monthly Salary: Not Disclosed

Posted on: 19 hours ago

Vacancies: 1 Vacancy

Job Summary

We are hiring a Databricks Engineer to design build and operate a scalable Data & AI platform for our client with a strong foundation in the Medallion Architecture (Bronze/Silver/Gold layers). This role will orchestrate complex data workflows and scalable ELT pipelines integrating data from enterprise systems (PeopleSoft D2L Salesforce).

Key Responsibilities

Design implement and optimize end-to-end data pipelines on Databricks following Medallion Architecture principles.
Build robust and scalable ETL/ELT pipelines using Apache Spark and Delta Lake.
Operationalize Databricks Workflows for orchestration and dependency management.
Connect and ingest data from enterprise systems such as PeopleSoft D2L and Salesforce.
Implement Unity Catalog or equivalent tools for centralized metadata management data lineage and governance.
Enable data scientists by delivering high-quality feature-rich data sets supporting the MLOps lifecycle using MLflow.

Required Qualifications/Skills

Hands-on experience with Databricks Delta Lake and Apache Spark for large-scale data engineering.
Deep understanding of ELT pipeline development orchestration and monitoring.
Strong proficiency in SQL Python or Scala for data transformations and workflow logic.
Proven experience integrating enterprise platforms (PeopleSoft Salesforce D2L) into centralized data platforms.
Familiarity with cloud platforms like Azure or AWS including storage and security aspects.
Minimum Years of Experience: Extensive hands-on experience with Databricks required.

EQUAL OPPORTUNITY EMPLOYER STATEMENT: Mfinite Consulting is an Equal Opportunity Employer. We value diversity and are committed to creating an inclusive environment for all employees and applicants. We do not discriminate based on race color religion sex national origin age disability marital status sexual orientation gender identity or expression veteran status or any other legally protected status. All qualified candidates are encouraged to apply.