Data Engineer Databricks

Were looking for a Data Engineer to join our Databricks practice and help design build and optimize Lakehouse-based data platforms for clients across industries from public sector agencies to healthcare financial services and manufacturing. Youll work hands-on with the Databricks Data Intelligence Platform to turn messy disconnected client data into governed trustworthy analytics- and AI-ready assets. 

This is a client-facing consulting role. Youll partner with solution architects data scientists and project leads to gather requirements design pipelines and deliver production-grade solutions then explain what you built and why it matters in language business stakeholders actually understand. 

What Youll Do 

• Design build and optimize scalable ETL/ELT pipelines on Databricks using PySpark Spark SQL and Delta Lake 

• Implement Medallion (Bronze/Silver/Gold) architecture patterns applying data quality checks schema evolution and enforcement along the way 

• Build declarative pipelines with Delta Live Tables (DLT) and ingest streaming/incremental data using Auto Loader and Structured Streaming 

• Orchestrate and monitor production workloads using Databricks Workflows integrating with tools like Airflow or Azure Data Factory where needed 

• Configure and maintain Unity Catalog for data governance catalogs schemas access controls lineage and PII masking 

• Partner with data scientists to prepare feature-engineered ML-ready datasets and support model deployment workflows using MLflow 

• Tune cluster configuration job design and Photon/serverless compute for performance and cost efficiency 

• Build and maintain CI/CD pipelines for Databricks notebooks jobs and asset bundles (Git-based workflows Azure DevOps GitHub Actions or similar) 

• Query profile and assess the quality of large complex datasets from a wide variety of source systems 

• Collaborate with solution leads architects and project managers on solution design and technical architecture decisions 

• Participate directly in client-facing work: requirements gathering solution reviews and translating technical tradeoffs into plain-language business impact 

• Document solutions clearly architecture diagrams data flow documentation code comments and runbooks 

Qualifications :

Required 

• Bachelors degree in Computer Science Engineering Data Science or a related field (or equivalent practical experience) 

• 2 years of hands-on data engineering experience including production work on the Databricks platform 

• Strong hands-on experience with PySpark and Spark SQL 

• Practical experience with Delta Lake fundamentals ACID transactions OPTIMIZE/Z-ORDER partitioning and schema evolution 

• Solid SQL skills across relational platforms (SQL Server Postgres Oracle Snowflake etc.) 

• Experience with at least one major cloud platform (Azure AWS or GCP) and its data services 

• Working knowledge of data modeling (dimensional modeling 3NF) and ETL/ELT design principles 

• Strong communication skills and comfort working directly with clients and non-technical stakeholders 

• A collaborative detail-oriented mindset with a bias toward solution quality and follow-through 

Preferred / Nice-to-Have 

• Databricks Certified Data Engineer Associate or Professional 

• Experience with Unity Catalog Delta Live Tables and Auto Loader in production environments 

• Exposure to MLflow Feature Store or Databricks Vector Search for AI/ML-enabled use cases 

• Experience with Databricks Asset Bundles and CI/CD tooling (GitHub Actions Azure DevOps GitLab) 

• Familiarity with Terraform or other infrastructure-as-code tooling 

• Experience with dbt Kafka/Event Hubs or BI tools (Power BI Tableau) connected to Databricks 

• Docker/Kubernetes experience for containerized workloads 

• Prior consulting experience or comfort moving across multiple client engagements and industries 

Additional Information :

What Its Like to Work Here

At Resultant we are driven by purposepartnering with clients to take on their toughest challenges and creating outcomes that make a real difference. Success here means lasting impact not just delivered projects. We work as collaborative experts leaning into complexity with confidence and humility asking smart questions sharing ideas freely and combining our diverse expertise to turn challenges into clear transformative solutions. We make our outcomes visible by sharing results stories and lessons learned because growth happens through shared experience.

Accountability & Ownership

Resultant offers a flexible high-trust environment paired with a shared commitment to accountability:

• Take ownership of your work from start to finish and deliver on your commitments to clients and coworkers
• Communicate proactively especially when priorities shift
• Focus on outcomes follow-through and measurable impact
• Show up where it matters in person or virtually when it strengthens relationships or results
• Do the small things brilliantly: respond timely stay organized and follow through to build trust

We trust each other to own our work and deliver exceptional results. Flexibility means autonomy paired with accountability: the freedom to work in ways that fit your life balanced with the reliability our clients and coworkers count on.

Is Resultant the right spot for you

You may thrive here if you bring curiosity and a consulting mindset to every challenge take ownership of your growth and give and receive feedback with intention. If youre energized by bold ideas continuous learning and investing in the people around you this is your place. At Resultant we show up for each other own our outcomes and build leaders who create lasting impact for our clients our communities and each other.

Equal Opportunity Employer 

We embrace AI across everything we do and that includes how you prepare for this interview. Feel free to use AI tools to research the role practice your responses and put your best foot forward. What matters to us is getting to know the real you how you think how you communicate and what you genuinely bring to the table. Our interviews are designed to go deeper than any polished answer so come curious and come as yourself without the support of an AI tool during our conversation.

Remote Work :

Yes

Employment Type :

Full-time