City/State

Work Shift

Overview:

Sentara is hiring a Data Engineer!

This is a fully remote position.

Overview

We are looking for a Data Engineer to support a modern data platform built on Databricks. This role will focus on building scalable data pipelines supporting a metadata-driven ingestion framework and ensuring data quality and governance are embedded into the platform.

Key Responsibilities

• Develop and maintain data pipelines usingPySpark and Databricks
• Work within ametadata-driven ingestion frameworkto onboard new datasets
• Implementdata quality checks and validation ruleswithin pipelines
• Support ingestion fromfile-based sources and ingestion tools (e.g. Fivetran)
• Handleschema changes incremental loads and file processing patterns
• Contribute todata governance practicesincluding tagging metadata and lineage
• Troubleshoot and resolve pipeline failures and performance issues
• Collaborate with architects and stakeholders ondata onboarding and requirements
• Follow and contribute tocoding standards reusable components and best practices

Education

• Experience in lieu of a Bachelors Degree
• 3 years of relevant experience with a degree
• 5 years of relevant experience without a degree

Certification/Licensure

• No specific certification or licensure requirements

Experience

• Required to 3 to 5 years of relevant experience
• Hands-on experience withPySpark and Databricks
• Strong SQL skills
• Experience buildingETL/ELT data pipelines
• Understanding ofDelta Lake concepts(merge schema evolution partitions)
• Familiarity withcloud platforms (Azure preferred)
• Basic experience withGit and version control
• Exposure todata catalog or governance tools (e.g. DataHub)
• Experience withFivetran or similar ingestion tools
• Understanding ofdata quality and validation concepts
• Experience working withmetadata-driven frameworks
• Strong problem-solving and debugging skills
• Ability to work in a structured framework-driven environment
• Focus on data quality not just pipeline execution
• Willingness to learn and adapt in a fast-evolving data ecosystem

Sentara Health is an equal opportunity employer and prides itself on the diversity and inclusiveness of its close to an almost 30000-member workforce. Diversity inclusion and belonging is a guiding principle of the organization to ensure its workforce reflects the communities it serves.

In support of our mission to improve health every day this is a tobacco-free environment.

For positions that are available as remote work Sentara Health employs associates in the following states:

Alabama Delaware Florida Georgia Idaho Indiana Kansas Louisiana Maine Maryland Minnesota Nebraska Nevada New Hampshire North Carolina North Dakota Ohio Oklahoma Pennsylvania South Carolina South Dakota Tennessee Texas Utah Virginia Washington West Virginia Wisconsin and Wyoming.