Data Engineering Manager
Virginia Beach, VA - USA
Job Summary
City/State
Virginia Beach VAWork Shift
First (Days)Overview:
Sentara Health is looking to hire a Remote Data Engineering Manager.
This is a remote position: Remote opportunities available in the following states: Virginia North Carolina Alabama Delaware Florida Georgia Idaho Indiana Kansas Louisiana Maine Maryland Minnesota Nebraska Nevada New Hampshire North Dakota Ohio Oklahoma Pennsylvania South Carolina South Dakota Tennessee Texas Utah Washington (state) West Virginia Wisconsin Wyoming
Overview
The Data Engineering Manager is responsible for
- Design and build a metadata-driven file ingestion frameworkon Databricks aligned with medallion architecture
- Lead onboarding of datasets using pattern-based ingestion (not one-off pipelines)
- Define and enforce data contractsincluding schema keys and data quality rules
- Implement scalable ingestion patternssupporting header / no-header / schema evolution scenarios
- Drive table-driven configuration modelto eliminate dependency on static YAML-based onboarding
- Integrate ingestionframework with governance tools (e.g. DataHub)for lineage discovery and ownership
- Ensure strong data quality auditability andobservabilitythrough centralized logging and control tables
- Collaborate with business and source system teams tounderstand data semantics and define keys
- Establish best practices for file ingestion schema management and incremental processing
- Lead vendor teams to ensure delivery aligns with target architecture and platform standards
Education
- BLD - Bachelors Level Degree in computer science required
- 15 years of experience in a complex computing environment may be considered in lieu of degree.
Certification/Licensure
- Databricks Certification (Preferred)
Experience
- 8 years in data engineering with strong experience in modern data platforms (Azure preferred)
- Hands-on expertise in Databricks and PySparkfor large-scale data processing
- Strong understanding of medallion architecture (Bronze / Silver / Gold)
- Experience designing metadata-driven or configuration-driven data pipelines
- Deep knowledge of data ingestion patterns (batch file-based incremental loads)
- Strong experience with data modeling concepts (keys SCD merge strategies)
- Experience implementing data quality frameworks and validation rules
- Proficiency in SQL and distributed data processing concepts
- Experience with Azure Data Lake Storage (ADLS) and file-based ingestion patterns
- Familiarity with CI/CD Git and deployment practices in data engineeringPreferred Experience
- Experience with data catalog and governance tools (DataHub Collibra Alation etc.)
- Exposure to customer 360 / MDM / CRM data integration (Salesforce Dynamics etc.)
- Experienceworking in healthcare or regulated environments (HIPAA PHI handling)
- Familiarity withUnity Catalog and data access governance models
- Experience integrating dataplatforms with workflow tools like ServiceNow for access management
- Exposure to event-driven ingestion patterns(file triggers streaming etc.)
- Experience working in large-scale migration or modernization programs enterprise data platforms
- Experience enabling self-service data access and governance
- Familiarity with API-driven data integration patterns
We provide market-competitive compensation packages inclusive of base pay incentives and benefits. The base pay rate for Full Time employment is:$116729.60-$216777.60. Additional compensation may be available for this role such as shift differentials standby/on-call overtime premiums extra shift incentives or bonus opportunities.
Legal Resources Plan
Colleagues have the opportunity to earn an annual discretionary bonus ifestablished system and employee eligibility criteria is met.
Sentara Health is an equal opportunity employer and prides itself on the diversity and inclusiveness of its close to an almost 30000-member workforce. Diversity inclusion and belonging is a guiding principle of the organization to ensure its workforce reflects the communities it serves.
In support of our mission to improve health every day this is a tobacco-free environment.
For positions that are available as remote work Sentara Health employs associates in the following states:
Alabama Delaware Florida Georgia Idaho Indiana Kansas Louisiana Maine Maryland Minnesota Nebraska Nevada New Hampshire North Carolina North Dakota Ohio Oklahoma Pennsylvania South Carolina South Dakota Tennessee Texas Utah Virginia Washington West Virginia Wisconsin and Wyoming.
Required Experience:
Manager
About Company
Sentara Health, is an integrated, not-for-profit health care delivery system in Virginia and North Carolina. Sentara improves health everyday.