Data Engineering Lead

Shrive Technologies LLC

Job Location:

San Jose, CA - USA

Monthly Salary: Not Disclosed

Posted on: 13 days ago

Vacancies: 1 Vacancy

Job Summary

Lead end-to-end architecture and delivery.
Design scalable data models including SCD Type 2 surrogate keys and semantic data structures.
Architect and oversee ETL/ELT pipelines.
Drive implementation of metadata-driven modular and idempotent data pipelines.
Integrate Data Quality Framework with ingestion validation reconciliation and drift detection processes.
Define overall security architecture governance alignment policy enforcement strategy
Define migration strategy sequencing governance and validation approach
Enable governance and semantic capabilities through Enterprise Data Catalog and Enterprise Knowledge Graph.
Lead ontology lineage metadata and semantic modeling for AI-ready data consumption.
Oversee orchestration workflows and support Java/Python-based API integrations.
Drive parallel run side-by-side validation controlled cutover and legacy ETL decommissioning with zero business disruption.

Lead end-to-end architecture and delivery. Design scalable data models including SCD Type 2 surrogate keys and semantic data structures. Architect and oversee ETL/ELT pipelines. Drive implementation of metadata-driven modular and idempotent data pipelines. Integrate Data Quality Framework with inge...