Data Engineer
Share
Job Location:
San Francisco, CA - USA
Monthly Salary:
Not Disclosed
Posted on:
5 hours ago
Vacancies:
1 Vacancy
Job Summary
PG&E
Requisition Title: (IT PSP) Data Engineer V
Location: Oakland CA (San Francisco CA)
Duration: 6 months
Core Responsibilities
Design and maintain Palantir Foundry pipelines for OEIS compliance reporting
Build and maintain data checker / validation frameworks within Foundry Develop PySpark and Spark SQL transformations for large-scale datasets Implement compliance driven checks (completeness consistency reconciliation exception flags)
Ensure full data lineage auditability and reproducibility of compliance datasets
Partner with compliance SMEs and stakeholders to validate logic and reporting outputs
Support operational monitoring issue triage and data quality remediation
Required Technical
Skills
Strong Python
PySpark / Spark SQL
Advanced SQL
Hands-on experience with Palantir Foundry Experience building data validation QA or data quality frameworks Understanding of compliance audit or regulatory reporting requirements
Preferred / Nice to Have
Experience with OEIS or regulatory compliance reporting Foundry Workshop experience working with ontology-driven or curated datasets Utility infrastructure or asset-based domain experience
