Data Lineage Automation Engineer
Share
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
Data Lineage Automation Engineer
* 12 Months Contract
* 5days Onsite - McLean Virginia
* October First week Start Date
* Immediate Interview
* 12 Months Contract
* 5days Onsite - McLean Virginia
* October First week Start Date
* Immediate Interview
Must Qualify in
Lead the implementation of automated data lineage across a complex data estate that includes: Cloud platforms (e.g. Snowflake AWS)
Legacy relational databases and ETLs o NoSQL data stores o BI/reporting platforms (e.g. Tableau Power BI)
Experience integrating lineage with data governance tools (e.g. Collibra Alation etc.)
Apply AI/ML techniques to infer lineage
Deep understanding of metadata capture ETL process tracing and query execution mapping
Strong programming background in Python Scala or Java
Familiarity with SQL and query logs from systems like Snowflake SQL Server Oracle MongoDB etc.
Lead the implementation of automated data lineage across a complex data estate that includes: Cloud platforms (e.g. Snowflake AWS)
Legacy relational databases and ETLs o NoSQL data stores o BI/reporting platforms (e.g. Tableau Power BI)
Experience integrating lineage with data governance tools (e.g. Collibra Alation etc.)
Apply AI/ML techniques to infer lineage
Deep understanding of metadata capture ETL process tracing and query execution mapping
Strong programming background in Python Scala or Java
Familiarity with SQL and query logs from systems like Snowflake SQL Server Oracle MongoDB etc.
Key Skills
- Continuous Integration
- APIs
- Automotive software
- Test Cases
- Electrical Engineering
- Junit
- Distributed Control Systems
- Testng
- Java
- Test Automation
- Programmable Logic Controllers
- Selenium
