AI Enabled Alation Data Governance Engineer

San Jose, CA - USA

Monthly Salary: Not Disclosed

Posted on: Yesterday

Vacancies: 1 Vacancy

Job Summary

Job Description:

Purpose Lead the design development and implementation of cuttingedge AIdriven data governance solutions to ensure the integrity traceability and trustworthiness of data across the Snowflake data platform This role is pivotal in leveraging Agentic AI frameworks to build test deploy automate scale and mature data governance agents working on an enterpriseready AIenabled data platform with smart governance inherently builtin while maintaining critical human oversight for strategic decisionmaking

Key Responsibilities:

Architect and implement AI First Engineering solutions for data cataloging data dictionary and data taxonomy leveraging Agentic AI to automate metadata discovery enrichment and curation ensuring comprehensive and accurate metadata management
Engineer and deploy Agentic AI workflows for endtoend data lineage on the Snowflake data platform utilizing tools like Alations Agentic Layer for Intelligent Snowflake This includes developing agents to autonomously parse and map sourcetotarget transformations across complex ETLs business logic and API integrations
Design and build intelligent agents and logic to automatically assess and score the quality and coverage of data lineage coverage by domain and subdomain providing actionable insights and driving accountability among data stewards and owners
Develop and integrate Agentic AI to advance data quality initiatives beyond foundational IT monitoring completeness timeliness consistency This involves building agents that learn adapt and enforce sophisticated accuracy and validity checks translating complex business rules into executable data quality logic within Snowflakes internal processes
Implement human in the loop mechanisms within AIdriven governance processes ensuring that critical decisions policy exceptions and complex issue resolutions are reviewed and approved by data stewards and owners fostering trust and collaboration
Leverage and implement Snowflakes native capabilities eg Data Metric Functions Streamlit stored procedures Streams Tasks Dynamic Tables in conjunction with Agentic AI to embed and enforce robust data quality and governance rules directly within the platform from data ingestion to downstream consumption
Develop and maintain the underlying data models and data pipelines that feed interactive dashboards and scorecards built with tools like Power BI and Tableau to visualize AIdriven insights on data maturity data usage data health lineage completeness and metadata coverage
Utilize Alation Compose SQL to develop customize and automate reports specifically for catalog metrics lineage coverage and data quality insights enhancing the capabilities of the Agentic Layer
Collaborate closely with data domain teams data engineers and data scientists to integrate AIdriven governance into their workflows identify data quality issues resolve lineage gaps and improve overall data trust scores
Contribute to the documentation and visualization of trends in data adoption metadata completeness and AI readiness across the organization driven by AIgenerated insights

Qualifications:

5 years of handson engineering experience in data quality data governance data lineage or a related data engineeringAI engineering role
Proven experience designing building and implementing AIML solutions particularly Agentic AI within data governance or data management contexts
Expertlevel proficiency in SQL Python and experience with scriptingautomation for data and AI workflows
Demonstrable handson experience in driving and implementing data lineage initiatives specifically with Alation and a strong understanding of Alations Agentic Layer for Intelligent Snowflake
Strong technical understanding and practical experience with data engineering concepts including ETLELT pipeline development API integrations data modeling and complex data transformation logic with an emphasis on how AI can enhance these
Deep expertise in Snowflakes native data quality features and a track record of implementing them for robust data integrity in an AIenabled environment
Handson experience with data governance and cataloging tools such as Alation including practical experience with Alation Compose SQL or similar intelligent governance platforms
Experience with data visualization tools like Power BI andor Tableau for building AIdriven data quality and lineage dashboards
Ability to translate complex business requirements into technical specifications and implement robust scalable and AIdriven data solutions
Strong problemsolving skills and attention to detail with a passion for leveraging AI to achieve data accuracy reliability and governance at scale
Understanding of ethical AI principles and how to build responsible AI systems for data governance

Job Description: Purpose Lead the design development and implementation of cuttingedge AIdriven data governance solutions to ensure the integrity traceability and trustworthiness of data across the Snowflake data platform This role is pivotal in leveraging Agentic AI frameworks to build test deploy ...

Job Description:

Key Responsibilities:

Architect and implement AI First Engineering solutions for data cataloging data dictionary and data taxonomy leveraging Agentic AI to automate metadata discovery enrichment and curation ensuring comprehensive and accurate metadata management
Engineer and deploy Agentic AI workflows for endtoend data lineage on the Snowflake data platform utilizing tools like Alations Agentic Layer for Intelligent Snowflake This includes developing agents to autonomously parse and map sourcetotarget transformations across complex ETLs business logic and API integrations
Design and build intelligent agents and logic to automatically assess and score the quality and coverage of data lineage coverage by domain and subdomain providing actionable insights and driving accountability among data stewards and owners
Develop and integrate Agentic AI to advance data quality initiatives beyond foundational IT monitoring completeness timeliness consistency This involves building agents that learn adapt and enforce sophisticated accuracy and validity checks translating complex business rules into executable data quality logic within Snowflakes internal processes
Implement human in the loop mechanisms within AIdriven governance processes ensuring that critical decisions policy exceptions and complex issue resolutions are reviewed and approved by data stewards and owners fostering trust and collaboration
Leverage and implement Snowflakes native capabilities eg Data Metric Functions Streamlit stored procedures Streams Tasks Dynamic Tables in conjunction with Agentic AI to embed and enforce robust data quality and governance rules directly within the platform from data ingestion to downstream consumption
Develop and maintain the underlying data models and data pipelines that feed interactive dashboards and scorecards built with tools like Power BI and Tableau to visualize AIdriven insights on data maturity data usage data health lineage completeness and metadata coverage
Utilize Alation Compose SQL to develop customize and automate reports specifically for catalog metrics lineage coverage and data quality insights enhancing the capabilities of the Agentic Layer
Collaborate closely with data domain teams data engineers and data scientists to integrate AIdriven governance into their workflows identify data quality issues resolve lineage gaps and improve overall data trust scores
Contribute to the documentation and visualization of trends in data adoption metadata completeness and AI readiness across the organization driven by AIgenerated insights

Qualifications:

5 years of handson engineering experience in data quality data governance data lineage or a related data engineeringAI engineering role
Proven experience designing building and implementing AIML solutions particularly Agentic AI within data governance or data management contexts
Expertlevel proficiency in SQL Python and experience with scriptingautomation for data and AI workflows
Demonstrable handson experience in driving and implementing data lineage initiatives specifically with Alation and a strong understanding of Alations Agentic Layer for Intelligent Snowflake
Strong technical understanding and practical experience with data engineering concepts including ETLELT pipeline development API integrations data modeling and complex data transformation logic with an emphasis on how AI can enhance these
Deep expertise in Snowflakes native data quality features and a track record of implementing them for robust data integrity in an AIenabled environment
Handson experience with data governance and cataloging tools such as Alation including practical experience with Alation Compose SQL or similar intelligent governance platforms
Experience with data visualization tools like Power BI andor Tableau for building AIdriven data quality and lineage dashboards
Ability to translate complex business requirements into technical specifications and implement robust scalable and AIdriven data solutions
Strong problemsolving skills and attention to detail with a passion for leveraging AI to achieve data accuracy reliability and governance at scale
Understanding of ethical AI principles and how to build responsible AI systems for data governance