INManagerSAP Data EngineerGCCAdvisoryPune

Job Description & Summary:

We are seeking a Senior Data Governance Engineer with strong expertise in the Azure ecosystem and Databricks platform to lead the design and implementation of data governance frameworks and solutions. The successful candidate will combine hands-on technical skills in PySpark Python and SQL with deep domain knowledge of data governance tools such as Azure Purview and Databricks Unity Catalog. Exposure to Databricks Genie for orchestration will be an added advantage.

You will play a critical role in ensuring data quality security compliance and accessibility across the organizations data assets by collaborating closely with data engineering security compliance and business teams.

Responsibilities:

• Develop implement and maintain enterprise-wide data governance policies procedures and standards within the Azure ecosystem.

• Leverage Azure Purview to manage data catalogs lineage classification and metadata across multiple data sources.

• Design and implement data access controls data stewardship models and compliance monitoring using Databricks Unity Catalog.

• Build and maintain data quality and validation frameworks using PySpark Python and SQL within Azure Databricks environments.

• Collaborate with engineering teams to embed governance standards into data pipelines and workflows.

• Monitor adherence to data governance policies and regulatory compliance (e.g. GDPR HIPAA) leveraging Azure and Databricks tools.

• Utilize Databricks Genie or similar orchestration tools for automated workflow scheduling and job monitoring with governance checks.

• Develop dashboards reports and alerts to track key data governance metrics and incidents.

• Conduct training and awareness sessions to enhance data governance literacy across the organization.

• Work across cross-functional teams including legal security risk and business units to align governance strategies.

• Stay current with emerging trends and best practices in data governance and cloud data platforms.

Mandatory skill sets:

• Bachelors or Masters degree in Computer Science Data Science Information Systems or a related discipline.

• 5 years of experience in data governance data management or data engineering roles withinAzure-based environments.

• Strong hands-on experience withAzurePurviewfor data cataloging metadata management and lineage tracking.

• Proficiency inDatabricks Unity Catalogto enforce fine-grained access control data classification and policy enforcement.

• Expertise in developing data workflows and governance automation usingPySparkPython andSQLonAzureDatabricks.

• Solid understanding of data governance principles data privacy regulations and compliance frameworks.

• Some exposure toDatabricks Genieor similar orchestration/scheduling tools.

• Experience collaborating with data stewards data owners security teams and compliance officers.

• Strong analytical documentation and communication skills.

Preferred skill sets:

• Bachelors or Masters degree in Computer Science Data Science Information Systems or a related discipline.

• 5 years of experience in data governance data management or data engineering roles withinAzure-based environments.

• Strong hands-on experience withAzurePurviewfor data cataloging metadata management and lineage tracking.

• Proficiency inDatabricks Unity Catalogto enforce fine-grained access control data classification and policy enforcement.

• Expertise in developing data workflows and governance automation usingPySparkPython andSQLonAzureDatabricks.

• Solid understanding of data governance principles data privacy regulations and compliance frameworks.

• Some exposure toDatabricks Genieor similar orchestration/scheduling tools.

• Experience collaborating with data stewards data owners security teams and compliance officers.

• Strong analytical documentation and communication skills.

Years of experience required:

8-14 years

Education qualification:

Bachelors or Masters degree in Computer Science Engineering or related field (60% above)