MS FDL-Data Engineeirng Architect-Manager

Job Title: Senior Data Architect-

Summary:

We are looking for highly skilled and experienced Senior Data Architect with extensive knowledge of Oracle ERP SAP and Databricks to join our team and play a crucial role in designing and implementing data quality solutions. You will be responsible for leading the development and implementation of strategies and processes to ensure the accuracy completeness and consistency of our data across the organization specifically focusing on data within Oracle ERP and SAP systems while leveraging the capabilities of Databricks for data processing and transformation including building and maintaining ETL pipelines using PySpark.

Responsibilities:

• Partner with business stakeholders and data engineers to understand data quality requirements and challenges specific to Oracle ERP SAP systems and within the context of big data processing using Databricks including ETL development needs.
• Design and implement data quality solutions including data cleansing transformation and validation processes for data originating from Oracle ERP SAP and processed within Databricks utilizing PySpark for building and maintaining ETL pipelines.
• Develop and maintain data quality standards policies and procedures specifically tailored to Oracle ERP SAP and Databricks data integration processing and ETL development.
• Select and implement data quality tools and technologies compatible with Oracle ERP SAP and Databricks including PySpark libraries and functionalities for ETL development within Databricks.
• Monitor and assess data quality metrics within Oracle ERP SAP and Databricks pipelines including those related to ETL performance and data quality within ETL processes.
• Develop and implement data governance frameworks to ensure data quality and compliance focusing on Oracle ERP SAP and Databricks data integration processing and ETL development.
• Own the data performance and cost for the ETL frameworks and jobs in production.
• Collaborate with data analysts and scientists to ensure data used in analysis from Oracle ERP SAP and processed through Databricks including data transformed through ETL pipelines is high-quality and reliable.
• Document data quality processes and solutions for future reference specifically regarding Oracle ERP SAP and Databricks data integration processing and ETL development.
• Stay up to date on the latest trends and innovations in data quality technologies and best practices particularly those relevant to Oracle ERP SAP Databricks and PySpark for ETL development.

Qualifications:

• Bachelors degree in computer science Information Technology or a related field (Masters degree preferred).
• 12 years of experience as a Data Architect or similar role.
• Extensive knowledge of data quality principles and methodologies as applied to Oracle ERP SAP systems and big data processing in Databricks.
• Experience in designing and implementing data quality solutions using various tools and technologies compatible with Oracle ERP SAP and Databricks (e.g. data profiling data cleansing tools data quality monitoring tools within Databricks).
• Strong understanding of Oracle ERP and SAP data models functionalities and integrations.
• Experience working with Oracle and SAP data extraction transformation and loading (ETL) processes.
• Experience and expertise in utilizing Databricks for data processing transformation and analytics workflows including building and maintaining ETL pipelines using PySpark.
• Familiarity with data quality best practices within the context of enterprise resource planning (ERP) systems and big data processing.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.