Data Engineer with DWH

Project Description

The goal of the project is to implement and standardize Data Contracts across the organization to improve data quality consistency and predictability within the data ecosystem (Data Warehouse / Big Data) in a GCP environment.

The project includes the design implementation and automation of data contracts between data producers and consumers covering:

• Definition of data schemas
• Data quality requirements
• Validation and monitoring mechanisms
• Technical documentation supporting analytical business and technical teams

The solution will support a Data Governance by Design approach increasing data transparency integration stability and reducing response time to changes from both data sources and consumers.

Main Responsibilities

You will be responsible for delivering tasks within Data Engineering and Data Analytics with a strong focus on Data Contracts including:

• Designing and defining Data Contracts (data schemas quality rules and SLAs) in collaboration with business analytics and technical teams.
• Implementing data contracts using standards such as OpenAPI / JSON Schema.
• Automating contract validation in CI/CD pipelines including data quality (QA) testing.
• Analyzing processing and modeling data in a Data Warehouse / Big Data environment on GCP.
• Developing and optimizing advanced SQL queries (aggregations performance optimization index management).
• Designing logical and physical data models and data layers.
• Ensuring data quality through testing monitoring and alerting mechanisms.
• Creating and maintaining technical documentation and participating in code reviews.
• Collaborating with Data Governance and Data Quality teams.

Qualifications :

Must-have Requirements

• 3 years of experience as a Data Engineer
• Practical knowledge of Data Contracts preferably in ODCS (Open Data Contract Standard) including defining contracts and quality requirements
• Experience with tools supporting contract automation (e.g. OpenAPI JSON Schema CI/CD tools data QA tools)
• Hands-on experience in data analysis processing and modeling
• Strong understanding of Data Warehouse and Big Data architectures
• Advanced SQL skills with proven experience (query optimization aggregations index management)
• Experience in data modeling and building data layers
• Experience ensuring data quality (testing monitoring alerting)
• Experience in technical documentation and code review processes
• Strong collaboration and communication skills with business technical and analytics teams
• Proactive mindset ownership and focus on data quality.

Nice-to-have Requirements

• Experience with data management tools such as:
  • dbt Dataform (data transformation and documentation)
  • Dataplex Data Catalog (data governance tools)
• Experience with data migrations from on-premise systems
• Knowledge of Data Governance and Data Quality concepts
• Familiarity with the GCP ecosystem

Additional Information :

Hybrid work: 1 day per week working from the office Warsaw

Remote Work :

No

Employment Type :

Full-time