Senior Data Engineer (Modern Data Platform & AI) (all genders) | Berlin, hybrid or remote
Share
Job Location:
Monthly Salary:
Posted on:
6 days ago
Vacancies:
1 Vacancy
Job Summary
Responsibilities
- Data Modeling & Transformation:
- Design necessary data models and transformations to curate raw data.
- Develop optimize and maintain existing data models pipelines and transformations to support analytics reporting and AI use cases such as but not limited to curating transforming annotating and modeling data.
- Data Platform Architecture:
- Architect and contribute in implementing a scalable modern data platform including data lakehouse or warehouse to support real-time/near-real-time data flows from Kafka to downstream consumers.
- Optimize ETL/ELT pipelines using tools like DBT Spark or Airflow bridging upstream (e.g. Debezium MSK) and downstream processes.
- Evaluate and integrate new technologies to support hybrid monolith-microservices architecture and ML and AI enablement.
- Ensure seamless migrations and minimal disruptions during platform evolution.
- Real-Time Data Integration:Build and optimize real-time data pipelines using Kafka Spark and Delta Live Tables.
- Data Governance & Quality:
- Support the team lead in establishing and enforcing data governance frameworks including data lineage quality standards catalogue metadata management SSOT for business glossaries/CBC terms and policies to ensure reliable reporting.
- Ensure the existence of or adaptation to full Data Life Cycle Management (DLCM) and end-to-end testing.
- AI/ML Enablement:Collaborate with the team to integrate AI/ML capabilities such as feature engineering and model serving to accelerate data products for market penetration and operational efficiency as well as operationalizing ML models and integrate AI into business processes.
- Knowledge Sharing: Mentor the team on best practices modern tools (e.g. Databricks Snowflake AI adaptation and integrations like Cursor/CodeRabbit) and cloud-native scalability. And last but not least foster a culture of innovation and continuous improvement.
- Stakeholder Collaboration:Collaborate with Product Analytics domain teams and business to deliver data solutions that drive value and are aligned with business needs.
Skills
- Masters degree in Computer Science Data Engineering or related field (or equivalent experience)
- 10 years of experience in data engineering with 5 years in senior roles focused on modern architectures.
- Excellent communication and collaboration skills the ability to drive change and influence stakeholders and a passion for mentoring coaching and sharing knowledge
- Proven expertise in designing developing & maintaining data lakehouses/DWH (e.g. Databricks Delta Lake Snowflake) and transformations (e.g. DBT SQL/Python/Spark).
- Strong experience with cloud platforms such as AWSservices (S3 Athena MSK/Kafka Terraform) andreal-time streaming(e.g. Kafka Spark Structured Streaming Flink).
- Hands-on knowledge of data governance tools (e.g. Unity Catalog Collibra) for lineage quality catalogs and SSOT.
- Familiarity inAI/ML pipelines and MLOps (e.g. MLflow feature stores) and complex system integration within modern data technologies.
- Proficiency in CI/CD for data and tools like Git Airflow or dbt Cloud.
- Experience with large-scale data modeling (DataVault dimensional schema-on-read) and optimizing for self-service analytics.
What we offer
Room to grow // Stay curious:In regular/annual feedback meetings you design your own personal development path together with your team addition we offer monthly Tech Talks an annual training budget free access to LinkedIn Learning as well as great workshops to seek new input and specific training for your personal development.
Mental & physical health // Stay healthy & active:We care about your well-being and support your health with a discounted membership at Urban Sports addition our cooperation partner Fürstenberg Institute is available to you and your family members with advice and support when it comes to mental health & coaching.
Taking responsibility // We #care: We care for our planet and the people who are living on it. To make our world a little bit better our ESG Team (Environmental Social & Governance) promotes our awareness for environmentally friendly addition we work with JobRad offer a discounted BVG ticket and actively support social projects in Berlin at our annual Social Day to give something back.
Teamspirit // Stay connected: What drives us is our sense of community. Thats why we celebrate our Company Day once a month in our office at Potsdamer Platz where everyone gets together in addition to a comprehensive update of our C-Board the main focus is on togetherness and the exchange of ideas over lunch and dinner together.
Transparency // We want to be transparent - also when it comes to salary: If you have any questions about a possible salary range for this position feel free to send us an email at We will get back to you as soon as possible.
About us
Aroundhome is a recommendation platform for houseowners.
With a comprehensive range of information and services relating to their own home and a team of 250 employees Aroundhome supports houseowners who live in their own property in carrying out major investment projects relating to their own home - from selling and investing to maintaining and repairing their property.
Our mission: Your property is more than just a house. It is a home and a life project. Every change brings insecurities. Because every decision can be a wrong one - and expensive. We make it possible to make better decisions with good recommendations and to realize all large projects around the own home more stress-free. With orientation individual advice and the mediation of suitable partners for all-round successful projects.
Aroundhome - Because its their home.
Together with you we want Aroundhome to develop into the one recommendation platform for houseowners and are looking forward to welcoming you to our team.
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Aroundhome is a recommendation platform for houseowners. With a comprehensive range of information and services relating to their own home and a team of 250 employees, Aroundhome supports houseowners who live in their own property in carrying out major investment projects relating to ... View more
