(Senior) Data Engineer (mfx)
Share
Job Location:
Monthly Salary:
Posted on:
13 hours ago
Vacancies:
1 Vacancy
Job Summary
Intro
As a Data Engineer you will play a key role in building maintaining and evolving our AWS-based data platform. You will work closely with data product and engineering teams to deliver high-quality data models and enable analytics reporting and AI-driven use cases across the organization.
Tasks
- Collaborate with your team to manage and evolve our AWS-based core data layer including data modeling integration and aggregation for analytics and reporting
- Design and implement AWS-based data processing solutions ingesting data from internal backend services and third-party sources
- Prepare clean and transform structured and unstructured data developing high-quality data models for reporting advanced analytics and AI use cases
- Work closely with skilled and ambitious colleagues in data product sales and engineering teams to deliver data-driven product features
- Ensure high data quality and consistency across the Data Warehouse by applying best practices validations and monitoring
- Design and develop scalable and reliable data pipelines to support new use cases and continuously optimize existing solutions
Country
Germany
Recruiter
Zimmermann
Benefits
- The opportunity to actively shape the future of the online B2B business and build an European champion
- You can expect an established traditional company with the advantages of a dynamic start-up culture: flat hierarchies relaxed informal atmosphere and a great team spirit
- An agile and supportive environment where success is always a team effort
- Benefit from our fitness cooperation with Urban Sports Club and train flexibly in over 7500 studios across Germany
- Optimal work-life balance with 30 vacation days (plus Christmas Eve & New Years Eve) and flexible working hours
- We believe in the best of both worlds: flexibility and collaboration. Thus youll enjoy the benefits of working from home while also experiencing the team spirit in our offices (approx. 50%)
- We promote your professional and personal skills with individual training opportunities (e.g. Visable Online-Academy & Trainings) regular feedback discussions and team-building measures
- Take advantage of our Workation offer and work where others spend their holiday
Profile
- 4 years of hands-on experience in data engineering
- Proven experience designing and operating data pipelines on AWS using services such as S3 Lambda Batch and Glue
- Strong experience with Amazon Redshift and dbt
- Solid programming skills in Python ideally including experience with Apache Airflow and data processing frameworks such as PySpark
- Experience with data streaming technologies such as Kafka Kinesis Flink or Spark Streaming
- Strong background in relational databases including data modeling and writing efficient optimized SQL queries
- Experience with data quality frameworks and techniques including implementing data validation checks and monitoring mechanisms
- Fluent in English
Nice to Have
- Knowledge of Shell scripting and Linux
- Experience with NoSQL databases
We live and love diversity! Thats why we signed the Diversity Charter to promote equal opportunities and diversity in all its components. By signing the Diversity Charter we guarantee that all qualified applicants are considered for employment without regard to age ethnicity religion sexual orientation gender identity or physical abilities. A culture of respectful interaction is deeply rooted in our corporate values and therefore we want every employee to feel included accepted and valued. With over 50 different nationalities and more than 20 spoken languages among Visables workforce we can already be proud of being a culturally varied and truly international company.
You can find more information about Visable here.
Required Experience:
IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Europe’s unique combination of B2B marketplaces and online marketing – Visable ensures added reach.
