Data Engineer (Python & Java)
Share
Job Location:
Monthly Salary:
Posted on:
8 hours ago
Vacancies:
1 Vacancy
Job Summary
About the Role
We are seeking a skilled and forward-thinking Data Engineer to join our team. This role is ideal for someone who thrives in dynamic environments brings hands-on experience in building robust ETL pipelines and is eager to contribute fresh perspectives to improve our engineering practices.
Initially your focus will be on designing and maintaining ETLs in Python. In the next phase these ETLs will be migrated to a Java backend so were looking for someone who either already has Java experience or demonstrates strong potential to skill up quickly.
Were not just looking for someone to adapt to our current ways of working. We want someone who brings real-world experience innovative thinking and the confidence to challenge and improve our current solutions and practices.
We are looking for you if you have:
- Proficiency in Python and familiarity with at least one other strongly typed language (preferably Java).
- Proven experience in ETL/data pipeline development beyond stored procedures or backend-only work.
- Hands-on experience with big data processing frameworks (e.g. Spark).
- Experience with automated testing and data quality frameworks.
- Familiarity with CI/CD pipelines preferably in Azure DevOps.
- Solid understanding of software design patterns and object-oriented programming.
- Comfort working with workflow orchestration tools like Airflow.
- Ability to articulate complex technical problems in a clear and simple manner.
- Strong collaboration skills across functional and interdisciplinary teams.
- Confidence to challenge existing practices and propose improvements.
- Relevant experience and fresh perspectives from recent roles.
Youll get extra points for:
- Experience migrating ETL processes to a Java-based backend.
- Knowledge of containerization and DTAPenvironments.
- Familiarity with code style standards and best engineering practices.
- Prior involvement in cross-functional teams delivering high-impact solutions.
Your responsibilities:
- Design build and maintain scalable ETL pipelines using Python.
- Collaborate on the migration of ETL processes to a Java-based backend.
- Ensure high data quality through automated testing strategies (unit integration system).
- Work with big data frameworks (e.g. Spark) for efficient data processing.
- Develop and maintain CI/CD workflows (preferably in Azure DevOps).
- Apply best engineering practices including containerization DTAP environments and code style standards.
- Use workflow orchestration tools like Airflow to manage data pipelines.
- Contribute to software design using object-oriented principles and design patterns.
- Collaborate cross-functionally with interdisciplinary teams to deliver high-impact solutions.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
ING Global Career Opportunities - Welcome to 'careers at ING'. We give you the space to develop yourself as an intern, trainee and professional. Check out our opportunities. Jump on!
