Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
14 hours ago
Vacancies:
1 Vacancy
Job Summary
ING Hubs Poland is hiring!
The expected salary for this position:13000 - 28000 PLN
The financial ranges specified in the announcement are adjusted and may differ from the range specified in the remuneration regulations.
We are looking for you if You:
- have hands-on experience with Hadoop ecosystem and related tools with strong proficiency in Confluent Kafka for real-time data streaming
- have expertise in Java/Scala Python and Ansible for data engineering and platform development
- are experienced in building batch and streaming data pipelines using Apache Nifi and Spark
- are proficient in building microservices and event driven architecture
- have proven experience in designing and implementing highly available scalable and fault-tolerant data platforms
- can define and implement the infrastructure required for optimal loading of data from a wide variety of data sources using big data technologies.
- have worked in DevOps environment (CI/CD with Azure DevOps Test Automation Docker/Kubernetes)
- have good understanding of CI/CD concepts and Elastic based monitoring solutions
- demonstrate a knowledge of relational database concepts design and performance tuning.
- have knowledge on data security access management and risk compliance
- understand data governance practices including lineage retention quality and cataloging.
Youll get extra points for:
Exposure to public cloud platforms like GCP or Azure.
- Excellent communication skills and stakeholder management
- Ability to translate functional and non-functional requirements (e.g. Security High Availability Performance)
- Understanding of Agile Scrum methodology is considered a plus.
Your responsibilities:
- Deal with a wide spectrum of tech from ETL/ELT pipelines Data Warehouses Batch and Event processing and more.
- Contribute to strategy and lifecycle management of Data Lake implementation.
- Assess the efficiency of end-to-end processes by identifying and mitigating risks.
- Collaborate closely with an international team made of Chapter Leads Product Owners DevOps engineers and Infrastructure Specialists.
- Up to date with the latest industry standards and trends in Data Management
Information about the squad:
As a senior-level professional you will be responsible for designing implementing and maintaining an on-premises Cloudera Hadoop-based data platform. You will collaborate with other senior engineers to define propose and build core capabilities that elevate the platform to the next level. This is a hands-on role where you will work as part of a team of Big Data engineers to help our client develop and deliver data-driven products.
The role naming convention in the global ING job architecture will be Engineer IV.
The financial ranges specified in the announcement are adjusted and may differ from the range specified in the remuneration regulations.
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
ING Global Career Opportunities - Welcome to 'careers at ING'. We give you the space to develop yourself as an intern, trainee and professional. Check out our opportunities. Jump on!
