Data Engineer with banking
Data Engineer with banking
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Data Engineerwith banking
Location: Warszawa/Wrocaw/Katowice
Hybrid model: 2 days office/3 days remote
Let us introduce you the job offer by EY GDS Poland a member of the global integrated service delivery centre network by EY.
The opportunity
As a Data Engineer You will be responsible for the creation schedule and optimization of the data processing pipelines using Apache Spark and Apache Airflow deployed on our data analytics platform.
The Data Engineer will support our software developers architects and DevOps team on data initiatives. Ability to work in an Agile/Scrum model.
Your key responsibilities
- Create build and deploy data pipelines that clean and process data for analysis
- Build reusable component pipelines that can be assembled for more complex pipelines
- Identify design and implement internal process improvements: automating manual processes optimizing data delivery redesigning infrastructure for greater scalability
- Work with structured and unstructured data sets
- Work with QA to develop an automation test strategy for data pipelines that aligns with the platforms architecture
Skills and attributes for success
- Minimum 7 years handson experience building complex data pipelines
- Strong experience in data processing and optimization using Apache Spark
- Good knowledge of data manipulation and transformation
- Experience with Apache Airflow Python SQL
- Deployment and provisioning automation tools (e.g. Docker Kubernetes CI/CD)
- Handson experience managing and further developing distributed systems and clusters for both batch as well as streaming data (S3/Spark and/or Kafka/Flink)
- Handson experience in training and evaluating ML models
- Experience with Golang
- Experience with monitoring and observability (ELK stack)
- Bash scripting and Linux systems
- Experience with buildpacks
- Security authentication and authorisation (LDAP / Kerberos / PAM)
- Experience working in cloud environment (e.g. GCP)
Ideally youll also have
- Experience with data warehousing solutions
- Knowledge of big data tools and technologies
- Strong problemsolving skills and attention to detail
- Excellent communication and collaboration skills
- Ability to work independently and as part of a team
What we offer
EY Global Delivery Services (GDS) is a dynamic and truly global delivery network. We work across ten locations Argentina China Hungary India the Philippines Poland Sri Lanka Mexico Spain and the United Kingdom and with teams from all EY service lines geographies and sectors playing a vital role in the delivery of the EY growth strategy. From accountants to coders to advisory consultants we offer a wide variety of fulfilling career opportunities that span all business disciplines. In GDS you will collaborate with EY teams on exciting projects and work with wellknown brands from across the globe. Well introduce you to an everexpanding ecosystem of people learning skills and insights that will stay with you throughout your career.
- Continuous learning:Youll develop the mindset and skills to navigate whatever comes next.
- Success as defined by you:Well provide the tools and flexibility so you can make a meaningful impact your way.
- Transformative leadership:Well give you the insights coaching and confidence to be the leader the world needs.
- Diverse and inclusive culture:Youll be embraced for who you are and empowered to use your voice to help others find theirs.
About EY
EY Building a better working world
EY exists to build a better working world helping to create longterm value for clients people and society and build trust in the capital markets.
Enabled by data and technology diverse EY teams in over 150 countries provide trust through assurance and help clients grow transform and operate.
Working across assurance consulting law strategy tax and transactions EY teams ask better questions to find new answers for the complex issues facing our world today.
If you can demonstrate that you meet the criteria above please contact us as soon as possible.
The exceptional EY experience. Its yours to build.
In compliance with the requirements of the Whistleblower Protection Act our company has established the Procedure for reporting breaches of law and undertaking appropriate followup actions. Any misconduct should be reported through the EY Ethics Hotline.
Employment Type
Full Time
