Senior SparkScala Developer
Share
Job Location:
Monthly Salary:
Posted on:
12 days ago
Vacancies:
1 Vacancy
Job Summary
We are focusing on developing global solutions across different geographical locations for various regulatory reporting needs. Our main aim is to create efficient user-friendly and scalable solutions that could be used by different teams in our company. We believe that strong and robust data products could mitigate risks and improve our capability inside our Group.
We run our projects in SCRUM/Agile methodology as we believe that continuous delivery that enables quick feedback loop is the key to our success and satisfaction of our clients. To achieve our goals we use Scala Python Java SQL/HQL Airflow ControlM Jenkins Github Hive Databricks Azure S3 Maven. To ensure the highest quality we use Unit Tests with Quality tests Automation and Pull Requests review.
WHAT YOU WILL BE DOING
We are looking for a Tech Lead in Data Engineering team with a strong background in Spark/Scala technology to lead the design and delivery of cutting-edge data-driven solutions. This role combines hands-on engineering with technical leadership you will both architect scalable data systems and guide a team to successful implementation.
As a Technical Leader your will:
- Lead end-to-end technical delivery of data engineering projects.
- Architect design and implement scalable data pipelines and platforms.
- Optimize workflows for data ingestion processing and storage (Spark Airflow Cloudera DataBricks Hive).
- Develop and maintain data lake solutions for structured and unstructured data.
- Collaborate with global teams (business data and technology) to align solutions with organizational objectives.
- Oversee code quality CI/CD pipelines versioning and release management.
- Write and review high-quality Scala/Spark code and contribute to automation.
- Mentor and support engineers fostering technical excellence and growth.
- Ensure delivery is aligned with regulatory and compliance requirements.
- Hands-on experience with testing Big Data solutions - unit tests integration tests E2E tests.
- Understanding AI tools and techniques and how they can contribute to increasing development efficiency.
Qualifications :
Required qualifications
- 7 years of experience in Big Data systems and data management.
- 3 years of hands-on experience with Scala/Spark.
- Hands-on with Big Data technologies like Spark Cloudera Data Platform Airflow Hive.
- Excellent understanding of dimensional data and data modeling techniques.
- Experience implementing and deploying solutions in cloud environments.
- Ability to work independently and take ownership of project deliverables.
- Fluent in English (at least C1 level).
- Bachelors degree in technical or mathematical studies.
- Strong communication skills at least 2 years leading development teams.
Preferred qualifications
- CI/CD and orchestration tools: GitHub Actions Airflow Control-M Bash scripting..
- Knowledge of Databricks Kafka Docker Kubernetes OpenShift
- Familiarity with cybersecurity practices code quality (Sonar) code security (Fortify) and SDLC.
- Experience with microservices architecture REST APIs frontend technologies (React NextJS) and backend technologies (NodeJS).
Additional Information :
What do we offer you
- Permanent full-time contract.
- Training and career development.
- Benefits and perks such as private medical insurance LuxMed lunch pass card Pluxee MultiSport Plus card.
- Possibility to be part of a multicultural team and work on international projects.
- Hybrid position based in Warsaw Poland.
- Possibility to manage work permits.
If you have read this far and you are looking forward to joining this challenge do not hesitate to apply... we would be delighted to meet you!
Remote Work :
No
Employment Type :
Full-time
Key Skills
- APIs
- REST
- Spring
- SOAP
- .NET
- React
- Node.js
- Angular
- J2EE
- JavaScript
- Web Services
- Java
About Company
Talan is an international consulting and technology expertise group that accelerates the transformation of its clients by leveraging innovation, technology, and data. For over 20 years, Talan has been advising and supporting businesses and public institutions in the implementation of ... View more
