Senior Data Engineer (SparkScala)
Share
Job Location:
Monthly Salary:
Posted on:
13 hours ago
Vacancies:
1 Vacancy
Job Summary
We are looking for a highly skilled Senior Data Engineer with strong experience in designing building and maintaining scalable data solutions. The ideal candidate has a deep understanding of ETL processes big data technologies and modern analytics platforms and is comfortable working in fast-paced data-driven environments.
Key Responsibilities
- Design develop and optimize robust ETL pipelines to support data ingestion transformation and processing at scale.
Build and maintain high-performance data models to support analytics reporting and data science initiatives.
Work with large-scale distributed systems and data lake architectures (Apache Hive AWS S3 etc.).
Ensure data quality through strong validation practices and automated testing.
Collaborate closely with cross-functional teams to deliver secure clean and reliable data to downstream consumers.
Implement and maintain CI/CD pipelines and align code to static analysis tools such as Sonar or Fortify.
Work with BI tools and platforms (Databricks Power BI Starburst etc.) to enable effective data visualization and insights.
Required Experience & Skills
5 years of experience in implementing ETL pipelines.
3 years of experience working with Apache Spark.
3 years of hands-on experience with Scala programming.
2 years of experience with BI tools (Databricks Power BI Starburst or similar).
Strong expertise in SQL and relational database systems.
Experience designing and implementing data models for enterprise use cases.
Familiarity with data lakes and cloud-based storage environments (Apache Hive AWS S3).
Strong background in data validation unit testing and best practices for code quality.
Solid understanding of CI/CD principles and experience delivering high-quality code in production environments.
Additional Information :
What do we offer you
- Full-time contract.
- Smart Office Pack so that you can work comfortably from home.
- Training and career development.
- Benefits and perks such as private medical insurance life insurance.
- Possibility to be part of a multicultural team and work on international projects.
- This is a remote position based in Málaga Spain. Relocation is mandatory.
- Possibility to manage work-permits.
If you are passionate about development & tech we want to meet you!
Talan Spains commitment to non-discrimination based on gender race ideology or any other reason in accordance with the companys Equality Plan and the current regulations on gender equality between women and men (Royal Decree-Law 6/2019).
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Talan is an international consulting and technology expertise group that accelerates the transformation of its clients by leveraging innovation, technology, and data. For over 20 years, Talan has been advising and supporting businesses and public institutions in the implementation of ... View more
