Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
EURECAT
Eurecat is the main Research & Technology Organisation in Catalonia and the second largest private research organization in southern Europe. It brings together the experience of more than 700 professionals and provides services to more than 2000 companies. Applied R&D technological services highly specialized training technological consultancy or valorisation and exploitation of industrial property are some of the services that Eurecat offers for both large and small and mediumsized enterprises in all sectors. The technology centre participates in more than 200 large national and international consortium projects of high strategic R&I and has 181 patents and 10 spinoffs. The added value provided by Eurecat accelerates innovation reduces spending on scientific and technological infrastructures reduces risks and provides specialized knowledge tailored to each company.
Job description
EURECAT Technology Center of Cataloniais seeking a highly motivated DATA ENGINEERfor its Data Science & Big Data Analytics Technological Unit.
FUNCTIONS AND RESPONSIBILITIES OF THE JOB:
Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system including queue management and realtime data processing.
Architect reusable software practices using state of the art orchestration systems such as Airflow or Dagster and containerization stack such as Docker or Kubernetes.
Deploy data sharing and cataloguing existing software tools to enable Data Spaces through standard building blocks from IDSA GaiaX and Fiware.
Contribute to Machine Learning projects by adopting technologies for data storing serving and versioning capabilities from blobStorage to traditional SQL solutions and NoSQL.
Assist the unit in multicloud deployments (Amazon Web Services Azure and Google Cloud Platform).
When applicable deploy and design Big Data Architectures including batch and streaming paradigms such as Flink Spark Structured Streaming Kafka and the Hadoop Ecosystem.
Project management and technical lead in EU funded and private projects. Writing proposals for Horizon Europe calls (excellence task description)
Requirements
REQUIREMENTS:
Studies
MsC in Computer Science. Other technical background will also be considered (Engineer Mathematics Physics etc. and PhD or Masters in this field will be highly valuated.
Experience
Database Systems (MySQL PostgreSQL MongoDB ElasticSearch Cassandra DB Redis)
Implementation of data catalogues (CKAN) data brokers and data connectors (DSSC Eclipse Fiware)
Airflow and Python based E(L)TL data pipelines.
Cloud providers technological stack (Serverless functions Virtual Computing Resources Storage).
Software patterns best practices as well as knowledge from Data Mining and Machine Learning.
Languages and programming tools (Python Java Scala SQL C/C Git Docker)
DevOps knowledge and experience in Linux is a big plus specially deploying and maintaining big data infrastructures using Ambari or Ansible.
Interest in Research Innovation & Patent Publication Conference Presentations Prototyping Full Lifecycle Product Development.
Languages
Excellent written and oral communication skills in English.
Catalan and/or Spanish would be desirable.
WHAT CAN EURECAT OFFER YOU
- Permanent contract.
- Hybrid work (home office/ work in the office).
- Flexible Schedule.
- Shorter workday on Friday and Summer Schedule.
- Flexible remuneration package (health insurance transport lunch studies training and kindergarten).
- Eurecat employees can join the Eurecat Academy courses.
- Language courses (English Catalan and Spanish).
Employment Type
Full Time
