Data Engineer - Program Tech Lead Databricks

Lisbon - Portugal

Monthly Salary: Not Disclosed

Posted on: 30+ days ago

Vacancies: 1 Vacancy

Job Summary

Hi! We are Grupo Data and we are searching for the best talent! Our goal is to simplify our clients lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal!

If you are passionate and have the desire to make the difference we want to get to know you! Join us to be part of this incredible adventure!

Who are we looking for

Program Tech Lead Databricks

Key Responsibilities:

- Lead the migration of data pipelines from Snowflake to Databricks.
- Design develop and optimize ETL workflows and data pipelines.
- Collaborate with cross-functional teams to understand database requirements and ensure successful migration.
- Implement best practices for data engineering and ensure high performance and reliability of data systems.
- Identify opportunities to optimize and reduce costs associated with data storage and processing.

Skills:
- Very good English - C1
- Minimum of 4 years of professional experience in data engineering business intelligence or a similar role.
- Proficiency in programming languages such as Python.
- Over 7 years of experience in ETL orchestration and workflow management tools like Airflow Flink Oozie and Azkaban using AWS or GCP.
- Expertise in database fundamentals Tableau or SQL and distributed computing.
- At least 4 years of experience with distributed data ecosystems (Spark Hive Druid Presto).
- Experience working with Snowflake Redshift PostgreSQL Tableau and/or other DBMS platforms.
- Lead and mentor a team of engineers fostering a collaborative and productive work environment.
- Apply Scrum methodologies to manage project workflows and deliverables efficiently.

Sector: Communication Services

Full remote

Hi! We are Grupo Data and we are searching for the best talent! Our goal is to simplify our clients lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference we want to get to know you! Join us to...