Senior Data Engineer
Job Summary
We are looking for an experienced Data Engineer to join a dynamic data engineering team and contribute to the development of modern scalable data solutions within a Microsoft Azure and Databricks environment.
You will play a key role in designing developing and maintaining data pipelines and data platforms working with large and complex datasets to support business intelligence analytics and data-driven decision-making.
This is an excellent opportunity for a Data Engineer who enjoys working with modern cloud technologies and is interested in data architecture modelling and building robust data solutions.
Key Responsibilities
- Design develop and maintain scalable data pipelines and ETL/ELT processes using Azure Data Factory (ADF) and Azure Databricks.
- Develop efficient data processing and transformation solutions using Python and Databricks.
- Work with large and complex datasets ensuring data quality reliability and performance.
- Contribute to the design and implementation of modern data architectures within the Azure ecosystem.
- Work with Medallion Architecture principles to build robust and scalable data solutions.
- Support the development of Data Vault and Business Vault architectures using Databricks on Azure.
- Work with Microsoft Fabric and OneLake including the use of shortcuts to integrate and access data across different platforms.
- Contribute to data modelling activities within Azure Data Warehouse and related analytical environments.
- Collaborate with Data Architects Developers Analysts and other stakeholders to understand requirements and translate them into effective technical solutions.
- Identify opportunities to improve data processing architecture performance and automation.
- Ensure solutions follow best practices around scalability security maintainability and data governance.
Qualifications :
Requirements
- Proven professional experience as a Data Engineer.
- Strong hands-on experience with Azure Data Factory (ADF).
- Strong experience with Azure Databricks.
- Good programming skills in Python.
- Solid understanding of data engineering principles including ETL/ELT data transformation and data modelling.
- Experience working with cloud-based data platforms and large-scale data processing.
- Good understanding of SQL and relational data concepts.
Nice to Have
- Experience with Medallion Architecture.
- Knowledge of Data Vault / Business Vault methodologies.
- Experience implementing Data Vault solutions using Databricks on Azure.
- Experience with Microsoft Fabric and OneLake particularly OneLake shortcuts.
- Knowledge of data modelling in Azure Data Warehouse.
- Experience working within the financial services or wealth management sector.
- Familiarity with data governance data quality and modern cloud data architecture principles.
Additional Information :
What do we offer you
- Remote within Spain Time zone.
- Possibility to be part of a multicultural team and work on international projects.
- CET working hours
If you have read this far and you are looking forward to joining this challenge do not hesitate to apply... we would be delighted to meet you!
Talan Spains commitment to non-discrimination based on gender race ideology or any other reason in accordance with the companys Equality Plan and the current regulations on gender equality between women and men (Royal Decree-Law 6/2019).
Remote Work :
Yes
Employment Type :
Full-time
About Company
Talan is an international consulting and technology expertise group that accelerates the transformation of its clients by leveraging innovation, technology, and data. For over 20 years, Talan has been advising and supporting businesses and public institutions in the implementation of ... View more