SeniorLead Data Engineer (Databricks)
SeniorLead Data Engineer (Databricks)
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
About the Client
The health and fitness software and payment processing provider in the United States Puerto Rico Canada and Mexico. Founded in 1981 they currently work with 7000 health clubs. Customer offerings include payment processing and gym management solutions that allow managers to track memberships and schedules and automate payment processing functions.
Support the migration from Synapse to Databricks across multiple data streams.
Design and implement scalable solutions for:
Initial data load
Data mart and consumption layer
Reporting and Power BI integration
Collaborate with product and business teams to understand requirements and deliver data-driven solutions.
Optimize data pipelines for performance scalability and reliability.
Ensure best practices in data modeling ETL/ELT processes and storage optimization.
Write unit and integration tests to ensure data quality and consistency.
Diagnose and resolve issues in data pipelines performance bottlenecks and integration points.
Keep up with evolving technologies in the data engineering and cloud ecosystem recommending improvements to keep the stack up to date.
8 years of professional experience in data architecture and cloud-based data platforms.
Proven expertise in designing and leading large-scale implementations on Databricks.
Deep knowledge of data warehousing lakehouse architecture and consumption layer design.
Strong background in enterprise data modeling governance security and compliance.
Ability to define reference architectures and best practices for scalable ETL/ELT pipelines.
Proficiency in Python PySpark and SQL with the ability to guide engineering teams on performance optimization.
Experience integrating analytics and reporting solutions including Power BI into enterprise data platforms.
Demonstrated ability to review mentor and elevate the technical capabilities of engineering teams.
Experience working in agile teams using SCRUM methodologies.
Strategic mindset with a focus on scalability cost optimization and long-term platform evolution.
English: upper-intermediate
Location: EU Brazil
Ready to Join
We look forward to receiving your application and welcoming you to our team!
Employment Type
Full Time
