Staff Engineer â Data Platform and Lakehouse
Staff Engineer â Data Platform and Lakehouse
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
We are seeking and experienced Staff Engineer Data Platform and Lakehouse to lead the design and implementation of our cloud-native Data Platform that support AI advanced analytics and machine learning applications in our ecosystem of B2B SaaS applications in the FinTech vertical Youll work with a diverse team of talented engineers AI and ML scientists and product managers to build our next generation data and AI platforms support migration of products from legacy infrastructure and help product engineering teams leverage the Data platform and Lakehouse to launch new products and build new genAI applications. As a company that specializes in data-driven insights the reliability scalability and effectiveness of our data & AI platforms are integral to our product offerings. This role requires deep technical expertise strategic thinking and strong collaboration across engineering data science and product teams.
Responsibilities:
- Design and implement scalable secure and maintainable data platforms on Databricks and AWS cloud infrastructure.
- Provide architectural leadership across engineering domains ensuring consistency scalability and resilience
- Architect distributed data processing systems using Apache Spark and optimize for performance and scalability.
- Lead development of reusable data pipelines and workflows using Databricks Workflows.
- Translate business objectives into platform capabilities in collaboration with Product Managers and cross-functional teams.
- Support AI/ML initiatives through robust data engineering including feature engineering model deployment.
- Champion best practices in ETL/ELT data quality monitoring observability and Agile development.
- Drive adoption of data governance standards: access control metadata management lineage and compliance.
- Establish and maintain CI/CD pipelines and DevOps automation for data infrastructure.
- Evaluate and integrate emerging technologies to enhance development testing deployment and monitoring.
Salary Range: $180000 -$220000 (plus bonus)
Qualifications :
Desired Skills and Expertise:
- 15 years of experience in software development covering the full SDLC: ideation design development testing deployment and support.
- Strategic mindset capable of aligning technical decisions with business goals and driving architectural vision.
- Excellent collaboration and communication skills across functions including data scientists MLOps engineers and product managers.
- Advanced proficiency in Python and SQL with a strong foundation in software engineering principles.
- Extensive experience with distributed computing frameworks particularly Apache Spark including performance tuning and scalability.
- Required hands-on experience with Databricks including Unity Catalog Feature Store and Delta Live Tables.
- Proficiency in data pipeline orchestration tools using Databricks Workflows Airflow or AWS Glue; Databricks required.
- Strong command of data engineering best practices and tools including ETL/ELT design data quality validation monitoring and observability. Experience with Monte Carlo preferred.
- Proven ability to build scalable cloud-native data architectures on Databricks AWS Azure or GCP; Databricks required.
- Experience enabling AI/ML workloads including feature engineering model deployment and real-time processing.
- Strong understanding of data governance and security including access control data lineage compliance and metadata management.
Additional Information :
Why work at Curinos
- Competitive benefits including a range of Financial Health and Lifestyle benefits to choose from
- Flexible working options including home working flexible hours and part time options depending on the role requirements please ask!
- Competitive annual leave floating holidays volunteering days and a day off for your birthday!
- Learning and development tools to assist with your career development
- Work with industry leading Subject Matter Experts and specialist products
- Regular social events and networking opportunities
- Collaborative supportive culture including an active DE&I program
- Employee Assistance Program which provides expert third-party advice on wellbeing relationships legal and financial matters as well as access to counselling services
Applying:
We know that sometimes the perfect candidate doesnt exist and that people can be put off applying for a job if they dont meet all the requirements. If youre excited about working for us and have relevant skills or experience please go ahead and apply. You could be just what we need!
If you need any adjustments to support your application such as information in alternative formats special requirements to access our buildings or adjusted interview formats pleasecontact us at and well do everything we can to help.
Inclusivity at Curinos:
We believe strongly in the value of diversity and creating supportive inclusive environments where our colleagues can succeed. As such Curinosis proud to be an Equal Opportunity do not discriminate on the basis of race color ancestry national origin religion or religious creed mental or physical disability medical condition genetic information sex (including pregnancy childbirth and related medical conditions) sexual orientation gender identity gender expression age marital status military or veteran status citizenship or other protected characteristics.
Remote Work :
Yes
Employment Type :
Full-time
Employment Type
Remote
Company Industry
Key Skills
- Computer Science
- Docker
- Kubernetes
- Python
- VMware
- C/C++
- Go
- System Architecture
- gRPC
- OS Kernels
- Perl
- Distributed Systems
