Senior Data Engineer
Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We are Vitesse a global leader in crossborder payment solutions dedicated to empowering businesses with fast secure and reliable financial technology. Our engineering department is expanding and we are looking for a talented Data Platform Engineer to join our team. This role is integral to establishing a robust semantic layer and creating a framework to enable the development of dataheavy features across multiple teams.
As a Senior Data Engineer you will collaborate closely with our business and engineering teams to design implement and maintain data engineering solutions while ensuring security and data best practices. You will work on internal and/or Vitesse SaaS platform data initiatives. As a senior you will work mostly independently with light touch leadership from the squad lead. You will join a multidisciplinary squad of 5 data professionals within the organisations wider data team. We work remotely with regular contact time in our London based offices.
YOUR RESPONSIBILITIES
Design build and maintain scalable data pipelines for batch and real time data handling large volumes of structured and unstructured data.
Develop enhance and optimize ELT processes to ingest transform enrich and publish data.
Build quality trusted secure data products for consumption in reporting analytics and science.
Assure the privacy security and legal compliance of data in data engineering.
Optimise data pipelines and queries for better performance and costefficiency.
Integrate data pipelines with monitoring and observability to proactively detect and resolve issues before they impact business operations.
Design and build data models for lake house storage and analytics.
Implement and maintain CI/CD pipelines for data engineering.
Collaborate with business teams product owners analysts and data scientists to understand their needs and ensure availability of relevant data.
Capture and maintain data documentation enabling selfservice communities to understand assess and utilise reusable data assets.
Research and evaluate cuttingedge data technologies tools and practices to improve data engineering processes.
Mentor early in career data engineers support the squad lead in PR review.
Requirements
- Developing data processing pipelines in python and SQL for Databricks including many of the following technologies: Spark Delta Delta Live Tables PyTest Great Expectations (or similar) and Jobs.
- Developing data pipelines for batch and stream processing and analytics.
- Building data pipelines for enterprise data and one other business domain.
- Building and orchestrating data pipelines and analytical processing for streaming data with technologies such as Kafka AWS Kinesis or Azure Stream Analytics.
- Knowledge of data governance privacy regulations (e.g. GDPR) and security best practices.
- Delivering data engineering and designing for cloud native data platforms (AWS/ Azure/ Databricks).
- Building DevOps pipelines for data engineering solutions using Terraform GitHub DevOps.
- Working within highly agile multidisciplinary scrum teams in Scrum/Kanban.
- Mentoring data engineers carrying out PR review.
Desirable experience:
- Domain knowledge from insurance payments or equivalent domains.
- Building data pipelines to support AI/ML solutions created in Mosaic AI/ML Flow.
- Background in software engineering
- Experience automated testing for data
Benefits
- 25 days Holiday per year (increasing by 1 day per years service up to 30 days) Bank Holidays
- Remote working UK or EU Based.
- Contributory pension scheme
- Enhanced Parental leave
- Cycle to Work Scheme
- Private Medical Insurance with AXA
- Unlimited access to therapy sessions through our partner Oliva
- Discounted Gym membership through Gympass
- Financial Coaching with Octopus Wealth
- 2 days of volunteering leave per year
- Sabbatical after 5 years service
- Life Assurance MetLife (UK employees only)
- Ongoing Learning and Development to support you reach your career goals
Vitesse at our best our values
The Vitesse values are a true reflection of what it takes to thrive in our business so its important to us that any employee who joins our business is aligned with these 3 attributes
Confident Humility
We dont do ego and we know that unless we all win none of us win. We admit when were wrong ask for help and always think about the wider business before ourselves.
Driven to Succeed
We see the opportunity ahead of us and we wont stop until we fulfil the potential we know we have. We hold ourselves to high standards and deliver high quality outcomes for Vitesse and our customers.
Tenacious Responsibility
We take ownership for our actions and decisions and face into the challenges that come our way. We are committed to seeing things through to completion even in the face of adversity.
We are an Equal Opportunity Employer We are committed to creating an inclusive environment that enables everyone to perform at their best where we recognise the rights of all individuals to mutual respect and where there is an unbiased acceptance of others. Our policies and practices aim to promote an environment that is free from all forms of Unfair discrimination and values the diversity of all people. At the heart of our policy we seek to treat people fairly and with dignity and respect. Please confirm if selected for an interview what interview adjustments you would need You can contact Clara MorettiGreene on or in her absence contact our People Team
Required Experience:
Senior IC
Employment Type
Full-Time
