Senior Data Engineer - Streaming
Senior Data Engineer - Streaming
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Checkout is looking for an ambitious Senior Data Engineer to join our Data Platform Team. Our teams mission is to build a worldclass data platform that powers our products and analytics.
The Data Platform team is here to ensure internal stakeholders can easily collect store process and utilise data to build reports or products aiming to solve business problems. Our focus is on maximising the amount of time business stakeholders spend on solving business problems and minimising time spent on technical details around implementation deployment and monitoring of their solutions.
The core tech stack we use is based on AWS using:
Kafka as our message transport
Flink for (near) real time processing
Datahub as our catalog
Snowflake as our warehouse
Airflow for scheduling
DBT for data transformation
Montecarlo for monitoring
The platform here encompasses the endtoend first for real time / streaming use cases but also for our analytical / warehouse needs.
Were building for scale. As such much of what we design and implement today will be the technology/infrastructure which will serve hundreds of teams and petabytelevel volumes of data.
Key Responsibilities
Youll work as part of the team to build enablement components across the platform as well as monitor and support the capabilities we offer.
Develop and maintain documentation for data systems and processes.
Participate in code and design reviews and provide constructive feedback.
Wherever possible automate workflows and processes were aiming for the platform to be as selfsustaining as possible.
Stay uptodate with the latest data and streaming engineering technologies and trends.
Use that knowledge and subject matter expertise to mentor the more junior members of the team and work with other application teams to provide guidance and best practice.
Build light weight tooling and associated reference patterns to foster the adoption of the platform by enabling upstream teams and systems to easily publish and manipulate data and deploy applications using industry best practices
Implement all the necessary infrastructure to enable end users to build host monitor and deploy their own applications
Provide consultancy across the technology organisation to drive the adoption of the platform and unlock usecases
Promote data quality and governance as a first class citizen of the platform
Qualifications :
You will have:
Strong engineering background with a track record of implementing and owning components of a data platform
Experience working with stream technologies ideally Kafka but Kinesis Pulsar or similar would also be applicable
Experience designing and implementing stream processing applications (kStreams kSQL Flink Spark Streaming)
Experience with Data Warehousing tools like Snowflake / Bigquery / Databricks and building pipelines on these.
Experience working with modern cloudbased stacks such as AWS Azure or GCP
Excellent programming skills with at least one of Python Java Scala or C#
Youre a mentor raising the bar for your colleagues.
Youre a collaborator always ready to dive in and partner to solve tough problems.
Youre a listener and seek to understand the underlying problems before pitching solutions
You are able to drive through best practices by taking teams and organisations as a whole with you.
You are a thought leader so wed love to see articles podcasts meetups or conference talks if youve done them
Additional Information :
Apply without meeting all requirements statement
If you dont meet all the requirements but think you might still be right for the role please apply anyway. Were always keen to speak to people who connect with our mission and values.
Hybrid Working Model: All of our offices globally are onsite 3 times per week (Tuesday Wednesday and Thursday). Weve worked towards enabling teams to work collaboratively in the same space while also being able to partner with colleagues globally. During your days at the office we offer amazing snacks breakfast and lunch options in all of our locations.
We believe in equal opportunities
We work as one team. Wherever you come from. However you identify. And whichever payment method you use.
Our clients come from all over the world and so do we. Hiring hardworking people and giving them a community to thrive in is critical to our success.
When you join our team well empower you to unlock your potential so you can do your best work. Wed love to hear how you think you could make a difference here with us.
We want to set you up for success and make our process as accessible as possible. So let us know in your application or tell your recruiter directly if you need anything to make your experience or working environment more comfortable. Well be happy to support you.
Take a peek inside life at Checkout via
- Our Culture video careers page LinkedIn Life pages Instagram without meeting all requirements statement
If you dont meet all the requirements but think you might still be right for the role please apply anyway. Were always keen to speak to people who connect with our mission and values.
We believe in equal opportunities
We work as one team. Wherever you come from. However you identify. And whichever payment method you use.
Our clients come from all over the world and so do we. Hiring hardworking people and giving them a community to thrive in is critical to our success.
When you join our team well empower you to unlock your potential so you can do your best work. Wed love to hear how you think you could make a difference here with us.
We want to set you up for success and make our process as accessible as possible. So let us know in your application or tell your recruiter directly if you need anything to make your experience or working environment more comfortable. Well be happy to support you.
Take a peek inside life at Checkout via
Employment Type
Full-time
