Data Engineer
Job Location:
Monthly Salary:
Posted on:
Vacancies:
Job Summary
WHO WE ARE
Privately owned and independently minded at Creditsafe we are guided by values of customer-focus trust respect and a willingness to try new things. For over 20 years these values have shaped a culture of growth innovation and support where our team members build successful long-term careers.
With a diverse team spread across 25 offices in 14 countries we value collaboration learning and problem-solving together. We have been featured twice in The Sunday Times 100 Best Companies to Work For and continue to prioritize well-being career growth and inclusion.
Our continued success has made us the most used business data provider in the world and one of the industrys strongest growing business intelligence providers. Today Creditsafe has 23 offices across 3 continents serving110000 customersfrom SMEs to enterprise businesses.
THE TEAM
Join a team of highly technically skilledengineerswhoaredesigningCreditsafesnewConsumer Bureauwithdata qualitylineage andauditabilityas primary goals whilstmaintaininghigh throughputand platformwill be builtusingAWSinfrastructure such as S3and S3-tables(Iceberg) AuroraServerless DynamoDB LambdaFargate ECS AirflowSparkand manage overone hundred millionobjectswith a high volume of daily updateshandlingaddition deletionandcorrectionof our dataand indexesinanauditable platform will employ a sophisticated matching algorithm to enable us to assign incoming updates to existing data processing application is entirely based onPythonand designed toefficientlytransformincomingrawdata volume teamis alsobuildinghighlyavailableand low latency APIstoenableour clientswithfasterdata delivery.
WHAT YOULL OWN
Design and build metadata driveneventbaseddistributeddata processing platformusing technologies such asPythonSparkAirflow IcebergDynamoDBAWS Glue S3.
Playan activerole in the design development and deployment ofourbusiness-criticalsystem.
Building and scalingCreditsafesdata pipelinescombining batch and streaming approachesandtargetingsub-500ms latency serving.
Understandingdomaindatatomake recommendationsto improvetheexisting product.
Employing various AI tools such as Perplexity Cursor CoPilot etc to aid in all aspects of your work.
WHAT YOU WIILL NEED TO BRING
You understand and can implement data engineering best practices.
Youdemonstratetheability towrite clean&efficient code andcombine itwiththecloud environment forbestperformance.
You haveaminimum6years ofdevelopment experience within a commercial environment creating production gradedatapipelines in python.
You are looking to growyour skillsthrough daily technical challenges andenjoyproblem solvingwhiteboardingin collaboration with team.
You have excellent communication skillsandability to explain your viewsclearlytotheteam andare open tounderstandingtheviews of others.
You have a proventrack recordto draw from a deep and broad technicalexpertiseto mentor engineers complete hands-on technical work and provide leadership on complex technology issues.
You share your ideascollaborativelyviawikisdiscussions boards etcandshareany decisionsmadefor the benefit of others.
You take ownership of end-to-end deliverables from planning all the way to production.
WHY CREDITSAFE
IC ladder with teeth.Staff and Principal are a destination not a waypoint - with scope comp and influence that genuinely match the title.
Written design culture.Anything non-trivial gets an RFC. Decisions are recorded. We disagreeindocuments not in meetings.
Real operability.We run what we build. No hand-offs to a separate ops team.
Pragmatic agile.Teams own their own process. Weoptimisefor shipping not ceremony.
Customer-first. Our focus is on making work that adds value to our clients first. Stability freshness durability trust non-negotiable.
Leadershipyoullwant to work with.Engineering leadership is technical present and will back your calls.
Benefits
Competitive Salary.
Company Laptop.
Bonus Scheme.
25 Days Annual Leave (plus bank holidays).
Hybrid working model.
Healthcare & Company Pension.
E-learning and career development opportunities.
Global company gatherings and events.
Plusmore that can be foundonthe benefits section on the Careers page are committed to providing a welcoming supportive environment. Creditsafe is an equalopportunitiesemployer that values diversity. Please contact us if you need anyassistancewith your application.
Required Experience:
IC
About Company
Bushel transforms agribusiness with innovative solutions, streamlining operations and boosting efficiency across the supply chain.
