Lead Data Platform Engineer
Lead Data Platform Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business which means you will be employed by us and work either with clients or on internal projects and assignments.
As part of your application you may be presented to clients/partners as part of the recruitment process. If selected for the assignment you will be employed by us and work either with clients or on internal projects and assignments as part of our consulting business.
Role:
Design implement and integrate core platform components for dataset catalog storage standards publishing SDKs orchestration and metadata tracking
Evaluate and integrate opensource tools like Flyte Dagster Amundsen DataHub
Help shape how Databricks fits into the platform strategy and make it play well with the rest of the platform
Establish conventions and tooling for dataset formats (e.g. Parquet) versioning access control and schema definitions
Help define and build the golden path for producing and consuming datasets across teams
Embed platform thinking into everything making the platform extensible observable and pleasant to use
Essential requirements:
Have 7 years of handson software engineering experience including building dataintensive systems or platforms
Are familiar with data pipeline orchestration (Airflow Flyte Dagster etc.
Know your way around cloud platforms ideally with Azure but GCP or AWS is also fine
Are comfortable working with Databricks and its ecosystem handson experience is a strong plus
Understand the value of metadata lineage and data product ownership
Have experience building or contributing to internal platforms developer tools or shared services
Are comfortable with Python and CLI tooling and ideally know SQL as well
Are pragmatic: you can balance speed and structure you ship iteratively and youre not religious about tools
Can work across team boundaries explain your thinking clearly and enjoy helping others succeed
Meritorious:
Experience integrating with tools like Power BI Backstage or open metadata catalogs
Familiarity with Delta Lake and architectures (e.g. lakehouse)
Background in data engineering operations or developer experience roles
Last day to apply:
About Us
We currently employ experienced consultants in areas such as System Development AI Machine Learning Testing Cloud Infra DevOps and IT Project Management.
Working at Deploja is something entirely different from working at an ordinary consulting companyand we are really proud of that. So what makes us unique
We simply offer more than just a high salary and greater freedom; thats just the beginning. With us youll find the work environment and opportunities you deserve. Welcome to Deploja where the grass is indeed greener!
Vi erbjuder dig fljande Valet r ditt!
Exciting assignments with our many clients. We focus on longterm projects which gives you the opportunity to create value for the client while also developing yourself.
A secure monthly salary together well agree on a base salary depending on your assignments.
Company car we encourage you to choose an electric car for a more sustainable future.
Occupational pension and great opportunities for salary conversion.
Vacation Would you like more than 30 days of vacation perhaps 60 days
Private health insurance accident insurance and life insurance for increased security.
Skills development you set your own budget and choose the training you wish to attend.
Quality of life Are you struggling to balance everyday life and wish to work a little less while still earning as much if not more
We handle applications continuously and due to the high workload its especially important to include a short motivation for the position explaining how you meet the requirements.
Employment Type
Full Time
