Lead Data Platform Engineer
Lead Data Platform Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Role:
Design implement and integrate core platform components for dataset catalog storage standards publishing SDKs orchestration and metadata tracking
Evaluate and integrate opensource tools like Flyte Dagster Amundsen DataHub
Help shape how Databricks fits into the platform strategy and make it play well with the rest of the platform
Establish conventions and tooling for dataset formats (e.g. Parquet) versioning access control and schema definitions
Help define and build the golden path for producing and consuming datasets across teams
Embed platform thinking into everything making the platform extensible observable and pleasant to use
Essential requirements:
Have 7 years of handson software engineering experience including building dataintensive systems or platforms
Are familiar with data pipeline orchestration (Airflow Flyte Dagster etc.
Know your way around cloud platforms ideally with Azure but GCP or AWS is also fine
Are comfortable working with Databricks and its ecosystem handson experience is a strong plus
Understand the value of metadata lineage and data product ownership
Have experience building or contributing to internal platforms developer tools or shared services
Are comfortable with Python and CLI tooling and ideally know SQL as well
Are pragmatic: you can balance speed and structure you ship iteratively and youre not religious about tools
Can work across team boundaries explain your thinking clearly and enjoy helping others succeed
Meritorious:
Experience integrating with tools like Power BI Backstage or open metadata catalogs
Familiarity with Delta Lake and architectures (e.g. lakehouse)
Background in data engineering operations or developer experience roles
Please explain how you meet all the requirements when applying.
Utilization:100
Location: Stockholm
Period:
Last day to apply:
We present regularly. This means that we sometimes remove the assignements from our website before the final application deadline. If you are interested in an assignement we recommend that you submit your application as soon as possible.
Employment Type
Full Time
