Data Platform Lead
Data Platform Lead
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We are looking for a Data Platform Lead to take charge of designing and managing our data infrastructure. You will lead efforts in developing scalable and highperformance data models. Youll oversee our ETL pipelines data ingestion processes and collaborate closely with data scientists to ensure their machine learning models are smoothly integrated into production. You will also play a key role in defining the infrastructure necessary for heterogeneous data ingestion ML training processes and ML Ops ensuring the right pipelines monitoring and automation are in place.
Key Responsibilities:
Lead the design and optimization of data models and infrastructure to support largescale data processing.
Oversee and manage the data layer architecture currently built on Cube.dev and MongoDB with a key objective to evaluate and potentially transition to an SQLbased system (e.g. PostgreSQL for enhanced performance.
Handle geospatial data management ensuring efficient handling of locationbased data for analysis storage and visualization.
Build and maintain robust ETL pipelines and data ingestion streams that ensure high availability reliability and performance of data systems.
Collaborate with the data science team to ensure the integration of machine learning models into production environments focusing on efficient model deployment monitoring and iteration.
Design and implement ML Ops infrastructure to support model training experimentation and deployment including tracking versioning and scalability of training processes.
Define and implement best practices for data governance ensuring security quality and compliance.
Evaluate and adopt new tools and technologies to improve data processing with a focus on realtime data ingestion and scalable ML infrastructure.
Provide leadership in shaping the future of our data architecture ensuring it aligns with the companys goals of sustainability and highimpact analytics.
Employment Type
Full-Time
