Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We are looking for brilliant engineers to join our team at Magentic. Were pushing the boundaries of AI with next-generation agentic systems that can manage entire workflows. Were focusing on a three trillion dollar market of supply chains and procurement.
Our mission is to make global manufacturing supply chains robust to an ever-changing world and to harness the potential of generative AI through thoughtful deployment maximising benefits while prioritising ethical use and safety.
Data Engineers are the backbone of Magentic. They design build and maintain the scalable data infrastructure that powers our intelligent agentic systems. Youll work closely with ML engineers product teams and domain experts to transform raw supply chain data into structured reliable and actionable insights that drive decision-making across our platform.
Were creating the data foundation for autonomous agents to reason plan and act in complex high-stakes environments. This role is an opportunity to work on deeply technical challenges with real-world impact at scale.
Tasks
In this role you will:
- Design and operate performant scalable ingestion pipelines processing high-volume data from global supply chain and procurement systems.
- Define evolve and manage data schemas and cataloguesfrom raw staging to high-quality analytics and feature storesensuring consistency and discoverability.
- Build end-to-end monitoring and observability for your pipelines: owning data quality latency completeness and lineage at every stage.
- Champion secure governed data practices: access controls secrets management encrypted data-in-transit/at-rest and compliance with frameworks like GDPR.
- Collaborate closely with AI Platform and Product teams provisioning data sets feature tables and contracts for analytics and machine learning at scale.
- Continuously improve efficiency and reliability via testing CI/CD automation cost/performance tuning and incident/root-cause reviews.
Requirements
Requirements
You may be a fit if you have:
- Expertise in Cloud-Native Data Engineering: 3 years building and running data pipelines in AWS or Azure including managed data services (e.g. Kinesis EMR/Databricks Redshift Glue Azure Data Lake).
- Programming Mastery: Advanced skills in Python or another major language; writing clean testable production-grade ETL code at scale.
- Modern Data Pipelines: Experience with batch and streaming frameworks (e.g. Apache Spark Flink Kafka Streams Beam) including orchestration via Airflow Prefect or Dagster.
- Data Modeling & Schema Management: Demonstrated expertise in designing evolving and documenting schemas (OLAP/OLTP dimensional star/snowflake CDC) data contracts and data cataloguing.
- API & Integration Fluency: Building data ingestion from REST/gRPC APIs file drops message queues (SQS Kafka) and 3rd party SaaS integrations with idempotency and error handling.
- Storage & Query Engines: Strong with RDBMS (PostgreSQL MySQL) NoSQL (DynamoDB Cassandra) data lakes (Parquet ORC) and warehouse paradigms.
- Observability & Quality: Deep familiarity with metrics logging tracing and data quality tools (e.g. Great Expectations Monte Carlo custom validation/test suites).
- Security & Governance: Data encryption secrets management RBAC/ABAC and compliance awareness (GDPR CCPA).
- CI/CD for Data Systems: Comfort with automation infrastructure as code (Terraform) version control and release workflows.
- Collaborative Spirit: Experience working closely with platform ML and analytics teams in a fast-paced mission-driven environment.
Benefits
Benefits
Compensation and Benefits
At Magentic we recognise and reward the talent that drives our success. We offer:
- Competitive Equity: play a real part in Magentics upside.
- A salary of 95000-105000
- Visa sponsorship available; we prioritise UK-based candidates but welcome global talent.
- Hybrid London HQ (3-4 days in the office) with remote flexibility.
- Annual team retreata fully-funded off-site to recharge bond and build.
About Magentic
At Magentic we are committed to developing artificial intelligence that benefits humanity. We push the limits of AIs capabilities and are dedicated to its responsible and safe deployment. Recognising the profound impact of AI we ensure that its development is centred around human needs and safety incorporating a wide array of perspectives to fulfil our mission. We bring expertise from OpenAI NASA and McKinsey and were backed by the best venture funds in the world.
We cant wait to have you on board.
Equal Opportunities Statement
Magentic is committed to creating a diverse and inclusive workplace and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race colour religion gender gender reassignment marital or civil partnership status age disability pregnancy or maternity or any other basis as protected by the Equality Act 2010.
We actively encourage applications from candidates of all backgrounds and cultures and believe a diverse workforce enhances our ability to deliver innovative solutions. We also ensure that our employment decisions are based solely on individual qualifications merit and business needs.
Accommodations for Applicants with Disabilities
Magentic is dedicated to providing reasonable accommodations to job applicants with disabilities. If you require any adjustments during the recruitment process please indicate this in your application or contact us directly
Employment Type
Full Time
