We are looking for a Senior Data Platform Engineer to build out services and ingestion related to a knowledge graph. This knowledge graph aims to unify insights on data processingjob telemetry SLA expectation and attainment data quality infra incidentsusing job lineage to build a comprehensive and predictive view of data processing health across all of Apple Services data engineering. Youll apply your expertise in data systems to design build and support ingestion services to feed and manage data in the knowledge graph (a graph db) and be a part of coming up with new ways to classify and represent data via agentic workflows to increase the insight available from the graph. We believe graph-based insights can be used to power operational excellence by capture production issues driving analysis guiding resolution of issues and enabling proactive avoidance of future incidents. Youll work alongside a Dublin based team of data and other software engineers committed to bringing the knowledge graph to life. You will have a tremendous amount of individual responsibility and influence over the direction of this critical service for years to come. Additionally you will have the chance to interact with various other teams each with unique skill sets and operating in different time zones.
Experience designing and developing data services and/or data platforms
Experience with containerisation and orchestration (e.g. Kubernetes and Apache Airflow )
Experienced in SQL relational databases NoSQL databases and ORM tooling
Experience with Apache Spark and Kafka
Bachelors degree in Computer Science Computer Engineering Mathematics or equivalent professional experience.
Experience with a graph database (eg ArrangoDB Neo4j TigerGraph) and/or graph ontology
Experience with Python and/or Scala
A learning attitude to continuously improve the self team and the organisation
Loves fast-paced environment and learning/leveraging new technologies
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.