We are looking for a Data Engineer to join our Analytics & Data Engineering Knowledge graph team designing and develop data pipelines. Our knowledge graph aims to unify insights on data processing data lineage and data infrastructure across the entire Services division to generate a rich operational health view of our data pipelines. The graph will power operational excellence driving incident analysis guide agentic resolution of issues and enabling proactive avoidance of future incidents. Youll work alongside a Dublin based team of software and other data engineers committed to bringing the knowledge graph to life. You will have significant individual responsibility and influence over the direction of this critical service and the opportunity to learn and interact with a department of global teams each with unique skill sets and operating in different time zones.
Bachelors degree in a scientific field (Computer Science Computer Engineering Mathematics preferred)
Industry experience in a Data Engineering
Experience working with Spark and other distributed data technologies (e.g. Hadoop) for building efficient & large scale data pipelines.
Growth mindset and ability to learn new technologies
Good understanding of software development life cycle version control code reviews testing data quality tools and frameworks
Familiar with Data Lake and Data Warehouse technologies
Experience with job orchestrators and how they work (eg Airflow)
Experience with streaming data pipelines (eg Kafka Flink Spark-Streaming)
Experience with a graph database (eg Neo4j ArangoDB TigerGraph)
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.