Senior Technology Architect Databricks UK
Job Summary
Role Senior Databricks Architect
Technology Databricks (Spark PySpark/SQL) and data lake architectures
Location London UK
Compensation Competitive (including bonus)
Job Description
We are looking for a Data Architect to design build and operate scalable data pipelines and data products enabling a modern data mesh architecture. The role focuses on integrating legacy systems with cloud-native platforms to support analytics reporting and domain-owned data products.
Primary Skills
Strong experience with Databricks (Spark PySpark/SQL) and data lake architectures.
Hands-on experience with streaming technologies especially Kafka / Confluent Kafka.
Experience integrating legacy data sources such as DB2 (mainframe) and SQL Server.
Working knowledge of AWS data services especially S3.
Understanding of data product thinking data mesh concepts and modern data engineering best practices.
Key Responsibilities
Build and maintain batch and streaming data pipelines from legacy mainframe DB2 and on prem SQL Server systems into an AWS-based data lake.
Implement real-time ingestion using Confluent Kafka and land data in Amazon S3.
Develop data transformations and analytics pipelines in Databricks using the medallion architecture (Bronze Silver Gold).
Design and deliver high-quality reusable data products aligned to data mesh principles.
Ensure data quality reliability security and governance across pipelines.
Collaborate with domain teams platform teams and stakeholders to enable self-serve analytics and consumption.
Good to have
Experience in banking or financial services data platforms.
Familiarity with data governance metadata management and regulatory reporting
Personal
Besides the professional qualifications of the candidates we place great importance in addition to various forms personality profile. These include:
High analytical skills
A high degree of initiative and flexibility
High customer orientation
High quality awareness
Excellent verbal and written communication skills
Overview
***
Infosys is a global leader in next-generation digital services and consulting. We enable clients in 59 countries to navigate their digital transformation.
With over four decades of experience in managing the systems and workings of global enterprises we expertly steer clients in 59 countries as they navigate their digital transformation powered by cloud and AI. We enable them with an AI-first core empower the business with agile digital at scale and drive continuous improvement with always-on learning through the transfer of digital skills expertise and ideas from our innovation ecosystem. We are deeply committed to being a well-governed environmentally sustainable organization where diverse talent thrives in an inclusive workplace.
***
All aspects of employment at Infosys are based on merit competence and performance. We are committed to embracing diversity and creating an inclusive environment for all employees. Infosys is proud to be an equal opportunity employer.
Required Experience:
Senior IC
About Company
Welcome to Infosys Careers for Experienced Professionals As a leading provider of next-generation consulting, technology and outsourcing solutions, we are dedicated to helping organizations in over 46 countries to renew their core and simultaneously innovate into new frontiers. Whilst ... View more