Principal Engineer - Site Reliability / SRE (we have office locations in Cambridge, Leeds & London)

Are you passionate about helping to mature technical practices and empowering teams to run resilient and reliable services At Genomics England we are looking for a Principal Site Reliability Engineer to help lead and refocus our small SRE capability ultimately growing it to become thoughtleaders in system reliability across the organisation.

About the Role

As the Principal Site Reliability Engineer you will be a handson contributor with exemplary platform engineering skills who also has an ability to lead and think strategically to identify and prioritise areas with the greatest impact. You may have previously worked in a variety or roles and job titles within engineering and you may have worked in a variety of organisational contexts. Whatever your past experience it will have given you a deep understanding of SRE principles and practices and how these are used to build and operate reliable services that exceed customer expectations.

You will be a problemsolver who identifies risks issues gaps and dependencies and brings people together to find solutions. You will do this through your supportive empathetic and collaborative behaviours acting as coach mentor guide or constructive questioner as the situation demands. You are pragmatic but also mindful of the big picture consciously balancing the immediate goals of teams against the longterm direction for their products. You will be a great communicator comfortable not just leading your own team but also engaging across the engineering community and with nontechnical stakeholders.

About the Tech Stack

The SRE team will support squads that run a variety of services: most of these are either userfacing web applications (React) backend APIs (Python) bioinformatics pipelines (NextFlow) or data ETL workflows (Prefect Dremio). These services increasingly run in AWS though there is still a significant onpremise presence and they run in a mixture of compute environments from ECS/Fargate to HPC clusters to (occasionally) Kubernetes.

Within the SDLC we have a standard toolchain which includes Terraform for infrastructureascode GitLab for source code and CI/CD Artifactory for software artefacts and DataDog for observability. We are working to become interoperable with the wider NHS via open standards like FHIR and GA4GH APIs and increasingly aiming to integrate with their own API Management platform.

Job Description

• Assess the current state of human and technical processes and practices from a site reliability perspective and identify the areas of greatest concern
• Develop a roadmap of initiatives aimed at raising the maturity of live services through SRE practices (SLOs Critical User Journeys monitoring with Golden Signals releaseengineering etc.)
• Grow and lead a small team of Site Reliability Engineers to roll out those initiatives across the organisation through partnership with product squads
• Work with key stakeholders to establish and embed key SRE principles (e.g. Error Budget Policies)
• Maintain close contact with Engineering leadership and other enabling teams (Test Enablement Developer Platform) to ensure that SRE work is fully aligned with our direction of travel
• Stay abreast of emerging technologies and industry trends and incorporate them into our software development practices
• Contribute to the wider conversation at Genomics England and help mature our technical practices

Qualifications

While we recognise the value of relevant qualifications or certifications we are primarily interested in your realworld experience.

Essential Skills and Experience

• Comprehensive knowledge of SRE principles and practices with significant experience of applying these to realworld situations
• Excellent software engineering skills especially in the context of release automation and other toileliminating activities (Python preferred polyglot ideal)
• Strong understanding of how architecture and other factors contribute to the overall resilience of systems
• Extensive experience of platform engineering across CI/CD Infrastructure as Code operational monitoring and alerting backup and recovery etc.
• Experience in at least one major public cloud (AWS preferred but not essential)
• Demonstrable ability to lead teams manage direct mentor and plan work 
• Strong interpersonal skills with a temperament that builds trust and connection within and across squads through open honest communication
• Comfortable engaging responsively with teams both remotely and in person when required
• Ability to navigate rapidly to effective solutions through engaged and inclusive listening clarity of thought clear documentation and succinct presentation

Desirable Experience

These skills are not essential but if you have either of them they may prove to be useful:

• Background in healthcare or bioinformatics
• Experience in regulated environments

If youre an experienced Site Reliability Engineer leader who thrives on working collaboratively to mature engineering practices wed love to hear from you. Join us at Genomics England and make a meaningful impact in the world of genomics.

Qualifications :

While we recognise the value of relevant qualifications or certifications we are primarily interested in your realworld experience.

Additional Information :

Salary: 103500

Being an integral part of such a meaningful mission is extremely rewarding in itself but in order to support our people were continually improving our benefits package. We pride ourselves on investing in our people and supporting them to achieve their career goals as well as offering a benefits package including: 

• Generous Leave: 30 days holiday plus bank holidays additional leave for long service and the option to apply for up to 30 days of remote working abroad annually (approval required).
• FamilyFriendly: Blended working arrangements flexible working enhanced maternity paternity and shared parental leave benefits.
• Pension & Financial: Defined contribution pension (Genomics England doublematches up to 10% however you can contribute more if you wish) Life Assurance (3x salary) and a Give As You Earn scheme.
• Learning & Development: Individual learning budgets support for training and certifications and reimbursement for one annual professional subscription (approval required).
• Recognition & Rewards: Employee recognition programme and referral scheme.
• Health & Wellbeing: Subsidised gym membership a free Headspace account and access to an Employee Assistance Programme eye tests flu jabs.

Equal opportunities and our commitment to a diverse and inclusive workplace 

Genomics England is actively committed to providing and supporting an inclusive environment that promotes equity diversity and inclusion best practice both within our community and in any other area where we have influence. We are proud of our diverse community where everyone can come to work and feel welcomed and treated with respect regardless of any disability ethnicity gender gender identity religion sexual orientation or social background. 

Genomics Englands policies of nondiscrimination and equity and will be applied fairly to all people regardless of age disability gender identity or reassignment marital or civil partnership status being pregnant or recently becoming a parent race religion or beliefs sex or sexual orientation length of service whether full or parttime or employed under a permanent or a fixedterm contract or any other relevant factor.  

Genomics England does not tolerate any form of discrimination harassment victimisation or bullying at work. Such behaviour is contrary toour virtues undermines our mission and core values and diminishes the dignity respect and integrity of all parties.  Our People policies outline our commitment to inclusivity. 

We aim to remove barriers in our recruitment processes and to be flexible with our interview processes. Should you require any adjustments that may help you to fully participate in the recruitment process we encourage you to discuss this with us. 

Blended working model

Genomics England operates a blended working model as we know our people appreciate the flexibility that hybrid working can bring. We expect most people to come into the office a minimum of 2 times each month. However this will vary according to role and will be agreed with your team leader. There is no expectation that people will return to the office full time unless they want to however some of our roles require full time on site attendance e.g. lab teams reception team. 

Our teams and squads have and will continue to reflect on what works best for them to work together successfully and have the freedom to design working patterns to suit beyond the minimum. Our office locations are: Canary Wharf Cambridge and Leeds.

Onboarding background checks

As part of our recruitment process all successful candidates are subject to a Standard Disclosure and Barring Service (DBS) check.  We therefore require applicants to disclose any previous offences at point of application as some unspent convictions may mean we are unable to proceed with your application due to the nature of our work in healthcare.