Employer Active
Job Alert
You will be updated with latest job alerts via emailJob Alert
You will be updated with latest job alerts via emailThe AI Security Institute is the largest team in a government dedicated to understanding AI capabilities and risks in the world.
Our mission is to equip governments with an empirical understanding of the safety of advanced AI systems. We conduct research to understand the capabilities and impacts of advanced AI and develop and test risk mitigations. We focus on risks with security implications including the potential of AI to assist with the development of chemical and biological weapons how it can be used to carry out cyber-attacks enable crimes such as fraud and the possibility of loss of control.
The risks from AI are not sci-fi they are urgent. By combining the agility of a tech start-up with the expertise and mission-driven focus of government were building a unique and innovative organisation to prevent AIs harms from impeding its potential.
The AI Security Institute (AISI) launched at the 2023 Bletchley Park AI Safety Summit is the worlds first state-backed organisation dedicated to advancing AI security for the public interest. Our mission is to assess and mitigate risks from frontier AI systems including cyber attacks on critical infrastructure AI-enhanced chemical and biological threats large-scale societal disruptions and potential loss of control over increasingly powerful AI. In just one year weve assembled one of the largest and most respected research teams featuring renowned scientists and senior researchers from leading AI labs such as Anthropic DeepMind and OpenAI.
At AISI were building the premier institution for impacting both technical AI safety and AI governance. We conduct cutting-edge research develop novel evaluation tools and provide crucial insights to governments companies and international partners. By joining us youll collaborate with the brightest minds in the field directly shape global AI policies and tackle complex challenges at the forefront of technology and ethics. Whether youre a researcher engineer or policy expert at AISI youre not just advancing your career youre positioned to have significant impact in the age of artificial intelligence.
ABOUT AISIs CHEM-BIO WORKSTREAM
You will be part of the Chem-Bio (CB) Team in AISIs Research Unit a multidisciplinary team comprised of several technical workstreams and a strategy and delivery function (which serves as an impact-multiplier for our technical outputs). The CB teams technical work plan is overseen by the CB Workstream Lead who will also serve as the line manager for this role.
Our teams mission is to advance the security science of advanced AI models including LLMs and more specialized AI models within biology and chemistry and to equip policymakers with an empirical understanding of security-relevant AI capabilities specifically at the intersection of AI with biology and chemistry. We work closely across AISI HMG and with external experts to make sure our research has real-world impacts on AI safety and chemical and biological security through policy recommendations.
You will lead technical work on thresholds ecosystem engagement and conceptual research on mitigations. This may involve defining what AI capabilities would indicate increased risks leading on research to understand how the academic/industry ecosystem uses different AI tools or considering what content would be appropriate for an LLM to refuse.
Given the sensitivity of our work we will need someone who either holds or is able to attain Developed Vetting (DV) and any continued employment will be conditional on earning and maintaining this level of clearance. More detail on Security Clearances can be found on the UK Government website.
ROLE SUMMARY
As a Research Scientist your key duties will span three pillars: Thresholds Ecosystem Engagement and Mitigations.
Mitigations
Thresholds
Ecosystem
PERSON SPECIFICATION
We strongly encourage you to apply even if you feel you only meet some of the criteria listed here.
Essential Criteria
Desirable Criteria
If you have questions about the role AISIs Chem-Bio Workstream Lead (Sophie Rose; ) is available to discuss it further.
Whilst AISI often encourages applications from individuals of any nationality due to the unique nature of this role and the elevated security clearances that would be required once in post we can only accept individuals capable of meeting DV criteria which is largely restricted to UK nationals. Therefore this statement supersedes our general nationality rules policy as described in the footnote of this post. For further vetting clarification please visit the listed below:
National security vetting: clearance levels -
We are hiring individuals at all ranges of seniority and experience within this research unit and this advert allows you to apply for any of the roles within this range. Your dedicated talent partner will work with you as you move through our assessment process to explain our internal benchmarking process. The full range of salaries are available below salaries comprise of a base salary technical allowance plusadditional benefitsas detailed on this page.
This role sits outside of the DDaT pay framework given the scope of this role requires in depth technical expertise in frontier AI safety robustness and advanced AI architectures.
There are a range of pension options available which can be found through the Civil Service website.
The Internal Fraud function of the Fraud Error Debt and Grants Function at the Cabinet Office processes details of civil servants who have been dismissed for committing internal fraud or who would have been dismissed had they not resigned. The Cabinet Office receives the details from participating government organisations of civil servants who have been dismissed or who would have been dismissed had they not resigned for internal fraud. In instances such as this civil servants are then banned for 5 years from further employment in the civil service. The Cabinet Office then processes this data and discloses a limited dataset back to DLUHC as a participating government organisations. DLUHC then carry out the pre employment checks so as to detect instances where known fraudsters are attempting to reapply for roles in the civil service. In this way the policy is ensured and the repetition of internal fraud is prevented. For more information please see -Internal Fraud Register.
We may be able to offer roles to applicant from any nationality or background. As such we encourage you to apply even if you do not meet the standard nationality requirements (opens in a new window).
Full Time