Research Scientist

AI Safety Institute
London
1 week ago
Create job alert
Autonomous Systems

We're focused on extreme risks from autonomous AI systems - those capable of interacting with the real world. To address this, we're advancing the state of the science in risk modeling, incorporating insights from other safety-critical and adversarial domains, while developing our own novel techniques. We're also empirically evaluating these risks - building out one of the world's largest agentic evaluation suites, as well as pushing forward the science of model evaluations, to better understand the risks and predict their materialisation.

Role Summary

As a research scientist, you'll work as part of a multi-disciplinary team including scientists, engineers and domain experts on the risks that we are investigating. Your team is given huge amounts of autonomy to chase research directions & build evaluations that relate to your team’s over-arching threat model. This includes coming up with ways of breaking down the space of risks, as well as designing & building ways to evaluate them. All of this is done within an extremely collaborative environment, where everyone does a bit of everything. Some of the areas we focus on include:

  • Research and Development (R&D).Investigating AI systems' potential to conduct research, particularly in sensitive areas. This includes studying AI capabilities in developing dual-use technologies, unconventional weapons, and accelerating AI and hardware (GPU) development.
  • Self-replication.Researching the potential for AI systems to autonomously replicate themselves across networks and studying their ability to establish persistence.
  • Human influence.Assessing AI models' capacity to manipulate, persuade, or coerce individuals and groups. This covers techniques for general human influence, key individual manipulation, social fabric alteration, and the accumulation of social and political power.
  • Dangerous resource acquisition.Examining AI models' ability to navigate restricted or illegal domains for acquiring resources or services. This encompasses research into general acquisition of dual-use resources, circumvention of embargoes and acquisition of human assets.
  • Deceptive alignment.Evaluating AI systems' potential to display deceptive behaviours. This includes research into AI's ability to misrepresent its capabilities, conceal its true objectives, and strategically behave in ways that may not align with its actual goals or knowledge.

You’ll receive coaching from your manager and mentorship from the research directors at AISI (including Geoffrey Irving and Yarin Gal). You will also regularly interact with world-famous researchers and other incredible staff (including alumni from DeepMind, OpenAI and ML professors from Oxford and Cambridge). We have a very strong learning & development culture to support this, including Friday afternoons devoted to deep reading and various weekly paper reading groups.

Person Specification

You may be a good fit if you havesomeof the following skills, experience and attitudes:

  • Experience working within a research team that has delivered multiple exceptional scientific breakthroughs, in deep learning (or a related field). We’re looking for evidence of an exceptional ability to drive progress.
  • Comprehensive understanding of large language models (e.g. GPT-4). This includes both a broad understanding of the literature, as well as hands-on experience with things like pre-training or fine tuning LLMs.
  • Strong track-record of academic excellence (e.g. multiple spotlight papers at top-tier conferences).
  • Improving scientific standards and rigour, through things like mentorship & feedback.
  • Strong written and verbal communication skills.
  • Experience working with world-class multi-disciplinary teams, including both scientists and engineers (e.g. in a top-3 lab).
  • Acting as a bar raiser for interviews.
Salary & Benefits

We are hiring individuals at all ranges of seniority and experience within the research unit, and this advert allows you to apply for any of the roles within this range. We will discuss and calibrate with you as part of the process. The full range of salaries available is as follows:

  • L3: £65,000 - £75,000
  • L4: £85,000 - £95,000
  • L5: £105,000 - £115,000
  • L6: £125,000 - £135,000
  • L7: £145,000

There are a range of pension options available which can be found through the Civil Service website.

Selection Process

In accordance with theCivil Service Commissionrules, the following list contains all selection criteria for the interview process.

Required Experience

We select based on skills and experience regarding the following areas:

  • Research problem selection
  • Research science
  • Writing code efficiently
  • Python
  • Frontier model architecture knowledge
  • Frontier model training knowledge
  • Model evaluations knowledge
  • AI safety research knowledge
  • Written communication
  • Verbal communication
  • Teamwork
  • Interpersonal skills
  • Tackle challenging problems
  • Learn through coaching
Desired Experience

We additionally may factor in experience with any of the areas that our work-streams specialise in:

  • Autonomous systems
  • Cyber security
  • Chemistry or Biology
  • Safeguards
  • Safety Cases
  • Societal Impacts

#J-18808-Ljbffr

Related Jobs

View all jobs

Research Scientist - Mathematical Modelling for Mechanical Systems Dynamics

Research Scientist In-Vivo

Research Scientist, Frontier Red Team (Autonomy)

Research Scientist: AI for Quantum Chemistry

Research Scientist - Brain-Inspired AI Systems (Contractor)

Research Scientist II, ROW AOP

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Biotechnology Leadership for Managers: Strategies to Motivate, Mentor, and Set Realistic Goals in Research-Driven Teams

Biotechnology—spanning everything from gene editing to vaccine development—plays an increasingly pivotal role in shaping our global future. As breakthroughs in molecular biology, genomics, and bioinformatics cascade into real-world applications, the ability to lead high-performing biotech teams has never been more critical. Today’s biotech leaders must combine scientific literacy, strategic thinking, and people-focused management to drive innovation while meeting stringent regulatory and ethical standards. This article provides actionable insights into how biotech managers can motivate, mentor, and set achievable milestones for research-focused teams. Whether you are spearheading cutting-edge R&D, managing clinical trials, or overseeing large-scale production in a pharmaceutical environment, the strategies outlined here will help you foster a culture of innovation and excellence within your organisation.

10 Best Biotech Books for UK Job Seekers: Boost Your Biotechnology Career in 2025

The biotechnology industry is booming, fuelled by advancements in genomics, synthetic biology, regenerative medicine, and countless other cutting-edge fields. With the UK emerging as a major global biotech hub—spanning sectors like healthcare, agriculture, and environmental science—there has never been a better time to develop the skills and knowledge necessary to thrive in this dynamic sector. Whether you’re a recent graduate or a seasoned scientist, staying updated with the right resources can dramatically enhance your career prospects. In this blog post, we present ten must-read books that offer deep insights into the foundational concepts, practical techniques, and forward-thinking innovations shaping biotechnology today. By reading and internalising the wisdom of these texts, you’ll be better equipped to navigate job interviews, tackle complex projects, and excel in roles throughout the biotech landscape.

Navigating Biotech Career Fairs Like a Pro: Preparing Your Pitch, Questions to Ask, and Follow-Up Strategies to Stand Out

In today’s fast-paced biotechnology industry, competition for the best roles can be fierce. Whether you’re a recent graduate in life sciences, an experienced research scientist aiming to transition into a more commercial role, or a skilled technician seeking a new challenge, biotech career fairs are an invaluable opportunity to meet prospective employers face-to-face. A successful experience at these events often comes down to preparing effectively, asking the right questions, and following up in a professional, memorable manner. In this comprehensive guide, we’ll explore how you can prepare your personal pitch, the kinds of questions that will make a lasting impression, key examples of biotech career fairs in the UK, and the follow-up strategies that will help you stand out in a crowded field. If you’re looking for the perfect chance to network with potential employers in the UK biotech sector, read on to learn how to make the most of these career fairs.