Research Scientist/Research Engineer

AI Safety Institute
London
1 week ago
Create job alert
Role Description

The AI Safety Institute research unit is looking for exceptionally motivated and talented people to join its Safeguard Analysis Team.

Interventions that secure a system from abuse by bad actors will grow in importance as AI systems become more advanced and integrated into society. The AI Safety Institute’s Safeguard Analysis Team researches such interventions, which it refers to as 'safeguards', evaluating protections used to secure current frontier AI systems and considering what measures could and should be used to secure such systems in the future.

The Safeguard Analysis Team takes a broad view of security threats and interventions. It's keen to hire researchers with expertise developing and analysing attacks and protections for systems based on large language models, but is also keen to hire security researchers who have historically worked outside of AI, such as in - non-exhaustively - computer security, information security, web technology policy, and hardware security. Diverse perspectives and research interests are welcomed.

The Team seeks people with skillsets leaning in the direction of either or both of Research Scientist and Research Engineer, recognising that some technical staff may prefer work that spans or alternates between engineering and research responsibilities. The Team's priorities include research-oriented responsibilities – like assessing the threats to frontier systems and developing novel attacks – and engineering-oriented ones, such as building infrastructure for running evaluations.

In this role, you’ll receive mentorship and coaching from your manager and the technical leads on your team. You'll also regularly interact with world-famous researchers and other incredible staff, including alumni from Anthropic, DeepMind, OpenAI and ML professors from Oxford and Cambridge.

In addition to Junior roles, Senior, Staff and Principal RE positions are available for candidates with the required seniority and experience.

Person Specification

You may be a good fit if you havesomeof the following skills, experience and attitudes:

  • Experience working on machine learning, AI, AI security, computer security, information security, or some other security discipline in industry, in academia, or independently.
  • Experience working with a world-class research team comprised of both scientists and engineers (e.g. in a top-3 lab).
  • Red-teaming experience against any sort of system.
  • Strong written and verbal communication skills.
  • Comprehensive understanding of large language models (e.g. GPT-4). This includes both a broad understanding of the literature, as well as hands-on experience with things like pre-training or fine-tuning LLMs.
  • Extensive Python experience, including understanding the intricacies of the language, the good vs. bad Pythonic ways of doing things and much of the wider ecosystem/tooling.
  • Ability to work in a self-directed way with high agency, thriving in a constantly changing environment and a steadily growing team, while figuring out the best and most efficient ways to solve a particular problem.
  • Bring your own voice and experience but also an eagerness to support your colleagues together with a willingness to do whatever is necessary for the team’s success and find new ways of getting things done.
  • Have a sense of mission, urgency, and responsibility for success, demonstrating problem-solving abilities and preparedness to acquire any missing knowledge necessary to get the job done.
  • Writing production quality code.
  • Improving technical standards across a team through mentoring and feedback.
  • Designing, shipping, and maintaining complex tech products.
Salary & Benefits

We are hiring individuals at all ranges of seniority and experience within the research unit, and this advert allows you to apply for any of the roles within this range. We will discuss and calibrate with you as part of the process. The full range of salaries available is as follows:

  • L3: £65,000 - £75,000
  • L4: £85,000 - £95,000
  • L5: £105,000 - £115,000
  • L6: £125,000 - £135,000
  • L7: £145,000

There are a range of pension options available which can be found through the Civil Service website.

Selection Process

In accordance with theCivil Service Commissionrules, the following list contains all selection criteria for the interview process.

Required Experience

This job advert encompasses a range of possible research and engineering roles within the Safeguard Analysis Team. The 'required' experiences listed below should be interpreted as examples of the expertise we're looking for, as opposed to a list of everything we expect to find in one applicant:

  • Writing production quality code
  • Writing code efficiently
  • Python
  • Frontier model architecture knowledge
  • Frontier model training knowledge
  • Model evaluations knowledge
  • AI safety research knowledge
  • Security research knowledge
  • Research problem selection
  • Research science
  • Written communication
  • Verbal communication
  • Teamwork
  • Interpersonal skills
  • Tackle challenging problems
  • Learn through coaching

#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Research Scientist

Research Scientist, Frontier Red Team (Autonomy)

Research Scientist - AI Image and Video Synthesis

2024 Intern- Research Scientist/Engineer

Research Scientist - Mathematical Modelling for Mechanical Systems Dynamics

Postdoctoral Research Scientist - Antibody Engineering

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

10 Best Biotech Books for UK Job Seekers: Boost Your Biotechnology Career in 2025

The biotechnology industry is booming, fuelled by advancements in genomics, synthetic biology, regenerative medicine, and countless other cutting-edge fields. With the UK emerging as a major global biotech hub—spanning sectors like healthcare, agriculture, and environmental science—there has never been a better time to develop the skills and knowledge necessary to thrive in this dynamic sector. Whether you’re a recent graduate or a seasoned scientist, staying updated with the right resources can dramatically enhance your career prospects. In this blog post, we present ten must-read books that offer deep insights into the foundational concepts, practical techniques, and forward-thinking innovations shaping biotechnology today. By reading and internalising the wisdom of these texts, you’ll be better equipped to navigate job interviews, tackle complex projects, and excel in roles throughout the biotech landscape.

Navigating Biotech Career Fairs Like a Pro: Preparing Your Pitch, Questions to Ask, and Follow-Up Strategies to Stand Out

In today’s fast-paced biotechnology industry, competition for the best roles can be fierce. Whether you’re a recent graduate in life sciences, an experienced research scientist aiming to transition into a more commercial role, or a skilled technician seeking a new challenge, biotech career fairs are an invaluable opportunity to meet prospective employers face-to-face. A successful experience at these events often comes down to preparing effectively, asking the right questions, and following up in a professional, memorable manner. In this comprehensive guide, we’ll explore how you can prepare your personal pitch, the kinds of questions that will make a lasting impression, key examples of biotech career fairs in the UK, and the follow-up strategies that will help you stand out in a crowded field. If you’re looking for the perfect chance to network with potential employers in the UK biotech sector, read on to learn how to make the most of these career fairs.

Common Pitfalls Biotech Job Seekers Face and How to Avoid Them

The biotechnology sector is one of the fastest-growing industries in the UK, offering an array of exciting career opportunities for scientists, engineers, research associates, and business professionals alike. From cutting-edge gene editing and cell therapy to industrial bioprocessing and bioinformatics, biotechnology companies are pushing the boundaries of science to transform healthcare, agriculture, and sustainability. Yet, as more professionals enter the field, securing a great biotech role has become more competitive. Despite possessing strong qualifications and relevant scientific expertise, many biotech candidates inadvertently make avoidable mistakes during their job hunt, in their CVs, in interviews, and in their overall approach to professional development. These pitfalls can cost you that coveted role—whether it’s in a cutting-edge start-up or a well-established pharmaceutical multinational. In this article, we’ll explore the common challenges biotechnology job seekers face, along with proven strategies to overcome them. By following these guidelines, you can craft a compelling application, excel in interviews, and stand out in a thriving but crowded job market.