Evals Platform Engineer

COL Limited
London
1 week ago
Create job alert

Applications deadline:The final date for submissions is25 April 2025. However, we review applications on a rolling basis and encourage early submissions.

ABOUT APOLLO RESEARCH

The capabilities of current AI systems are evolving at a rapid pace. While these advancements offer tremendous opportunities, they also present significant risks, such as the potential for deliberate misuse or the deployment of sophisticated yet misaligned models. AtApollo Research, our primary concern lies with deceptive alignment, a phenomenon where a model appears to be aligned but is, in fact, misaligned and capable of evading human oversight.

Our approach focuses on behavioral model evaluations, which we then use to audit real-world models. We also combine black-box approaches with applied interpretability. In our evaluations, we focus on LM agents, i.e. LLMs with agentic scaffolding similar toAIDEorSWE agent. We also study model organisms in controlled environments (seeour security policies), e.g. to better understand capabilities related to scheming.

At Apollo, we aim for a culture that emphasizes truth-seeking, being goal-oriented, giving and receiving constructive feedback, and being friendly and helpful. If you’re interested in more details about what it’s like working at Apollo, you can find more informationhere.

ABOUT THE ROLE

We are looking for aPlatform Engineerto build, scale, and maintain the infrastructure that supports our frontier AI evaluation research, with a strong emphasis on security. As the infrastructure specialist on a small team, you'll have broad decision-making authority on our infrastructure stack. You’ll design and provision the infrastructure that our researchers depend on daily and also contribute to the software platform we build on top of this infrastructure.

You will work as part of a small cross-functional team, collaborating with software engineers and research scientists to ensure our infrastructure is scalable, secure, and efficient.

Responsibilities

  1. Design, implement, scale, and maintain infrastructure for running frontier LLM evals
  2. Work closely with software engineers and researchers to understand and address infrastructure needs
  3. Choose and integrate appropriate technologies for our infrastructure stack
  4. Administer and secure internal AWS accounts
  5. Enforce security best practices
  6. Manage IAM permissions and access control
  7. Manage CI/CD pipelines
  8. Design and build data storage systems for evaluation results
  9. Help set up and manage organisation-wide security processes
  10. Contribute to development of internal software tools that leverage our infrastructure

Required skills

  1. Experience leading infrastructure projects from start to finish
  2. Experience implementing security best practices for cloud and containerized environments
  3. Solid knowledge of AWS, including IAM and EKS
  4. Strong hands-on experience with Kubernetes
  5. Experience with Infrastructure as Code tools
  6. Strong software engineering skills, preferably in Python
  7. Ability to work well with researchers and understand their technical needs

Strong candidates may have some of the following

  1. Experience with Cilium, gVisor, or Karpenter
  2. Experience working with LLM evaluations
  3. Experience building and managing data storage systems
  4. Experience setting up and maintaining data collection, monitoring, and alerting systems.
  5. Exposure to startup environments or early-stage engineering teams
  6. Track record of building and scaling infrastructure from scratch with fast turnaround
  7. Cybersecurity experience

LOGISTICS

  • Start Date:Target of 2-3 months after the first interview.
  • Time Allocation: Full-time.
  • Location: The office is in London, and the building is shared with the London Initiative for Safe AI (LISA) offices. This is an in-person role. In rare situations, we may consider partially remote arrangements on a case-by-case basis.
  • Work Visas: We can sponsor UK visas

BENEFITS

  • Salary: a competitive UK-based salary.
  • Flexible work hours and schedule.
  • Unlimited vacation.
  • Unlimited sick leave.
  • Lunch, dinner, and snacks are provided for all employees on workdays.
  • Paid work trips, including staff retreats, business trips, and relevant conferences.
  • A yearly $1,000 (USD) professional development budget.

Equality Statement:Apollo Research is an Equal Opportunity Employer. We value diversity and are committed to providing equal opportunities to all, regardless of age, disability, gender reassignment, marriage and civil partnership, pregnancy and maternity, race, religion or belief, sex, or sexual orientation.

How to apply:Please complete the application form with your CV. The provision of a cover letter is optional but not necessary. Please also feel free to share links to relevant work samples.

About the interview process:Our multi-stage process includes a screening interview, a take-home test (approx. 2 hours), 3 technical interviews, and a final interview with Marius (CEO). The technical interviews will be closely related to tasks the candidate would do on the job.

#J-18808-Ljbffr

Related Jobs

View all jobs

▷ Urgent: Clinical Research Physician

Research Scientist, Frontier Red Team (Autonomy)

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Global vs. Local: Comparing the UK Biotech Job Market to International Landscapes

How to navigate opportunities, salaries, and work culture in biotechnology across the UK, the US, Europe, and Asia Biotechnology has steadily evolved from a specialised branch of life sciences to an influential force shaping healthcare, agriculture, environmental sustainability, and even digital technology through bioinformatics. From the development of groundbreaking gene therapies and vaccines to the engineering of sustainable biofuels and lab-grown foods, biotech has become one of the most innovative and impactful sectors worldwide. As such, the demand for skilled professionals—from research scientists to regulatory affairs experts—is on a steep upward trajectory. For job seekers looking to build or enhance their careers in biotechnology, understanding how different regional markets compare can be a game-changer. In this blog post, we examine how the UK biotech job market stacks up against that of the United States, Europe, and Asia. We’ll explore not only the scale of job demand and differences in salaries, but also important nuances around work culture and professional growth. For those considering remote or international positions, we’ll offer valuable insights to help you make informed decisions. Whether you’re a recent graduate from a life sciences programme, a seasoned researcher branching into industry, or a professional pivoting from a related discipline such as pharma or chemical engineering, the global biotech landscape is replete with opportunities. By assessing factors like salary expectations, cost of living, regulatory environments, and cultural norms, you’ll be better equipped to navigate the evolving biotech world—and thrive in a sector that’s reshaping our future.

Biotechnology Leadership for Managers: Strategies to Motivate, Mentor, and Set Realistic Goals in Research-Driven Teams

Biotechnology—spanning everything from gene editing to vaccine development—plays an increasingly pivotal role in shaping our global future. As breakthroughs in molecular biology, genomics, and bioinformatics cascade into real-world applications, the ability to lead high-performing biotech teams has never been more critical. Today’s biotech leaders must combine scientific literacy, strategic thinking, and people-focused management to drive innovation while meeting stringent regulatory and ethical standards. This article provides actionable insights into how biotech managers can motivate, mentor, and set achievable milestones for research-focused teams. Whether you are spearheading cutting-edge R&D, managing clinical trials, or overseeing large-scale production in a pharmaceutical environment, the strategies outlined here will help you foster a culture of innovation and excellence within your organisation.

10 Best Biotech Books for UK Job Seekers: Boost Your Biotechnology Career in 2025

The biotechnology industry is booming, fuelled by advancements in genomics, synthetic biology, regenerative medicine, and countless other cutting-edge fields. With the UK emerging as a major global biotech hub—spanning sectors like healthcare, agriculture, and environmental science—there has never been a better time to develop the skills and knowledge necessary to thrive in this dynamic sector. Whether you’re a recent graduate or a seasoned scientist, staying updated with the right resources can dramatically enhance your career prospects. In this blog post, we present ten must-read books that offer deep insights into the foundational concepts, practical techniques, and forward-thinking innovations shaping biotechnology today. By reading and internalising the wisdom of these texts, you’ll be better equipped to navigate job interviews, tackle complex projects, and excel in roles throughout the biotech landscape.