Sydney Von Arx

I work on adversarial stress-testing at METR. Fellows in this stream will build model organisms of misalignment that require real cognition to decide whether to misbehave, then test which detection methods actually catch them, with the goal of turning whatever works into an alignment evaluation we can run on real models.

Stream overview

I work on adversarial stress-testing at METR. The projects I am most excited about right now:

  • Detecting misaligned cognition in model organisms. We will have a suite of model organisms that require substantial cognition to determine whether or not to misbehave, alongside matched controls. The work is to apply existing detection methods and variants of them (reading chain-of-thought, out-of-distribution detection with probes, off-policy probes for things like "reasoning about the input", and fuzzing) and find out what actually catches these models. A hard constraint is that the auditor is never allowed to trigger the misbehavior: every input it uses must avoid the trigger, and it must still detect the cognition. The goal is to build an alignment evaluation on top of what works and apply it to real models.
  • Benchmarking the capability to scheme undetected. Building a benchmark for the level of reasoning a model would have to be capable of in order to scheme without getting caught.

Mentors

Sydney Von Arx
Nightingale
,
Technical Staff
SF Bay Area
Misalignment Science
AI Control and Monitoring
Capability and Propensity Evaluations

Sydney works on adversarial stress-testing at METR. She studied computational biology at Stanford and co-founded the Atlas Fellowship.

Read more

Mentorship style

Fellows we are looking for

Project selection

Streams

The Winter 2026 cohort offers a wide range of research streams led by experts across AI alignment, interpretability, governance, and safety. Each stream provides its own research agenda, methodology, and mentorship focus.

Systems Security
Systems Security
SF Bay Area
Empirical
London
Empirical
SF Bay Area
Empirical
SF Bay Area
Empirical
SF Bay Area
Founding and Field-Building
Systems Security
Washington, D.C.
Policy and Governance
SF Bay Area
Founding and Field-Building
Biosecurity
London
Theory
London
Empirical
SF Bay Area
Empirical
Theory
SF Bay Area
Strategy and Forecasting
Policy and Governance
No items found.
SF Bay Area
Founding and Field-Building
London
Biosecurity
Washington, D.C.
Biosecurity
Empirical
London
Empirical
London
Empirical