Empirical

Streams in this track include hands-on research using machine- learning experiments to understand and improve model safety including AI control, interpretability, scalable oversight, evaluations, red-teaming, and robustness. This track is defined by its methods rather than any single research agenda. If your primary tool is ML engineering, this is the track for you.

Application process

  • Stage 1: Complete the general application
  • Stage 2, phase 1: Complete 1–2 assessments evaluating research taste and technical implementation skills, alongside possibly reference requests
  • Stage 2, phase 2: Stream selection questions
  • Stage 3: Interviews and work-tests

Empirical track overview

The track is defined by its methodology more than by any single research agenda. Fellows run ML experiments to understand and improve the safety properties of frontier models, with work spanning interpretability, AI control, scalable oversight, evaluations, red-teaming, robustness, and model organisms of misalignment. The unifying thread is that progress comes from hands-on work with real models (training, probing, fine-tuning, measuring, etc.) rather than reasoning from first principles alone. This is the largest track in the program and the most common entry point into technical AI safety research.

We are looking for fellows whose primary tool is ML engineering, broadly construed. The essential requirement is the ability to design and run experiments on language models or other deep learning systems and iterate quickly on the results. In practice, that usually means having a solid understanding of Python (with and without AI coding tools), being comfortable with the infrastructure around running models at moderate scale, and knowing which experiments are worth running. Mission alignment is highly important, and fellows should be able to say why a given line of empirical work meaningfully reduces frontier risk, not just whether it yields a successful publication. Educational background and seniority are weighted lightly here relative to other tracks. Past cohorts have included strong fellows ranging from undergraduates to senior industry researchers.

Fellows are matched to mentors based on fit, and projects are scoped to produce concrete artifacts (i.e., papers, evaluation suites, open-source tooling, or technical reports) by the end of the program. The target audiences for the work produced in this track would include safety and alignment teams at frontier labs, governments and other evaluation organizations, and the broader ML research community.

If you are excited by this kind of work, we encourage you to apply.

Empirical track streams

We are interested in AI control and scalable oversight. I'm excited to work with scholars interested in empirical projects building and evaluating control measures and oversight techniques for LLM agents, especially those based on chain of thought monitoring. I'm also interested in the science of chain of thought monitorability, misalignment and control. An ideal project ends with a paper submitted to NeurIPS/ICML/ICLR.

Read more
Mentorship structure
Desired fellow characteristics
Project selection process

We build scalable technology for AI understanding and oversight.

Read more
Mentorship structure
Desired fellow characteristics
Project selection process

This stream will focus on evaluating dangerous capabilities in language models and detecting deception and dishonesty.

Read more

The team's focus is on stress-testing model alignment to detect and understand model propensities relevant to loss-of-control risks, and includes work on building realistic alignment evaluations, measuring and mitigating evaluation awareness, inferring hidden propensities and developing automated algorithms to search for misalignment behaviour. We perform pre-deployment alignment testing across frontier AI companies. See e.g.:

Read more
Mentorship structure
Desired fellow characteristics
Project selection process

Conceptual research on deceptive alignment, designing realistic scheming propensity evaluations and honeypots. The stream will run in person in London, with scholars working together as a team.

Read more
Mentorship structure
Desired fellow characteristics
Project selection process

Frequently asked questions

What is the MATS Program?
Who are the MATS Mentors?
What are the key dates of the MATS Program?
Who is eligible to apply?
How does the application and mentor selection process work?