战略与预测方向关注先进 AI 带来的长期问题,包括 AI 发展时间线、地缘政治竞争,以及后 AGI 时代的制度走向。随着能力快速提升,人们往往在信息有限、缺乏充分实证或广泛共识的情况下作出关键决定。应对这些挑战需要结构化预测、情景分析、地缘政治建模和宏观战略思维。
本方向聚焦宏观战略:理解向先进 AI 过渡的过程、机构与社会如何适应高能力 AI 系统,以及今天采取哪些行动最有助于改善长期结果。有些研究流侧重结构化预测,尤其是对 AI 能力、发展时间线、算力和经济影响开展定量研究;另一些则侧重情景分析与建模,研究前沿实验室动态、地缘政治竞争、国家行为、转型情景和桌面推演。
这些预测与模型可用于分析有哪些政策选项能够影响 AGI 或后 AGI 时代的发展轨迹、这些选项的成本与收益,以及今天的选择如何扩大或缩小未来决策者可用的选项范围。本方向可能研究先进 AI 将如何、为何、何时及在何地推动工业生产、军事战术和科学研究迅速变化,以及这些变化对地缘政治、民主和资本主义产生的次级影响。
本方向的研究员需要能够在不确定条件下进行推断、提出概率性判断,并清晰撰写证据有限的问题。跨学科研究经验或兴趣很有帮助,因为许多问题都涉及社会某个领域的变化如何影响其他领域。以往的优秀申请者来自预测研究、经济学、历史、哲学、政治学、国际关系、计算机科学、安全研究和定量社会科学等领域。
我们会根据契合度为研究员匹配导师,并规划项目,使其在项目结束前产出具体成果,例如预测报告、情景分析、政策备忘录、战略分析和同行评审研究。本方向的成果面向实验室战略与政策团队、AISI 工作人员、国家安全分析人员、长期决策相关的资助方和政策制定者,以及更广泛的预测、治理和 AI 安全社区。
We are interested in mentoring projects in AI forecasting, governance, and strategy. We want to improve the epistemic environment around thinking about AI risk by putting out concrete scenarios, exploring different dynamics and worlds that might happen, trying to forecast how things will go, and sometimes talking about how to deal with the risks. We hope that having better resources for thinking about the future will lead to better outcomes.
We will have meetings each week to check in and discuss next steps. We will be consistently available on Slack in between meetings to discuss your research, project TODOs, etc.
The most important characteristics include:
We will talk through project ideas with scholar
We aim to generalize tools for analyzing the dynamics of large-scale agency and power, such as public choice theory, to the setting in which machine minds are competitive with humans.
We're open to all backgrounds. Our ideal candidate might look something like Robin Hanson or David Friedman - a polymath who is comfortable both with analytical tools (e.g. from economics) and with extensive knowledge of real human history, institutions, and the pressures under which populations, cultures, states, and organizations of all sorts evolve.
This stream focuses on how advanced AI could enable new and dangerous bio technologies, and on assessing when risks become tractable or urgent as those capabilities arrive.
Half-hour one-on-one weekly meetings by default, with the option to extend or add ad-hoc calls when useful. I'm active on Slack and typically respond within a day for quick questions. I'm happy to read drafts and leave written feedback async between meetings.
Preferred:
I'll talk with the fellow about what they're interested in, and we'll pick a broad area together from a few directions I'd want to pitch. From there we'll work together to scope something sharp and well-defined, with me leaning on my sense of what's tractable and high-value. The fellow then runs with the project, and we adjust as it develops.
My stream focuses on preserving checks and balances as governments adopt increasingly powerful AI. Fellows will work on questions like how Congress can maintain oversight of an AI-accelerated executive branch (including via privacy-preserving AI auditors) and what a positive vision for government AI adoption looks like. Projects will typically produce a public report and sometimes involve engaging directly with policymakers and other stakeholders.
This stream focuses on identifying tractable policy and technical interventions to gradual disempowerment, focusing on economic disempowerment and the intelligence curse. Possible project areas include:
We’ll meet 1:1 for 30 minute slots twice a week, once with each mentor. We’ll be active on Slack (default to over-slacking us), and can do quick ad-hoc calls as well. Once a week, we expect you to have some artifact that we will give feedback on.
We're excited about applications from a variety of backgrounds. Use the list below as general guidance, not as an exhaustive list.
Essential:
We provide three projects as options we are excited about, but they are not inclusive of all ideas. During the application process, we will ask potential mentees to either a) sharpen these proposals into a more specific question incorporating their own interests, or b) propose their own projects.
We expect fellows to come in with inner conviction towards a starting point that fits within the above themes, and expect that the best work in this stream will come from self-directed fellows pursuing their own research taste. However, we will require sign off to pursue a project and may require fellows to shift scope if they move outside the target area.
MATS 项目是一项为期 10 周的研究奖学金计划,旨在培养和支持从事人工智能对齐、透明度和安全领域工作的新兴研究人员。研究员将与世界一流的导师合作,获得专门的研究管理支持,并加入位于伯克利、致力于推动人工智能安全与可靠发展的活跃社区。该项目提供开展高影响力研究并开启人工智能安全领域长期职业生涯所需的架构、资源和指导。
MATS 导师均为来自人工智能安全、对齐、治理、领域建设及安全等广泛领域的顶尖研究人员。他们包括学术界人士、行业研究员以及独立专家,负责指导学者开展研究项目、提供反馈,并助力每位学者的研究成长。导师们的专业领域涵盖:
查看 往届及现任导师
关键日期
申请:
主项目将于 9 月 28 日至 12 月 4 日进行,获选研究员的延展阶段将于 12 月开始。
MATS 欢迎来自不同学术和专业背景的申请者——从机器学习、数学和计算机科学,到政策、经济学、物理学、认知科学、生物学和公共卫生,同时也欢迎没有传统研究背景的创业者、运营人员和领域建设者。主要要求是具备为人工智能安全做出贡献的强烈动机,并展现出技术能力、研究潜力或相关的运营经验。具备人工智能安全相关经验会有所帮助,但并非必要条件。