← Dwarkesh Podcast

Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFold

第2024-02-28期2024-02-28English会员内容

嘉宾:Demis Hassabis

收听本集00:00 / 1:01:34
阅读设置
按你的习惯阅读
正文字号
下载播客精读
把这一篇,带走慢慢读

英文 · 精读 · 当前版本

下载功能还未开放

正文语言

精读 · 按主题梳理核心观点、论证与案例。

§01Intelligence, transfer, and search beyond language models

Hassabis sees intelligence as broad enough to suggest shared high-level algorithms beneath specialized brain functions. He says improvements in one LLM domain can sometimes transfer to another—for example, coding gains may improve general reasoning—while cautioning that the evidence remains limited. He compares this with humans specializing through practice while relying on general learning systems. His neuroscience perspective informs research directions such as reinforcement learning, experience replay, and attention, but he emphasizes inspiration rather than a one-to-one mapping between brains and engineered systems.

For combining LLMs with planning, Hassabis argues that large models could provide a prior or world model, while AlphaZero-like search on top could explore possible actions and construct plans. He regards this as promising but not sufficient by itself: systems need accurate, reliable models of the world and mechanisms to use them toward explicit goals. Search can be expensive, but he contrasts AlphaZero's tens of thousands of candidate positions with traditional chess engines that might examine millions, and with human champions who consider only hundreds. Better world models can reduce the search needed for strong decisions.

Hassabis is optimistic that self-play and synthetic data can help with data bottlenecks, though he says generating general-purpose world data is harder than generating experience in games. He points to AlphaGo and AlphaZero learning by playing themselves and building knowledge from their own mistakes. He also says data curation and analysis remain immature: researchers need to identify gaps in training distributions and target synthetic generation there. The discussion acknowledges that such methods are promising but does not establish how well they will transfer to open-ended real-world tasks.

好对话,值得读完整。

免费试读到此结束。开通书架会员,继续阅读全文,解锁中英对照与电子书下载。