← Dwarkesh Podcast

Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFold

Episode 2024-02-282024-02-28EnglishMembers only

Guests: Demis Hassabis

Listen to this episode00:00 / 1:01:34
Reading settings
Reading preferences
Text size
Download in-depth read
Read offline

English · In-depth read · Current version

Downloads are not available yet.

Text language

In-depth read · Key ideas, reasoning, and examples, organized by topic.

§01Intelligence, transfer, and search beyond language models

Hassabis sees intelligence as broad enough to suggest shared high-level algorithms beneath specialized brain functions. He says improvements in one LLM domain can sometimes transfer to another—for example, coding gains may improve general reasoning—while cautioning that the evidence remains limited. He compares this with humans specializing through practice while relying on general learning systems. His neuroscience perspective informs research directions such as reinforcement learning, experience replay, and attention, but he emphasizes inspiration rather than a one-to-one mapping between brains and engineered systems.

For combining LLMs with planning, Hassabis argues that large models could provide a prior or world model, while AlphaZero-like search on top could explore possible actions and construct plans. He regards this as promising but not sufficient by itself: systems need accurate, reliable models of the world and mechanisms to use them toward explicit goals. Search can be expensive, but he contrasts AlphaZero's tens of thousands of candidate positions with traditional chess engines that might examine millions, and with human champions who consider only hundreds. Better world models can reduce the search needed for strong decisions.

Hassabis is optimistic that self-play and synthetic data can help with data bottlenecks, though he says generating general-purpose world data is harder than generating experience in games. He points to AlphaGo and AlphaZero learning by playing themselves and building knowledge from their own mistakes. He also says data curation and analysis remain immature: researchers need to identify gaps in training distributions and target synthetic generation there. The discussion acknowledges that such methods are promising but does not establish how well they will transfer to open-ended real-world tasks.

Keep reading as a member.

You've read the free preview. Become a member to read the rest, with side-by-side reading and downloads where available.