← Lenny's Podcast: Product | Career | Growth

Inside the expert network training every frontier AI model | Garrett Lord (Handshake CEO)

第2025-08-24期2025-08-24English会员内容

嘉宾:Garrett Lord

Inside the expert network training every frontier AI model | Garrett Lord (Handshake CEO)
收听本集00:00 / 1:09:50
阅读设置
按你的习惯阅读
正文字号
下载播客精读
把这一篇,带走慢慢读

英文 · 精读 · 当前版本

下载功能还未开放

正文语言

精读 · 按主题梳理核心观点、论证与案例。

§01Why frontier models increasingly need expert data

Garrett Lord describes Handshake AI as a new business built on Handshake's decade-old student and early-career network. Lenny frames the opportunity as a company using an existing distribution advantage to create new data for model improvement, while Lord argues that access to an engaged expert audience is the central moat in human data. He says Handshake reaches 18 million professionals, including 500,000 PhDs and 3 million master's students, and that this audience lets the company target expertise rather than recruit anonymous workers one by one. These figures and the business trajectory are claims made in the conversation, not independently verified evidence in the episode.

The interview's main technical distinction is between pre-training and post-training. Lord says pre-training absorbed enormous collections of human-created material, including books, videos, and other internet data, while recent gains increasingly come from post-training. In his account, post-training means collecting targeted, high-quality examples in capabilities such as coding, mathematics, law, and finance, then testing hypotheses about which data improves a model. The examples can include reinforcement-learning environments, tool-use trajectories, multimodal material, prompt-response pairs, and preference rankings from human feedback. He presents this as an evolving experimental process rather than a single labeling task, and does not claim that all model progress has stopped on the pre-training side.

Lord explains Handshake's role as supplying people who can expose failures that ordinary users may not find. A physics PhD can probe several subfields, identify an error in a model's reasoning, distinguish a wrong final answer from a wrong path to that answer, and test whether the model can use tools or follow a procedure. The value is therefore not only producing a correct answer. It is finding difficult failure cases and creating the evidence needed to improve a specific capability. Lord also says the market has shifted from generalist labor doing basic tasks toward specialists who can work in advanced science, mathematics, medicine, law, finance, and other domains. That claim describes his view of current demand; the discussion does not quantify how much of the wider labeling market has actually made that transition.

好对话,值得读完整。

免费试读到此结束。开通书架会员,继续阅读全文,解锁中英对照与电子书下载。