← Lex Fridman

Sebastian Thrun: Flying Cars, Autonomous Vehicles, and Education

第2019-12-21期2019-12-21English

嘉宾:Sebastian Thrun

收听本集00:00 / 1:19:01
阅读设置
按你的习惯阅读
正文字号
下载播客精读
把这一篇,带走慢慢读

精读待补充

下载功能还未开放

§01Transcript · 00:00–08:04

00:00The following is a conversation with Sebastian Thrun.

00:03He's one of the greatest roboticists,

00:05computer scientists, and educators of our time.

00:08He led the development of the autonomous vehicles

00:10at Stanford that won the 2005 DARPA Grand Challenge

00:14and placed second in the 2007 DARPA Urban Challenge.

00:18He then led the Google Self-Driving Car Program

00:20which launched the self-driving car revolution.

00:24He taught the popular Stanford course

00:26on artificial intelligence in 2011,

00:29which was one of the first massive open online courses

00:32or MOOCs as they're commonly called.

00:35That experience led him to co-found Udacity,

00:37an online education platform.

00:39If you haven't taken courses on it yet,

00:41I highly recommend it.

00:43Their self-driving car program, for example, is excellent.

00:47He's also the CEO of Kitty Hawk,

00:49a company working on building flying cars

00:53or more technically EVTOLs,

00:54which stands for electric vertical takeoff

00:56and landing aircraft.

00:58He has launched several revolutions

01:00and inspired millions of people,

01:02but also, as many know, he's just a really nice guy.

01:06It was an honor and a pleasure to talk with him.

01:10This is the Artificial Intelligence Podcast.

01:12If you enjoy it, subscribe on YouTube,

01:15give it five stars on Apple Podcasts,

01:17follow it on Spotify, support it on Patreon,

01:19or simply connect with me on Twitter

01:21at Lex Friedman, spelled F-R-I-D-M-A-N.

01:25If you leave a review on Apple Podcasts

01:27or YouTube or Twitter, consider mentioning ideas,

01:30people, topics you find interesting.

01:32It helps guide the future of this podcast.

01:35But in general, I just love comments

01:38with kindness and thoughtfulness in them.

01:40This podcast is a side project for me, as many people know,

01:43but I still put a lot of effort into it.

01:45So the positive words of support

01:47from an amazing community, from you, really help.

01:52I recently started doing ads at the end of the introduction.

01:55I'll do one or two minutes after introducing the episode

01:58and never any ads in the middle

01:59that can break the flow of the conversation.

02:01I hope that works for you

02:03and doesn't hurt the listening experience.

02:05I provide timestamps for the start of the conversation

02:08that you can skip to, but it helps if you listen to the ad

02:11and support this podcast by trying out the product

02:13or service being advertised.

02:15This show is presented by Cash App,

02:18the number one finance app in the App Store.

02:21I personally use Cash App to send money to friends,

02:24but you can also use it to buy, sell,

02:25and deposit Bitcoin in just seconds.

02:28Cash App also has a new investing feature.

02:31You can buy fractions of a stock, say $1 worth,

02:34no matter what the stock price is.

02:36Brokerage services are provided by Cash App Investing,

02:39a subsidiary of Square and member SIPC.

02:42I'm excited to be working with Cash App

02:44to support one of my favorite organizations called FIRST,

02:47best known for their FIRST robotics and Lego competitions.

02:51They educate and inspire hundreds of thousands of students

02:54in over 110 countries

02:56and have a perfect rating on Charity Navigator,

02:59which means the donated money

03:00is used to maximum effectiveness.

03:03When you get Cash App from the App Store or Google Play

03:06and use code LEXPODCAST, you'll get $10

03:09and Cash App will also donate $10 to FIRST,

03:12which again is an organization

03:13that I've personally seen inspire girls and boys

03:16to dream of engineering a better world.

03:19And now, here's my conversation with Sebastian Thrun.

03:24You've mentioned that "The Matrix"

03:26may be your favorite movie.

03:29So let's start with a crazy philosophical question.

03:32Do you think we're living in a simulation?

03:34And in general, do you find the thought experiment

03:37interesting?

03:40- Define simulation, I would say.

03:42Maybe we are, maybe we are not,

03:43but it's completely irrelevant to the way we should act.

03:47Putting aside for a moment,

03:49the fact that it might not have any impact

03:52on how we should act as human beings,

03:54for people studying theoretical physics,

03:57these kinds of questions might be kind of interesting,

03:59looking at the universe as a information processing system.

04:03- Universe is an information processing system.

04:05It's a huge physical, biological, chemical computer.

04:08There's no question.

04:09But I live here and now.

04:12I care about people, I care about us.

04:15What do you think is trying to compute?

04:17- I don't think there's an intention.

04:18I think it's just the world evolves the way it evolves,

04:22and it's beautiful, it's unpredictable,

04:25and I'm really, really grateful to be alive.

04:28- Spoken like a true human.

04:29- Which last time I checked I was.

04:32- Well, in fact, this whole conversation

04:35is just a Turing test to see if indeed you are.

04:39You've also said that one of the first programs

04:42or the first few programs you've written

04:45was, wait for it, TI-57 calculator.

04:49- Yeah.

04:50- Maybe that's early '80s.

04:52I don't wanna date calculators or anything.

04:54- That's early '80s, correct.

04:55- Yeah.

04:56So if you were to place yourself back into that time,

04:59into the mindset you were in,

05:02could you have predicted the evolution of computing,

05:05AI, the internet, technology, in the decades that followed?

05:10- I was super fascinated by Silicon Valley,

05:13which I'd seen on television once and thought,

05:15my God, this is so cool.

05:16They build like DRAMs there and CPUs.

05:19How cool is that?

05:20And as a college student a few years later,

05:23I decided to really study intelligence

05:25and study human beings and found that,

05:28even back then in the '80s and '90s,

05:30that artificial intelligence

05:31is what fascinated me the most.

05:33What's missing is that back in the day,

05:35the computers are really small.

05:37They're like the brains you could build

05:39were not anywhere bigger than a cockroach,

05:41and cockroaches aren't very smart.

05:43So we weren't at the scale yet where we are today.

05:46- Did you dream at that time

05:48to achieve the kind of scale we have today?

05:51Or did that seem possible?

05:52- I always wanted to make robots smart.

05:54I felt it was super cool to build an artificial human.

05:57And the best way to build an artificial human

05:59would have been a robot,

06:00because that's kind of the closest we could do.

06:03Unfortunately, we aren't there yet.

06:04The robots today are still very brittle.

06:07But it's fascinating to study intelligence

06:09from a constructive perspective

06:10where you build something.

06:12- To understand you build,

06:15what do you think it takes to build an intelligent system

06:19and an intelligent robot?

06:20- I think the biggest innovation

06:22that we've seen is machine learning.

06:23And it's the idea that the computers

06:26can basically teach themselves.

06:27Let's give an example.

06:29I'd say everybody pretty much knows how to walk.

06:33And we learn how to walk in the first year or two

06:35of our lives.

06:36But no scientist has ever been able

06:38to write down the rules of human gait.

06:41We don't understand it.

06:42We have it in our brains somehow.

06:44We can practice it.

06:45We understand it.

06:46But we can't articulate it.

06:47We can't pass it on by language.

06:50And that to me is kind of the deficiency

06:52of today's computer programming.

06:53When you program a computer,

06:55they're so insanely dumb

06:56that you have to give them rules for every contingencies.

06:59Very unlike the way people learn

07:01but learn from data and experience,

07:03computers are being instructed.

07:05And because it's so hard to get this instruction set right,

07:07you pay software engineers $200,000 a year.

07:11Now, the most recent innovation,

07:13which has been to make for like 30, 40 years,

07:15is an idea that computers can find their own rules.

07:18So they can learn from falling down and getting up

07:20the same way children can learn

07:21from falling down and getting up.

07:23And that revolution has led to a capability

07:26that's completely unmatched.

07:28Today's computers can watch experts do their jobs,

07:31whether you're a doctor or a lawyer,

07:33pick up the regularities, learn those rules,

07:36and then become as good as the best experts.

07:39- So the dream of in the '80s of expert systems,

07:41for example, had at its core the idea

07:44that humans could boil down their expertise

07:47on a sheet of paper.

07:49So to sort of reduce, sort of be able to explain to machines

07:53how to do something explicitly.

07:55So do you think, what's the use of human expertise

07:59into this whole picture?

08:00Do you think most of the intelligence

08:01will come from machines learning from experience

08:04without human expertise input?

§02Transcript · 08:06–16:18

08:06- So the question for me is much more

08:08how do you express expertise?

08:10You can express expertise by writing a book.

08:12You can express expertise by showing someone

08:15what you're doing.

08:16You can express expertise by applying it

08:18by many different ways.

08:20And I think the expert systems was our best attempt in AI

08:23to capture expertise and rules.

08:25But someone sat down and say,

08:27"Here are the rules of human gait.

08:28"Here's when you put your big toe forward

08:31"and your heel backwards and here how you stop stumbling."

08:34And as we now know, the set of rules,

08:37the set of language that we can command

08:39is incredibly limited.

08:41The majority of the human brain doesn't deal with language.

08:43It deals with like subconscious numerical perceptual things

08:48that we don't even, that we're self aware of.

08:50Now, when a AI system watches an expert do their job

08:55and practice their job,

08:57it can pick up things that people can't even put into

09:01writing into books or rules.

09:03And that's where the real power is.

09:04We now have AI systems that, for example,

09:07look over the shoulders of highly paid human doctors

09:10like dermatologists or radiologists,

09:12and they can somehow pick up those skills

09:15that no one can express in words.

09:16- So you were a key person in launching three revolutions,

09:22online education, autonomous vehicles,

09:25and flying cars or VTOLs.

09:28So high level,

09:30and I apologize for all the philosophical questions.

09:35- No apology necessary.

09:36- How do you choose what problems to try and solve?

09:40What drives you to make those solutions a reality?

09:43- I have two desires in life.

09:44I wanna literally make the lives of others better.

09:48Or as we often say,

09:50maybe jokingly, make the world a better place.

09:52I actually believe in this.

09:54It's as funny as it sounds.

09:56And second, I wanna learn.

09:59I wanna get in the skillset.

10:00I don't wanna be in a job I'm good at,

10:01because if I'm in a job that I'm good at,

10:04the chances for me to learn something interesting

10:05is actually minimized.

10:06So I wanna be in a job I'm bad at.

10:08That's really important to me.

10:10So in a build, for example,

10:11what people often call flying cars,

10:12these are electrical, vertical,

10:14takeoff and landing vehicles.

10:16I'm just no expert in any of this.

10:19And it's so much fun to learn on the job

10:22what it actually means to build something like this.

10:24Now I'd say the stuff that I've done lately

10:27after I finished my professorship at Stanford,

10:31they really focused on like what has the maximum impact

10:33on society.

10:34Like transportation is something that has transformed

10:37the 21st or 20th century more than any other invention,

10:40in my opinion, even more than communication.

10:42And cities are different, workers different,

10:45women's rights are different because of transportation.

10:47And yet we still have a very suboptimal

10:50transportation solution where we kill 1.2

10:54or so million people every year in traffic.

10:57It's like the leading cause of death

10:58for young people in many countries,

11:01where we are extremely inefficient resource wise,

11:03just go to your average neighborhood city

11:06and look at the number of parked cars,

11:08that's a travesty in my opinion,

11:10or where we spend endless hours in traffic jams.

11:13And very, very simple innovations like a self-driving car

11:16or what people call a flying car

11:18could completely change this.

11:20And it's there, I mean, the technology is basically there.

11:23You have to close your eyes not to see it.

11:25- So lingering on autonomous vehicles,

11:29a fascinating space, some incredible work

11:32you've done throughout your career there.

11:33So let's start with DARPA, I think,

11:38the DARPA challenge through the desert

11:40and then urban to the streets.

11:42I think that inspired an entire generation of roboticists

11:45and obviously sprung this whole excitement

11:49about this particular kind of four wheeled robots

11:52we called autonomous cars, self-driving cars.

11:55So you led the development of Stanley,

11:58the autonomous car that won the race to the desert,

12:01the DARPA challenge in 2005.

12:03And Junior, the car that finished second

12:07in the DARPA urban challenge,

12:09also did incredibly well in 2007, I think.

12:13What are some painful, inspiring

12:16or enlightening experiences from that time

12:19that stand out to you?

12:20- Oh my God, painful were all these incredibly complicated,

12:25stupid bugs that had to be found.

12:30We had a phase where Stanley,

12:33our car that eventually won the DARPA urban challenge

12:36would every 30 miles just commit suicide

12:39and we didn't know why.

12:40And it ended up to be that in the syncing

12:43of two computer clocks, occasionally a clock went backwards

12:47and that negative time elapsed,

12:50screwed up the entire internal logic,

12:51but it took ages to find this.

12:54It were like bugs like that.

12:56I'd say enlightening is the Stanford team

12:59immediately focused on machine learning and on software,

13:02whereas everybody else seemed to focus

13:03on building better hardware.

13:05Our analysis had been a human being

13:07with an existing rental car can perfectly drive the course.

13:10Why do I have to build a better rental car?

13:12I just should replace the human being.

13:14And the human being to me was a conjunction of three steps.

13:18We had sensors, eyes and ears, mostly eyes.

13:22We had brains in the middle

13:23and then we had actuators, our hands and our feet.

13:26Now the actuators are easy to build.

13:28The sensors are actually also easy to build.

13:29What was missing was the brain.

13:30So we had to build a human brain

13:32and nothing clear then to me

13:35that the human brain is a learning machine.

13:36So why not just train our robot?

13:38So we would build massive machine learning into our machine.

13:42And with that, we're able to not just learn

13:44from human drivers, we had the entire speed control

13:47of the vehicle was copied from human driving,

13:49but also have the robot learn from experience

13:51where it made a mistake and go to recover from it

13:53and learn from it.

13:55- You mentioned the pain point of software and clocks.

14:00Synchronization seems to be a problem

14:04that continues with robotics.

14:06It's a tricky one with drones and so on.

14:08What does it take to build a thing,

14:13a system with so many constraints?

14:16You have a deadline, no time.

14:20You're unsure about anything really.

14:22It's the first time that people really even explore.

14:24It's not even sure that anybody can finish

14:26when we're talking about the race

14:28of the desert the year before nobody finished.

14:30What does it take to scramble and finish a product

14:33that actually, a system that actually works?

14:35- I mean, we were very lucky.

14:36We were a really small team.

14:38The core of the team were four people.

14:40It was four because five couldn't comfortably sit

14:43inside a car, but four could.

14:45And I, as a team leader, my job was to get pizza

14:47for everybody and wash the car and stuff like this

14:51and repair the radiator when it broke

14:52and debug the system.

14:55And we were very kind of open-minded.

14:56We had like no egos involved in this.

14:58We just wanted to see how far we can get.

15:00What we did really, really well was time management.

15:03We were done with everything a month before the race.

15:06And we froze the entire software a month before the race.

15:08And it turned out, looking at other teams,

15:11every other team complained if they had just one more week,

15:14they would have won.

15:15And we decided, we're not gonna fall into that mistake.

15:18We're gonna be early.

15:19And we had an entire month to shake the system.

15:22And we actually found two or three minor bugs

15:24in the last month that we had to fix.

15:27And we were completely prepared when the race occurred.

15:30- Okay, so first of all,

15:30that's such an incredibly rare achievement

15:34in terms of being able to be done on time or ahead of time.

15:38What do you, how do you do that in your future work?

15:43What advice do you have in general?

15:44Because it seems to be so rare,

15:46especially in highly innovative projects like this.

15:49People work till the last second.

15:50- Well, the nice thing about the Dark Background Challenge

15:52is that the problem was incredibly well-defined.

15:55We were able for a while

15:56to drive the old Dark Background Challenge course,

15:58which had been used the year before.

16:00And then at some reason, we were kicked out of the region.

16:04So we had to go to different deserts, the Snorren Desert,

16:06and we were able to drive desert trails

16:08just at the same time.

16:10So there was never any debate about,

16:12like, what is actually the problem?

16:13We didn't sit down and say,

16:14"Hey, should we build a car or a plane?"

16:16We had to build a car.

16:18That made it very, very easy.

§03Transcript · 16:20–23:55

16:20Then I studied my own life and life of others

16:23and realized that the typical mistake that people make

16:26is that there's this kind of crazy bug left

16:29that they haven't found yet.

16:31And it's just, they regret it.

16:34And the bug would have been trivial to fix.

16:36They just haven't fixed it yet.

16:37They didn't want to fall into that trap.

16:39So I built a testing team.

16:41We had a testing team that built a testing booklet

16:43of 160 pages of tests we had to go through

16:46just to make sure we shake out the system appropriately.

16:49- Wow.

16:49- And the testing team was with us all the time

16:51and dictated to us,

16:53today we do railroad crossings,

16:55tomorrow we do, we practice the start of the event.

16:58And in all of these, we thought,

17:00"Oh my God, this long solve trivial."

17:02And then we tested it out.

17:03"Oh my God, it doesn't do a railroad crossing, why not?

17:05"Oh my God, it mistakes the rails for metal barriers.

17:09"Shit, we have to fix this."

17:10- Yes.

17:11- So it was really a continuous focus

17:14on improving the weakest part of the system.

17:16And as long as you focus

17:18on improving the weakest part of the system,

17:20you eventually build a really great system.

17:23- Let me just pause in that.

17:24To me as an engineer, it's just super exciting

17:27that you were thinking like that,

17:28especially at that stage as brilliant

17:30that testing was such a core part of it.

17:33It may be to linger on the point of leadership.

17:35I think it's one of the first times you were really a leader

17:41and you've led many very successful teams since then.

17:45What does it take to be a good leader?

17:48- I would say most of all, just take credit

17:50for the work of others.

17:54That's very convenient, turns out,

17:57'cause I can't do all these things myself.

18:00I'm an engineer at heart, so I care about engineering.

18:03So I don't know what the chicken and the egg is,

18:06but as a kid, I loved computers

18:07because you could tell them to do something

18:09and they actually did it.

18:10It was very cool.

18:11And you could like in the middle of the night,

18:12wake up at one in the morning and switch on your computer.

18:15And what you told you to yesterday, it would still do.

18:18That was really cool.

18:19Unfortunately, that didn't quite work with people.

18:21So you go to people and tell them what to do

18:22and they don't do it and they hate you for it.

18:25Or you do it today and then they go a day later

18:28and they stop doing it.

18:29So you have to...

18:30So then the question really became,

18:31how can you put yourself in the brain of people

18:34as opposed to computers?

18:35And in terms of computers, that's super dumb.

18:37That's so dumb.

18:38If people were as dumb as computers,

18:39I wouldn't wanna work with them.

18:41But people are smart and people are emotional

18:43and people have pride and people have aspirations.

18:45So how can I connect to that?

18:48And that's the thing where most of our leadership just fails

18:52because many, many engineers turn manager

18:56believe they can treat their team just the same

18:58way they can treat your computer

18:59and it just doesn't work this way.

19:00It's just really bad.

19:02So how can I connect to people?

19:05And it turns out as a college professor,

19:07the wonderful thing you do all the time

19:09is to empower other people.

19:10Like your job is to make your students look great.

19:14That's all you do.

19:15You're the best coach.

19:16And it turns out if you do a fantastic job

19:18with making your students look great,

19:20they actually love you and their parents love you.

19:22And they give you all the credit

19:23for stuff you don't deserve.

19:24Turns out all my students were smarter than me.

19:27All the great stuff invented at Stanford

19:28was their stuff, not my stuff.

19:30And they give me credit and say,

19:31oh, Sebastian, we're just making them

19:33feel good about themselves.

19:35So the question really is, can you take a team of people

19:38and what does it take to make them,

19:40to connect to what they actually want in life

19:43and turn this into productive action?

19:45It turns out every human being that I know

19:48has incredibly good intentions.

19:50I've really rarely met a person with bad intentions.

19:53I believe every person wants to contribute.

19:55I think every person I've met wants to help others.

19:59It's amazing how much of a urge we have

20:01not to just help ourselves, but to help others.

20:04So how can we empower people

20:05and give them the right framework

20:07that they can accomplish this?

20:09In moments when it works, it's magical

20:12because you'd see the confluence of people

20:17being able to make the world a better place

20:19and just having enormous confidence and pride out of this.

20:22And that's when my environment works the best.

20:27These are moments where I can disappear for a month

20:29and come back and things still work.

20:31It's very hard to accomplish,

20:32but when it works, it's amazing.

20:35- So I agree with you very much.

20:37It's not often heard that most people in the world

20:42have good intentions.

20:43At the core, their intentions are good

20:45and they're good people.

20:47That's a beautiful message.

20:48It's not often heard.

20:50- We make this mistake,

20:51and this is a friend of mine, Alex Voda,

20:53talking this, that we judge ourselves by our intentions

20:57and others by their actions.

20:59And I think that the biggest skill,

21:01I mean, here in Silicon Valley, we're full of engineers

21:03who have very little empathy

21:05and are kind of befuddled by why it doesn't work for them.

21:09The biggest skill I think that people should acquire

21:13is to put themselves into the position of the other

21:16and listen, and listen to what the other has to say.

21:19And they'd be shocked how similar they are to themselves.

21:23And they might even be shocked

21:24how their own actions don't reflect their intentions.

21:28I often have conversations with engineers

21:30where I say, "Look, hey, I love you.

21:32"You're doing a great job.

21:33"And by the way, what you just did has the following effect.

21:37"Are you aware of that?"

21:38And then people would say, "Oh my God, not I wasn't

21:41"because my intention was that."

21:43And I say, "Yeah, I trust your intention.

21:44"You're a good human being.

21:46"But just to help you in the future,

21:48"if you keep expressing it that way,

21:51"then people will just hate you."

21:53And I've had many instances where people say,

21:55"Oh my God, thank you for telling me this

21:56"because it wasn't my intention to look like an idiot.

21:59"It wasn't my intention to help other people.

22:00"I just didn't know how to do it."

22:02- Very simple, by the way.

22:03There's a book, Dale Carnegie, 1936,

22:07"How to Make Friends and How to Influence Others."

22:10Has the entire Bible.

22:11You just read it and you're done

22:12and you apply it every day.

22:14And I wish I was good enough to apply it every day.

22:16But it's just simple things, right?

22:18Like be positive, remember people's names, smile,

22:22and eventually have empathy.

22:24Really think that the person that you hate

22:27and you think is an idiot is actually just like yourself.

22:30It's a person who's struggling, who means well,

22:33and who might need help.

22:34And guess what?

22:35You need help.

22:36I've recently spoken with Stephen Schwarzman.

22:39I'm not sure if you know who that is.

22:41- I do.

22:42It's on my list.

22:45(laughing)

22:46- On the list.

22:46(laughing)

22:47But he said, sort of to expand on what you're saying,

22:52that one of the biggest things you can do

22:56is hear people when they tell you what their problem is

23:00and then help them with that problem.

23:02He says it's surprising how few people

23:06actually listen to what troubles others.

23:08- Yeah.

23:09- And because it's right there in front of you

23:12and you can benefit the world the most.

23:15And in fact, yourself and everybody around you

23:18by just hearing the problems and solving them.

23:20- I mean, that's my little history of engineering.

23:23That is, while I was engineering with computers,

23:28I didn't care at all what the computer's problems were.

23:32I just told them what to do and they do it.

23:34And it just doesn't work this way with people.

23:37- It doesn't work with me.

23:38If you come to me and say, "Do A," I do the opposite.

23:41(laughing)

23:43- But let's return to the comfortable world of engineering.

23:47And can you tell me in broad strokes in how you see it?

23:52Because you're at the core of starting it,

23:53the core of driving it,

23:55the technical evolution of autonomous vehicles

§04Transcript · 23:58–31:59

23:58from the first DARPA Grand Challenge

24:00to the incredible success we see with the program

24:03you started with Google Self-Driving Car

24:05and Waymo and the entire industry that sprung up

24:08of different kinds of approaches, debates, and so on.

24:11- Well, the idea of self-driving car goes back to the '80s.

24:14There was a team in Germany, another team in Carnegie Mellon

24:16that did some very pioneering work.

24:18But back in the day, I'd say the computers were so deficient

24:21that even the best professors and engineers in the world

24:25basically stood no chance.

24:27It then folded into a phase where the US government

24:31spent at least half a billion dollars

24:33that I could count on research projects.

24:36But the way the procurement works,

24:37a successful stack of paper describing lots of stuff

24:42that no one's ever gonna read

24:43was a successful product of a research project.

24:47So we trained our researchers to produce lots of paper.

24:50That all changed with the DARPA Grand Challenge.

24:54And I really gotta credit the ingenious people at DARPA

24:58and the US government and Congress

25:00that took a complete new funding model

25:02where they said, "Let's not fund effort,

25:04"let's fund outcomes."

25:05And it sounds very trivial, but there was no tax code

25:08that allowed the use of congressional tax money for a price.

25:13It was all effort-based.

25:15So if you put in 100 hours in, you could charge 100 hours.

25:17If you put in 1,000 hours in, you could build 1,000 hours.

25:20By changing the focus and say, "We're making the price.

25:22"We don't pay you for development,

25:23"we pay you for the accomplishment."

25:26They drew in, they automatically drew out

25:28all these contractors who are used to the drug

25:31of getting money per hour.

25:33And they drew in a whole bunch of new people.

25:35And these people are mostly crazy people.

25:37They were people who had a car and a computer

25:40and they wanted to make a million bucks.

25:42The million bucks was the original price money,

25:43it was then doubled.

25:45And they felt, "If I put my computer in my car

25:47"and program it, I can be rich."

25:50And that was so awesome.

25:52Like half the teams, there was a team that was surfer dudes

25:55and they had like two surfboards on their vehicle

25:58and brought like these fashion girls,

26:00super cute girls, like twin sisters.

26:02And you could tell these guys were not your common

26:06fails babe bandit who gets all these big multi-million

26:10and billion dollar countries from the US government.

26:13And there was a great reset.

26:15Universities moved in.

26:18I was very fortunate at Stanford that I'd just received tenure

26:21so I couldn't get fired no matter what I do,

26:23otherwise I wouldn't have done it.

26:25And I had enough money to finance this thing.

26:28And I was able to attract a lot of money from third parties.

26:31And even car companies moved in.

26:32They kind of moved in very quietly

26:34because they were super scared to be embarrassed

26:36that their car would flip over.

26:38But Ford was there and Volkswagen was there

26:40and a few others and GM was there.

26:43So it kind of reset the entire landscape of people.

26:46And if you look at who's a big name

26:48in self-driving cars today,

26:49these were mostly people who participated

26:51in those challenges.

26:52- Okay, that's incredible.

26:54Can you just comment quickly on your sense of lessons learned

26:59from that kind of funding model

27:01and the research that's going on in academia

27:04in terms of producing papers?

27:06Is there something to be learned and scaled up bigger?

27:09These having these kinds of grand challenges

27:11that could improve outcomes?

27:14- So I'm a big believer in focusing

27:16on kind of an end-to-end system.

27:19I'm a really big believer in systems building.

27:21I've always built systems in my academic career,

27:23even though I do a lot of math and abstract stuff,

27:27but it's all derived from the idea

27:28of let's solve a real problem.

27:29And it's very hard for me to be an academic

27:33and say, let me solve a component of a problem.

27:35Like with someone, there's fields like non-monetary logic

27:38or AI planning systems where people believe

27:41that a certain style of problem solving

27:44is the ultimate end objective.

27:47And I would always turn it around and say,

27:49hey, what problem would my grandmother care about

27:52that doesn't understand computer technology

27:54and doesn't want to understand?

27:56And how could I make her love what I do?

27:58Because only then do I have an impact on the world.

28:01I can easily impress my colleagues.

28:02That is much easier,

28:04but impressing my grandmother is very, very hard.

28:07So I would always thought if I can build a self-driving car

28:10and my grandmother can use it

28:12even after she loses her driving privileges

28:14or children can use it,

28:16or we save maybe a million lives a year,

28:20that would be very impressive.

28:22And there's so many problems like these.

28:23Like there's a problem with curing cancer,

28:25or whatever it is, live twice as long.

28:27Once a problem is defined,

28:29of course I can't solve it in its entirety.

28:31Like it takes sometimes tens of thousands of people

28:34to find a solution.

28:35There's no way you can fund an army of 10,000 at Stanford.

28:39So you're gonna build a prototype.

28:41Let's build a meaningful prototype.

28:42And the Dark Background Challenge was beautiful

28:43because it told me what this prototype had to do.

28:46I didn't have to think about what it had to do.

28:47I just had to read the rules.

28:48And it was really, really beautiful.

28:51- And it's most beautiful, you think,

28:52what academia could aspire to is to build a prototype

28:56that's the systems level that solves,

29:00gives you an inkling that this problem

29:02could be solved with this prototype.

29:03- First of all, I wanna emphasize what academia really is.

29:06And I think people misunderstand it.

29:08First and foremost,

29:10academia is a way to educate young people.

29:13First and foremost, a professor is an educator.

29:15No matter where you are at,

29:17a small suburban college,

29:18or whether you are a Harvard or Stanford professor.

29:21That's not the way most people think of themselves

29:25in academia because we have this kind of competition

29:28going on for citations and publication.

29:31That's a measurable thing,

29:32but that is secondary to the primary purpose

29:35of educating people to think.

29:37Now, in terms of research,

29:40most of the great science,

29:42the great research comes out of universities.

29:45You can trace almost everything back,

29:46including Google to universities.

29:48So there's nothing really fundamentally broken here.

29:52It's a good system.

29:53And I think America has the finest university system

29:55on the planet.

29:56We can talk about reach and how to reach people

30:00outside the system.

30:01It's a different topic,

30:02but the system itself is a good system.

30:04If I had one wish, I would say,

30:07it'd be really great if there was more debate

30:10about what the great big problems are in society.

30:15And focus on those.

30:18And most of them are interdisciplinary.

30:21Unfortunately, it's very easy to fall

30:24into a interdisciplinary viewpoint

30:28where your problem is dictated

30:30by what your closest colleagues believe the problem is.

30:33It's very hard to break out and say,

30:35well, there's an entire new field of problems.

30:37So to give an example,

30:39prior to me working on self-driving cars,

30:41I was a roboticist and a machine learning expert.

30:44And I wrote books on robotics,

30:46something called probabilistic robotics.

30:48It's a very methods driven kind of viewpoint of the world.

30:51I built robots that acted in museums as tour guides,

30:54that like led children around.

30:55It is something that at the time was moderately challenging.

31:00When I started working on cars,

31:02several colleagues told me,

31:03"Sebastian, you're destroying your career

31:06"because in our field of robotics,

31:08"cars are looked like as a gimmick

31:10"and they're not expressive enough.

31:11"They can only push this bottle

31:14"and the brakes, there's no dexterity,

31:16"there's no complexity, it's just too simple."

31:19And no one came to me and said,

31:21"Wow, if you solve that problem,

31:22"you can save a million lives."

31:25Among all robotic problems that I've seen in my life,

31:27I would say the self-driving car, transportation,

31:29is the one that has the most hope for society.

31:32So how come the robotics community

31:33wasn't all over the place?

31:35And it was because we focused on methods and solutions

31:37and not on problems.

31:39Like if you go around today and ask your grandmother,

31:42what bugs you, what really makes you upset?

31:45I challenge any academic to do this

31:48and then realize how far your research

31:51is probably away from that today.

31:53At the very least, that's a good thing

31:56for academics to deliberate on.

31:59The other thing that's really nice in Silicon Valley

§05Transcript · 32:00–40:17

32:00is Silicon Valley is full of smart people outside academia.

32:04So there's the Larry Pages and Mark Zuckerbergs

32:06in the world who are anywhere as smart or smarter

32:09than the best academics I've met in my life.

32:11And what they do is they are at a different level.

32:15They build the systems,

32:16they build the customer-facing systems,

32:19they build things that people can use

32:21without technical education.

32:23And they are inspired by research,

32:25they're inspired by scientists.

32:27They hire the best PhDs from the best universities

32:30for a reason.

32:31So I think there's kind of vertical integration

32:35between the real product, the real impact,

32:37and the real thought, the real ideas.

32:39That's actually working surprisingly well

32:41in Silicon Valley.

32:42It did not work as well in other places in this nation.

32:44So when I worked at Carnegie Mellon,

32:46we had the world's finest computer science university,

32:49but there wasn't those people in Pittsburgh

32:52that would be able to take these very fine

32:55computer science ideas and turn them into

32:57massively impactful products.

33:00That symbiosis seemed to exist pretty much only

33:03in Silicon Valley and maybe a bit in Boston and Austin.

33:06- Yeah, with Stanford.

33:07That's really interesting.

33:11So if we look a little bit further on

33:14from the DARPA Grand Challenge

33:17and the launch of the Google self-driving car,

33:20what do you see as the state,

33:22the challenges of autonomous vehicles as they are now?

33:25Is actually achieving that huge scale

33:29and having a huge impact on society?

33:31- I'm extremely proud of what has been accomplished.

33:35And again, I'm taking a lot of credit for the work that I do.

33:37(laughing)

33:38And I'm actually very optimistic

33:40and people have been kind of worrying,

33:42is it too fast?

33:43Is it too slow?

33:44Why is it not there yet?

33:44And so on.

33:45It is actually quite an interesting hard problem.

33:48And in that a self-driving car,

33:51to build one that manages 90% of the problems

33:55and count them every day driving is easy.

33:57We can literally do this over a weekend.

33:59To do 99% might take a month.

34:02Then there's 1% left.

34:03So 1% would mean that you still

34:05have a fatal accident every week.

34:08Very unacceptable.

34:09So now you work on this 1%

34:10and the 99% of that,

34:12the remaining 1% is actually still relatively easy.

34:15But now you're down to like a hundredth of 1%

34:18and it's still completely unacceptable in terms of safety.

34:21So the variety of things you encounter are just enormous.

34:24And that gives me enormous respect for human beings

34:26that we're able to deal with the couch on the highway,

34:30right?

34:31Or the deer in the headlight

34:31or the blown tire that we've never been trained for.

34:34And all of a sudden I have to handle it

34:35in an emergency situation

34:37and often do very, very successfully.

34:38It's amazing from that perspective

34:40how safe driving actually is

34:42given how many millions of miles we drive

34:44every year in this country.

34:46We are now at a point

34:48where I believe the technology is there.

34:50And I've seen it.

34:51I've seen it in Waymo.

34:52I've seen it in Aptiv.

34:53I've seen it in Cruise

34:55and in a number of companies and Voyage

34:58where vehicles not driving around

35:00and basically flawlessly are able to drive people around

35:04in limited scenarios.

35:06In fact, you can go to Vegas today

35:08and order a summon a lift.

35:09And if you got the right setting of your app

35:13you'd be picked up by a driverless car.

35:15Now there's still safety drivers in there

35:18but that's a fantastic way to kind of learn

35:21what the limits of technology today.

35:22And there's still some glitches

35:24but the glitches have become very, very rare.

35:26I think the next step is gonna be to down cost it

35:29to harden it.

35:31The entrapment, the sensors

35:33are not quite an automotive grade standard yet.

35:36And then to really build the business models

35:37to really kind of go somewhere and make the business case.

35:40And the business case is hard work.

35:42It's not just, oh my God, we have this capability

35:44people are just gonna buy it.

35:45You have to make it affordable.

35:46You have to give people the,

35:50find the social acceptance of people.

35:52None of the teams yet has been able to

35:54or gutsy enough to drive around

35:56without a person inside the car.

35:59And that's the next magical hurdle.

36:01We'll be able to send these vehicles around

36:03completely empty in traffic.

36:05And I think, I mean, I wait every day,

36:08wait for the news that Waymo has just done this.

36:10- So, you know, it's interesting you mentioned gutsy.

36:14Let me ask some maybe unanswerable question,

36:19maybe edgy questions, but in terms of

36:24how much risk is required, some guts

36:28in terms of leadership style,

36:30it would be good to contrast approaches.

36:32And I don't think anyone knows what's right.

36:34But if we compare Tesla and Waymo, for example,

36:38Elon Musk and the Waymo team,

36:41there's slight differences in approach.

36:45So on the Elon side, there's more,

36:49I don't know what the right word to use,

36:50but aggression in terms of innovation.

36:53And on Waymo side, there's more sort of cautious,

36:58safety focused approach to the problem.

37:03What do you think it takes?

37:06What leadership at which moment is right?

37:09Which approach is right?

37:10- Look, I don't sit in either of those teams.

37:13So I'm unable to even verify,

37:16like somebody says, correct.

37:17In the end of the day, every innovator in that space

37:21will face a fundamental dilemma.

37:23And I would say you could put aerospace titans

37:27into the same bucket, which is you have to balance

37:30public safety with your drive to innovate.

37:34And this country in particular, in the States,

37:36has a hundred plus year history

37:38of doing this very successfully.

37:40Air travel is what a hundred times as safe per mile

37:43than ground travel, than cars.

37:46And there's a reason for it,

37:48because people have found ways to be very methodological

37:52about ensuring public safety,

37:55while still being able to make progress

37:56on important aspects, for example,

37:59like airline noise and fuel consumption.

38:01So I think that those practices are proven

38:06and they actually work.

38:07We live in a world safer than ever before.

38:09And yes, there will always be the provision

38:11that something goes wrong.

38:12There's always the possibility that someone makes a mistake

38:15or there's an unexpected failure.

38:17We can never guarantee to a hundred percent absolute safety

38:20rather than just not doing it.

38:23But I think I'm very proud of the history of the United States

38:27I mean, we've dealt with much more dangerous technology

38:30like nuclear energy and kept that safe too.

38:32We have nuclear weapons and we keep those safe.

38:36So we have methods and procedures

38:39that really balance these two things very, very successfully.

38:42- You've mentioned a lot of great autonomous vehicle

38:44companies that are taking sort of the level four, level five

38:48they jump in full autonomy with a safety driver

38:51and take that kind of approach.

38:53And also through simulation and so on.

38:55There's also the approach that Tesla Autopilot is doing

38:59which is kind of incrementally taking a level two vehicle

39:03and using machine learning and learning

39:05from the driving of human beings and trying to creep up

39:10trying to incrementally improve the system

39:12until it's able to achieve level four autonomy.

39:15So perfect autonomy in certain kind of geographical regions.

39:19What are your thoughts on these contrasting approaches?

39:23- Well, so first of all, I'm a very proud Tesla owner

39:25and I literally use the Autopilot every day

39:27and it literally has kept me safe.

39:29It is a beautiful technology specifically

39:33for highway driving when I'm slightly tired

39:37because then it turns me into a much safer driver

39:42and that I'm a hundred percent confident that's the case.

39:46In terms of the right approach,

39:47I think the biggest change I've seen

39:49since I ran the Waymo team is this thing called deep learning.

39:54Deep learning was not a hot topic when I started Waymo

39:58or Google self-driving cars.

39:59It was there, in fact, we started Google Brain

40:01at the same time in Google X.

40:02So I invested in deep learning, but people didn't talk

40:05about it, it wasn't a hot topic.

40:07And now it is.

40:08There's a shift of emphasis

40:10from a more geometric perspective

40:12where you use geometric sensors.

40:14They give you a full 3D view

40:15and you do a geometric reasoning about,

40:17oh, this box over here might be a car,

§06Transcript · 40:19–47:59

40:19towards a more human-like, oh, let's just learn about it.

40:24This looks like the thing I've seen 10,000 times before.

40:26So maybe it's the same thing, machine learning perspective.

40:30And that has really put, I think,

40:32all these approaches on steroids.

40:34At Udacity, we teach a course in self-driving cars.

40:38In fact, I think we've graduated over 20,000 or so people

40:43on self-driving car skills.

40:45So every self-driving car team

40:47in the world now uses our engineers.

40:49And in this course, the very first homework assignment

40:51is to do lane finding on images.

40:54And lane finding images for laymen,

40:56what this means is you put a camera into your car

40:59or you open your eyes

40:59and you wouldn't know where the lane is, right?

41:01So you can stay inside the lane with your car.

41:04Humans can do this super easily.

41:06You just look and you know where the lane is,

41:08just intuitively.

41:10For machines, for a long time, it was super hard

41:12because people would write these kind of crazy rules.

41:14If there's like one lane markers

41:16and here's what white really means,

41:17this is not quite white enough.

41:19So let's, oh, it's not white.

41:20Or maybe the sun is shining.

41:21So when the sun shines and this is white

41:23and this is a straight line,

41:24or maybe it's not quite a straight line

41:25because the road is curved.

41:27And do we know that there's really six feet

41:29between lane markings or not, or 12 feet, whatever it is.

41:32And now, what the students are doing,

41:36they would take machine learning.

41:37So instead of like writing these crazy rules

41:39for the lane marker, it's just say,

41:40hey, let's take an hour of driving

41:42and label it and tell the vehicle

41:44this is actually the lane by hand.

41:45And then these are examples

41:47and have the machine find its own rules

41:49what lane markings are.

41:51And within 24 hours, now every student

41:53that's never done any programming before in this space

41:56can write a perfect lane finder

41:58as good as the best commercial lane finders.

42:00And that's completely amazing to me.

42:02We've seen progress using machine learning

42:05that completely dwarfs anything

42:08that I saw 10 years ago.

42:10- Yeah, and just as a side note,

42:12the self-driving car nanodegree,

42:15the fact that you launched that many years ago now,

42:18maybe four years ago.

42:20- Three years ago.

42:20- Three years ago is incredible.

42:22That's a great example of system level thinking.

42:24So just taking an entire course that teaches you

42:27how to solve the entire problem,

42:29I definitely recommend people.

42:31- It's become super popular

42:32and it's become actually incredibly high quality.

42:34We've been with Mercedes

42:35and various other companies in that space.

42:38And we find that engineers from Tesla and Waymo

42:40are taking it to bay.

42:41The insight was that two things,

42:45one is existing universities will be very slow to move

42:49because the department lies

42:50and there's no department for self-driving cars.

42:52So between McGee and EE and computer science,

42:56getting those folks together into one room

42:57is really, really hard.

42:59And every professor listening here will know,

43:01they'll probably agree to that.

43:02And secondly, even if all the great universities

43:06did this, which none so far

43:08has developed a curriculum in this field,

43:11it is just a few thousand students that can partake

43:13because all the great universities are super selective.

43:16So how about people in India?

43:18How about people in China or in the Middle East

43:20or Indonesia or Africa?

43:23Why should those be excluded

43:25from the skill of building self-driving cars?

43:27Are they any dumber than we are?

43:28Are they any less privileged?

43:30And the answer is, we should just give everybody the skill

43:34to build a self-driving car.

43:35Because if we do this,

43:37then we have like a thousand self-driving car startups.

43:40And if 10% succeed, that's like a hundred,

43:42that means a hundred countries now

43:44will have self-driving cars and be safer.

43:46- It's kind of interesting to imagine,

43:48impossible to quantify, but the number,

43:52the, you know, over a period of several decades,

43:54the impact that has, like a single course,

43:57like a ripple effect of society.

43:59I just recently talked to Andrew

44:02and who was creator of Cosmos.

44:05So it's a show, it's interesting to think about

44:08how many scientists that show launched.

44:10And so it's really, in terms of impact,

44:15I can't imagine a better course

44:17than the self-driving car course.

44:18That's, you know, there's other more specific disciplines

44:21like deep learning and so on that Udacity is also teaching,

44:24but self-driving cars, it's really,

44:25really interesting course.

44:26- Yeah, and it came at the right moment.

44:28It came at a time when there were a bunch of acqui-hires.

44:31Acqui-hire is acquisition of a company,

44:34not for its technology or its products or business,

44:36but for its people.

44:38So acqui-hire means maybe the company of 70 people,

44:40they have no product yet, but they're super smart people

44:43and they pay a certain amount of money.

44:44So I took acqui-hires like GM Cruise and Uber and others

44:48and did the math and said, hey, how many people are there

44:52and how much money was paid?

44:53And as a lower bound, I estimated the value

44:56of a self-driving car engineer in these acquisitions

45:00to be at least $10 million, right?

45:02So think about this, you get yourself a skill

45:05and you team up and build a company

45:06and your worth now is $10 million.

45:09I mean, that's kind of cool.

45:10I mean, what other thing could you do in life

45:13to be worth $10 million within a year?

45:15- Yeah, amazing.

45:17But to come back for a moment onto deep learning

45:21and its application in autonomous vehicles,

45:23what are your thoughts on Elon Musk's statement,

45:28provocative statement perhaps, that lighter is a crutch?

45:31So this geometric way of thinking about the world

45:34may be holding us back if what we should instead be doing

45:38in this robotics, in this particular space

45:41of autonomous vehicles is using camera as a primary sensor

45:46and using computer vision and machine learning

45:48as the primary way to--

45:49- Look, I have two comments.

45:50I think first of all, we all know that people can drive cars

45:55without lighters in their hands because we only have eyes

45:59and we mostly just use eyes for driving.

46:02Maybe we use some other perception about our bodies,

46:04accelerations, occasionally our ears,

46:06certainly not our noses. (laughs)

46:10So the existence proof is there

46:12that eyes must be sufficient.

46:14In fact, we could even drive a car

46:17if someone put a camera out

46:19and then gave us the camera image with no latency,

46:23we would be able to drive a car that way, the same way.

46:26So a camera is also sufficient.

46:28Secondly, I really love the idea that in the Western world,

46:31we have many, many different people

46:33trying different hypotheses.

46:35It's almost like an ant hill.

46:37An ant hill tries to forge for food, right?

46:39You can sit there as two ants

46:40and agree what the perfect path is

46:42and then every single ant marches

46:44for the most likely location of food is

46:46or you can have them just spread out.

46:47And I promise you the spread out solution will be better

46:50because if the disgusting philosophical,

46:54intellectual ants get it wrong

46:55and they're all moving the wrong direction,

46:56they're gonna waste the day

46:58and then they're gonna discuss again for another week.

47:00Whereas if all these ants go in a random direction,

47:02someone's gonna succeed

47:03and they're gonna come back and claim victory

47:05and get the Nobel prize or whatever the ant equivalent is.

47:08And then they all march in the same direction.

47:10And that's great about society.

47:11That's great about the Western society.

47:13We're not plan-based, we're not central-based.

47:15We don't have a Soviet Union style central government

47:19that tells us where to forge.

47:21We just forge.

47:21We start in C-Corp.

47:23We get investor money, go out and try it out.

47:25And who knows who's gonna win?

47:27(laughs)

47:28- I like it.

47:29When you look at the long-term vision

47:33of autonomous vehicles,

47:35do you see machine learning

47:36as fundamentally being able to solve most of the problems?

47:39So learning from experience.

47:42- I'd say we should be very clear

47:44about what machine learning is and is not.

47:46And I think there's a lot of confusion.

47:48What it is today is a technology

47:50that can go through large databases

47:54of repetitive patterns and find those patterns.

47:59So an example, we did a study at Stanford two years ago

§07Transcript · 48:03–57:02

48:03where we applied machine learning

48:05to detecting skin cancer in images.

48:07And we harvested or built a data set

48:10of 129,000 skin photo shots

48:15that all had been biopsied for what the actual situation was.

48:19And those included melanomas and carcinomas,

48:22also included rashes and other skin conditions, lesions.

48:26And then we had a network find those patterns

48:30and it was by and large able to then detect skin cancer

48:34with an iPhone as accurately

48:36as the best board-certified Stanford-level dermatologist.

48:41We proved that.

48:42Now this thing was great in this one thing,

48:45finding skin cancer, but it couldn't drive a car.

48:48So the difference to human intelligence

48:51is we do all these many, many things

48:53and we can often learn from a very small data set

48:56of experiences, whereas machines still need

48:59very large data sets and things that would be very repetitive.

49:03Now that's still super impactful

49:04because almost everything we do is repetitive.

49:06So that's gonna really transform human labor,

49:09but it's not this almighty general intelligence.

49:13We're really far away from a system

49:15that would exhibit general intelligence.

49:17To that end, I actually commiserate the naming a little bit

49:21because artificial intelligence, if you believe Hollywood,

49:24is immediately mixed into the idea of human suppression

49:27and machine superiority.

49:30I don't think that we're gonna see this in my lifetime.

49:32I don't think human suppression is a good idea.

49:35I don't see it coming.

49:37I don't see the technology being there.

49:39What I see instead is a very pointed,

49:42focused pattern recognition technology

49:44that's able to extract patterns from large data sets.

49:48And in doing so, it can be super impactful, super impactful.

49:53Let's take the impact of artificial intelligence

49:55on human work.

49:57We all know that it takes something like 10,000 hours

50:00to become an expert.

50:01If you're gonna be a doctor or a lawyer

50:04or even a really good driver,

50:06it takes a certain amount of time to become experts.

50:09Machines now are able and have been shown

50:12to observe people become experts and observe experts

50:16and then extract those rules from experts

50:18in some interesting way that could go from law to sales

50:23to driving cars to diagnosing cancer

50:28and then giving that capability to people

50:31who are completely new in their job.

50:33We now can, and that's been done.

50:35It's been done commercially in many, many instantiations.

50:38So that means we can use machine learning

50:40to make people expert on the very first day of their work.

50:45Like think about the impact.

50:46If your doctor is still in their first 10,000 hours,

50:51you have a doctor who's not quite an expert yet.

50:53Who would not want a doctor who is the world's best expert?

50:57And now we can leverage machines

50:59to really eradicate error in decision-making,

51:02error in lack of expertise for human doctors.

51:06That could save your life.

51:08- If we can link on that for a little bit,

51:10in which way do you hope machines in the medical field

51:14could help assist doctors?

51:16You mentioned this sort of accelerating the learning curve

51:21or people, if they start a job,

51:24or in the first 10,000 hours can be assisted by machines.

51:27How do you envision that assistance looking?

51:29- So we built this app for an iPhone

51:32that can detect and classify and diagnose skin cancer.

51:36And we proved two years ago that it does pretty much

51:40as good or better than the best human doctors.

51:42So let me tell you a story.

51:43So there's a friend of mine, let's call him Ben.

51:45Ben is a very famous venture capitalist.

51:47He goes to his doctor and the doctor looks at a mole

51:50and says, "Hey, that mole is probably harmless."

51:55And for some very funny reason,

51:58he pulls out that phone with our app.

52:00He's a collaborator in our study.

52:02And the app says, "No, no, no, no, this is a melanoma."

52:06And for background, melanomas are,

52:08and skin cancer is the most common cancer in this country.

52:12Melanomas can go from stage zero to stage four

52:16within less than a year.

52:18Stage zero means you can basically cut it out yourself

52:20with a kitchen knife and be safe.

52:23And stage four means your chances of living

52:25for five more years are less than 20%.

52:27So it's a very serious, serious, serious condition.

52:31So this doctor who took out the iPhone

52:36looked at the iPhone and was a little bit puzzled.

52:37He said, "I mean, but just to be safe,

52:39let's cut it out and biopsy it."

52:41That's the technical term for it.

52:43Let's get an in-depth diagnostics

52:45that is more than just looking at it.

52:47And it came back as cancerous, as a melanoma.

52:50And it was then removed.

52:52And my friend Ben, I was hiking with him

52:54and we were talking about AI.

52:56And I said, I told him I do this book on skin cancer.

52:58And he said, "Oh, funny.

53:00My doctor just had an iPhone that found my cancer."

53:03(both laughing)

53:04Wow.

53:05So I was like completely intrigued.

53:06I didn't even know about this.

53:08So here's a person, I mean,

53:09this is a real human life, right?

53:11- Yes.

53:12- Now who doesn't know somebody

53:12who has been affected by cancer?

53:13Cancer is cause of death number two.

53:16Cancer is this kind of disease that is mean

53:19in the following way.

53:21Most cancers can actually be cured relatively easily

53:24if we catch them early.

53:25And the reason why we don't tend to catch them early

53:28is because they have no symptoms.

53:30Like your very first symptom of a gallbladder cancer

53:33or a pancreas cancer might be a headache.

53:37And when you finally go to your doctor

53:38because of these headaches or your back pain

53:41and you're being imaged, it's usually stage four plus.

53:45And that's the time when the occurring chances

53:48might be dropped to a single digit percentage.

53:50So if we could leverage AI to inspect your body

53:54on a regular basis without even a doctor in the room,

53:58maybe when you take a shower or what have you,

54:00I know this sounds creepy,

54:01but then we might be able to save millions

54:03and millions of lives.

54:06- You've mentioned there's a concern that people have

54:09about near-term impacts of AI in terms of job loss.

54:12So you've mentioned being able to assist doctors,

54:15being able to assist people in their jobs.

54:17Do you have a worry of people losing their jobs

54:21or the economy being affected by the improvements in AI?

54:25- Yeah, anybody concerned about job losses,

54:27please come to Gerdasady.com.

54:30We teach contemporary tech skills

54:32and we have our kind of implicit job promise.

54:36We often, when we measure,

54:38we spend way over 50% of our graduates in new jobs

54:41and they're very satisfied about it.

54:43And it costs almost nothing,

54:44costs like 1,500 max or something like that.

54:47- And I saw there's a cool new program

54:48that you agree with the US government,

54:51guaranteeing that you will help give scholarships

54:54that educate people in this kind of situation.

54:57- Yeah, we're working with the US government

55:00on the idea of basically rebuilding the American dream.

55:03So Udacity has just dedicated 100,000 scholarships

55:07for citizens of America for various levels of courses

55:12that eventually will get you a job.

55:15And those courses are all somewhat related

55:18to the tech sector because the tech sector

55:20is kind of the hottest sector right now.

55:22And they range from inter-level digital marketing

55:24to very advanced self-driving car engineering.

55:28And we're doing this with the White House

55:29because we think it's bipartisan.

55:30It's an issue that if you wanna really make America great,

55:35being able to be a part of the solution

55:40and live the American dream requires us

55:43to be proactive about our education and our skillset.

55:45It's just the way it is today.

55:47And it's always been this way.

55:48And we always had this American dream

55:49to send our kids to college.

55:51And now the American dream has to be

55:53to send ourselves to college.

55:54We can do this very, very, very efficiently

55:58and we can squeeze in the evenings and things to online.

56:01- At all ages.

56:03- All ages.

56:03So our learners go from age 11 to age 80.

56:08I just traveled Germany and the guy

56:14in the train compartment next to me was one of my students.

56:17It's like, wow, that's amazing.

56:19Think about impact.

56:21We've become the educator of choice for now,

56:24I believe officially six countries or five countries.

56:26Mostly in the Middle East, like Saudi Arabia and in Egypt.

56:30In Egypt, we just had a cohort graduate

56:33where we had 1100 high school students

56:37that went through programming skills proficient

56:40at the level of a computer science undergrad.

56:42And we had a 95% graduation rate

56:45even though everything's online.

56:46It's kind of tough, but we kind of trying to figure out

56:48how to make this effective.

56:50The vision is very, very simple.

56:52The vision is education ought to be a basic human right.

56:57It cannot be locked up behind ivory tower walls

57:02only for the rich people,

§08Transcript · 57:03–1:05:00

57:03for the parents who might be bribe themselves

57:05into the system and only for young people

57:08and only for people from the right demographics

57:10and the right geography and possibly even the right race.

57:14It has to be opened up to everybody.

57:15If we are truthful to the human mission,

57:18if we are truthful to our values,

57:20we're gonna open up education to everybody in the world.

57:23So Udacity's pledge of 100,000 scholarships,

57:27I think is the biggest pledge of scholarships ever

57:29in terms of numbers.

57:30And we're working, as I said, with the White House

57:32and with very accomplished CEOs

57:35like Tim Cook from Apple and others

57:37to really bring education to everywhere in the world.

57:40- Not to ask you to pick the favorite of your children,

57:44but at this point-- - Oh, that's Jasper.

57:46(laughing)

57:47I only have one that I know of.

57:49- Okay, good.

57:50In this particular moment, what nano degree,

57:55what set of courses are you most excited about at Udacity?

58:00Or is that too impossible to pick?

58:01- I've been super excited about something

58:03we haven't launched yet and we're building,

58:05which is when we talk to our partner companies,

58:09we have now a very strong footing in the enterprise world.

58:12And also to our students,

58:14we've kind of always focused on these hard skills

58:17like the programming skills or math skills

58:19or building skills or design skills.

58:22And a very common ask is soft skills.

58:25Like how do you behave in your work?

58:26How do you develop empathy?

58:28How do you work in a team?

58:29What are the very basics of management?

58:32How do you do time management?

58:33How do you advance your career

58:36in the context of a broader community?

58:39And that's something that we haven't done very well

58:41at Udacity and I would say most universities

58:43are doing very poorly as well

58:45because we are so obsessed with individual test scores

58:47and pay so little attention to teamwork in education.

58:52So that's something I see us moving into as a company

58:55because I'm excited about this.

58:56And I think, look, we can teach people tech skills

59:00and they're gonna be great.

59:00But if we teach people empathy,

59:02that's gonna have the same impact.

59:04- Maybe harder than self-driving cars, but--

59:08- I don't think so.

59:08I think the rules are really simple.

59:11You just have to want to engage.

59:14It's weird, we literally went in school in K through 12,

59:18we teach kids like get the highest math score.

59:20And if you are a rational human being,

59:22you might evolve from this education,

59:24say having the best math score

59:26and the best English scores, make me the best leader.

59:29And it turns out not to be the case.

59:31It's actually really wrong

59:32because making, first of all, in terms of math scores,

59:35I think it's perfectly fine to hire somebody

59:37with great math skills.

59:38You don't have to do it yourself.

59:40You can hire someone with great empathy for you,

59:42that's much harder, but it can always hire someone

59:44with great math skills.

59:46But we live in an affluent world

59:48where we constantly deal with other people.

59:51And that's a beauty.

59:51It's not a nuisance, it's a beauty.

59:53So if we somewhat develop that muscle

59:55that we can do that well and empower others

59:59in the workplace, I think we're gonna be super successful.

60:02- And I know many fellow roboticists

60:05and computer scientists that I will insist

60:08to take this course.

60:09(laughing)

60:11- Not to be named here.

60:12- Not to be named.

60:13Many, many years ago, 1903,

60:17the Wright brothers flew in Kitty Hawk for the first time.

60:22And you've launched a company of the same name, Kitty Hawk,

60:26with the dream of building flying cars, EVtols.

60:31So at the big picture, what are the big challenges

60:35of making this thing that actually have inspired

60:38generations of people about what the future looks like?

60:41What does it take?

60:42What are the biggest challenges?

60:43- So flying cars has always been a dream.

60:47Every boy, every girl wants to fly.

60:49Let's be honest.

60:50- Yes.

60:51- And let's go back in our history

60:52of your dreaming of flying.

60:53I think my, honestly, my single most remembered

60:56childhood dream has been a dream

60:58where I was sitting on a pillow and I could fly.

61:00I was like five years old.

61:02I remember like maybe three dreams of my childhood,

61:04but that's the one I remember most vividly.

61:06And then Peter Thiel famously said,

61:09"They promised us flying cars

61:10and they gave us 140 characters,"

61:12pointing at Twitter at the time,

61:15limited message size to 140 characters.

61:18So we're coming back now to really go

61:20for this super impactful stuff like flying cars.

61:23And to be precise, they're not really cars.

61:25They don't have wheels.

61:27They're actually much closer to a helicopter

61:28than anything else.

61:29They take off vertically and they fly horizontally,

61:32but they have important differences.

61:34One difference is that they are much quieter.

61:37We just released a vehicle called Project Heaviside

61:41that can fly over you as low as a helicopter.

61:43And you basically can't hear it.

61:45It's like 38 decibels.

61:46It's like, if you were inside the library,

61:49you might be able to hear it,

61:50but anywhere outdoors, your ambient noise is higher.

61:53Secondly, they're much more affordable.

61:57They're much more affordable than helicopters.

61:59And the reason is helicopters are expensive

62:01for many reasons.

62:03There's lots of single point of figures in a helicopter.

62:07There's a bolt between the blades

62:09that's called Jesus bolt.

62:10And the reason why it's called Jesus bolt

62:12is that if this bolt breaks, you will die.

62:16There is no second solution in helicopter flight.

62:19Whereas we have these distributed mechanism.

62:21When you go from gasoline to electric,

62:23you can now have many, many, many small motors

62:25as opposed to one big motor.

62:27And that means if you lose one of those motors,

62:28not a big deal.

62:29Heaviside, if it loses a motor, has eight of those,

62:32if it loses one of those eight motors,

62:34so it's seven left,

62:35it can take off just like before

62:37and land just like before.

62:38We are now also moving into a technology

62:42that doesn't require a commercial pilot

62:44because in some level,

62:45flight is actually easier than ground transportation.

62:48Like in self-driving cars,

62:50the world is full of like children and bicycles

62:54and other cars and mailboxes and curbs

62:56and shrubs and what have you,

62:58all these things you have to avoid.

63:00When you go above the buildings and tree lines,

63:03there's nothing there.

63:04I mean, you can do the test right now,

63:06look outside and count the number of things you see flying.

63:09I'd be shocked if you could see more than two things.

63:11It's probably just zero.

63:12In the Bay Area, the most I've ever seen was six.

63:16And maybe it's 15 or 20, but not 10,000.

63:20So the sky is very ample and very empty and very free.

63:23So the vision is, can we build a socially acceptable

63:27mass transit solution for daily transportation

63:32that is affordable?

63:34And we have an existence proof.

63:36Heaviside can fly 100 miles in range

63:39with still 30% electric reserves.

63:43It can fly up to like 180 miles an hour.

63:46We know that that solution at scale

63:48would make your ground transportation

63:5110 times as fast as a car

63:53based on US census or statistics data,

63:57which means we would take your 300 hours of daily,

64:00of yearly commute down to 30 hours

64:02and give you 270 hours back.

64:05Who wouldn't want, I mean, who doesn't hate traffic?

64:07Like I hate, give me the person who doesn't hate traffic.

64:10I hate traffic.

64:11Every time I'm in traffic, I hate it.

64:13And if we could free the world from traffic,

64:17we have technology, we can free the world from traffic.

64:20We have the technology.

64:21It's there, we have an existence proof.

64:23It's not a technological problem anymore.

64:25- Do you think there is a future where tens of thousands,

64:29maybe hundreds of thousands of both delivery drones

64:34and flying cars of this kind, EV towers fill the sky?

64:39- I absolutely believe this.

64:40And there's obviously the societal acceptance

64:43is a major question.

64:45And of course, safety is.

64:46I believe in safety,

64:48we're gonna exceed ground transportation safety

64:50as has happened for aviation already, commercial aviation.

64:54And in terms of acceptance,

64:56I think one of the key things is noise.

64:58That's why we are focusing relentlessly on noise

65:00and we built perhaps the quietest electric VTOL vehicle

§09Transcript · 1:05:05–1:13:22

65:05ever built.

65:06The nice thing about the sky is it's three dimensional.

65:09So any mathematician will immediately recognize

65:12the difference between 1D of like a regular highway

65:14to 3D of a sky.

65:16But to make it clear for the layman,

65:19say you wanna make 100 vertical lanes

65:22of highway 101 in San Francisco,

65:24because you believe building 100 vertical lanes

65:27is the right solution.

65:28Imagine how much it would cost

65:30to stack 100 vertical lanes physically onto 101.

65:33That would be prohibitive.

65:34That would be consuming the world's GDP for an entire year

65:37just for one highway.

65:39It's amazingly expensive.

65:41In the sky, it would just be a recompilation

65:43of a piece of software

65:44because all these lanes are virtual.

65:46That means any vehicle that is in conflict

65:49with another vehicle would just go to different altitudes

65:51and then the conflict is gone.

65:53And if you don't believe this,

65:55that's exactly how commercial aviation works.

65:58When you fly from New York to San Francisco,

66:01another plane flies from San Francisco to New York,

66:04they're at different altitudes

66:05so they don't hit each other.

66:06It's a solved problem for the jet space

66:10and it will be a solved problem for the urban space.

66:12There's companies like Google, Bing and Amazon

66:15working on very innovative solutions

66:16how do we have space management.

66:18They use exactly the same principles as we use today

66:21to route today's jets.

66:23There's nothing hard about this.

66:25- Do you envision autonomy being a key part of it

66:28so that the flying vehicles are either semi-autonomous

66:33or fully autonomous?

66:36- 100% autonomous.

66:37You don't want idiots like me flying in the sky.

66:40I promise you.

66:41And if you have 10,000,

66:43watch the movie "The Fifth Element"

66:45to get a fee for what would happen

66:48if it's not autonomous.

66:49- And a centralized, that's a really interesting idea

66:51of a centralized sort of management system

66:55for lanes and so on.

66:56So actually just being able to have

66:58similar as we have in the current commercial aviation

67:02but scale it up to much more vehicles.

67:05That's a really interesting optimization problem.

67:07- It is mathematically very, very straightforward.

67:11Like the gap we leave between jets is gargantuous.

67:13And part of the reason is there isn't that many jets.

67:16So it just feels like a good solution.

67:18Today, when you get vectored by air traffic control,

67:22someone talks to you, right?

67:23So an ATC controller might have up to maybe 20 planes

67:26on the same frequency.

67:28And then they talk to you, you have to talk back.

67:30And that feels right because there isn't more than 20 planes

67:32around anyhow, so you can talk to everybody.

67:34But if there's 20,000 things around,

67:36you can't talk to everybody anymore.

67:37So we have to do something that's called digital,

67:40like text messaging.

67:41Like we do have solutions.

67:43Like we have what, four or five billion smartphones

67:45in the world now, right?

67:46And they're all connected.

67:47And somehow we solve the scale problem for smartphones.

67:50We know where they all are.

67:51They can talk to somebody and they're very reliable.

67:54They're amazingly reliable.

67:56We could use the same system,

67:58the same scale for air traffic control.

68:01So instead of me as a pilot talking to a human being

68:04in the middle of the conversation,

68:06receiving a new frequency, like how ancient is that?

68:09We could digitize this stuff

68:11and digitally transmit the right flight coordinates.

68:15And that solution will automatically scale

68:18to 10,000 vehicles.

68:20- We talked about empathy a little bit.

68:22Do you think we'll one day build an AI system

68:25that a human being can love and that loves that human back?

68:30Like in the movie "Her."

68:31- Look, I'm a pragmatist.

68:33For me, AI is a tool.

68:35It's like a shovel.

68:37And the ethics of using the shovel are always

68:40with us, the people.

68:41And it has to be this way.

68:44In terms of emotions, I would hate to come into my kitchen

68:49and see that my refrigerator spoiled all my food,

68:54then have it explained to me that it fell in love

68:56with the dishwasher and I wasn't as nice as the dishwasher.

68:59So as a result, it neglected me.

69:02That would just be a bad experience

69:05and it would be a bad product.

69:07I would probably not recommend this refrigerator

69:09to my friends.

69:10And that's where I draw the line.

69:12I think to me, technology has to be reliable.

69:16It has to be predictable.

69:17I want my car to work.

69:19I don't want to fall in love with my car.

69:22I just want it to work.

69:24I want it to compliment me, not to replace me.

69:27I have very unique human properties

69:30and I want the machines to make me,

69:33turn me into a superhuman.

69:35Like I'm already a superhuman today,

69:37thanks to the machines that surround me.

69:39And I give you examples.

69:40I can run across the Atlantic near the speed of sound

69:45at 36,000 feet today.

69:48That's kind of amazing.

69:49My voice now carries me all the way to Australia

69:53using a smartphone today.

69:56And it's not the speed of sound, which would take hours.

70:00It's the speed of light.

70:01My voice travels at the speed of light.

70:03How cool is that?

70:04That makes me superhuman.

70:06I would even argue my flushing toilet makes me superhuman.

70:10Just think of the time before flushing toilets.

70:13And maybe you have a very old person in your family

70:16that you can ask about this

70:18or take a trip to rural India to experience it.

70:22It makes me superhuman.

70:25So to me, what technology does, it compliments me.

70:28It makes me stronger.

70:30Therefore, words like love and compassion have very little,

70:34have very little interest in this for machines.

70:38I have interest in people.

70:40- You don't think, first of all, beautifully put,

70:44beautifully argued,

70:45but do you think love has use in our tools, compassion?

70:50- I think love is a beautiful human concept.

70:53And if you think of what love really is,

70:55love is a means to convey safety, to convey trust.

71:00I think trust has a huge need in technology as well,

71:07not just people.

71:09We want to trust our technology

71:11the same way we, or in a similar way we trust people.

71:14In human interaction, standards have emerged

71:19and feelings, emotions have emerged,

71:21maybe genetically, maybe biologically,

71:23that are able to convey sense of trust, sense of safety,

71:26sense of passion, of love, of dedication

71:28that makes the human fabric.

71:30And I'm a big slacker for love.

71:33I want to be loved.

71:34I want to be trusted.

71:35I want to be admired.

71:36All these wonderful things.

71:38And because all of us, we have this beautiful system,

71:42I wouldn't just blindly copy this to the machines.

71:44Here's why.

71:46When you look at, say, transportation,

71:49you could have observed that up to the end

71:53of the 19th century, almost all transportation

71:56used any number of legs,

71:58from one leg to two legs to a thousand legs.

72:01And you could have concluded that is the right way

72:03to move about the environment.

72:06We've made the exception of birds, who use flapping wings.

72:08In fact, there were many people in aviation

72:10that flapped wings to their arms and jumped from cliffs.

72:13Most of them didn't survive.

72:15Then the interesting thing is that the technology solutions

72:19are very different.

72:21Like, in technology, it's really easy to build a wheel.

72:23In biology, it's super hard to build a wheel.

72:25There's very few perpetually rotating things in biology,

72:30and they usually run cells and things.

72:34In engineering, we can build wheels,

72:37and those wheels gave rise to cars.

72:39Similar wheels gave rise to aviation.

72:44Like, there's no thing that flies

72:46that wouldn't have something that rotates,

72:48like a jet engine or helicopter blades.

72:52So the solutions have used very different physical laws

72:55than nature, and that's great.

72:58So for me to be too much focused on,

73:00oh, this is how nature does it, let's just replicate it,

73:03if we really believed that the solution

73:05to the agricultural revolution was a humanoid robot,

73:08it would still be waiting today.

73:10- Again, beautifully put.

73:12You said that you don't take yourself too seriously.

73:15- Did I say that?

73:16You want me to say that?

73:19- Maybe I did.

73:20- You're not taking me seriously.

73:20- I'm not, yeah, that's right.

73:22- Good, you're right, I don't wanna.

§10Transcript · 1:13:24–1:18:28

73:24- I just made that up.

73:25But you have a humor and a lightness about life

73:29that I think is beautiful and inspiring to a lot of people.

73:33Where does that come from?

73:35The smile, the humor, the lightness amidst all the chaos

73:40of the hard work that you're in, where does that come from?

73:43- I just love my life.

73:44I love the people around me.

73:46I'm just so glad to be alive.

73:49Like, I'm, what, 52, hard to believe.

73:53People say 52 is a new 51, so now I feel better.

73:56(Lex laughing)

73:58But in looking around the world,

74:02looking, just go back 200, 300 years.

74:05Humanity is, what, 300,000 years old?

74:09But for the first 300,000 years minus the last 100,

74:13our life expectancy would have been

74:17plus or minus 30 years, roughly, give or take.

74:20So I would be long dead now.

74:22That makes me just enjoy every single day of my life

74:26because I don't deserve this.

74:28Why am I born today when so many of my ancestors

74:32died of horrible deaths, like famines, massive wars

74:37that ravaged Europe for the last 1,000 years,

74:41mystically disappeared after World War II

74:44when the Americans and the Allies did something amazing

74:47to my country that didn't deserve it,

74:49the country of Germany.

74:51This is so amazing.

74:52And then when you're alive and feel this every day,

74:56then it's just so amazing what we can accomplish,

75:01what we can do.

75:03We live in a world that is so incredibly

75:06vastly changing every day.

75:08Almost everything that we cherish,

75:10from your smartphone to your flushing toilet,

75:14to all these basic inventions,

75:16your new clothes you're wearing, your watch, your plane,

75:19penicillin, I don't know, anesthesia for surgery,

75:25penicillin, have been invented in the last 150 years.

75:30So in the last 150 years, something magical happened.

75:32And I would trace it back to Gutenberg

75:34and the printing press that has been able

75:35to disseminate information more efficiently than before,

75:38that all of a sudden we're able to invent agriculture

75:42and nitrogen fertilization that made agriculture

75:45so much more potent that we didn't have to work

75:48in the farms anymore and we could start reading and writing

75:50and we could become all these wonderful things

75:52we are today, from airline pilot to massage therapist

75:54to software engineer.

75:56It's just amazing.

75:57Like living in that time is such a blessing.

76:00We should sometimes really think about this.

76:03Steven Pinker, who is a very famous author and philosopher

76:07whom I really adore, wrote a great book called

76:09"Enlightenment Now" and that's maybe the one book

76:11I would recommend.

76:11And he asked the question if there was only

76:14a single article written in the 20th century,

76:17only one article, what would it be?

76:19What's the most important innovation,

76:21the most important thing that happened?

76:23And he would say this article would credit

76:24a guy named Carl Bosch.

76:27And I challenge anybody, have you ever heard

76:29of the name Carl Bosch?

76:31I hadn't, okay.

76:32There's a Bosch Corporation in Germany,

76:35but it's not associated with Carl Bosch.

76:37So I looked it up.

76:39Carl Bosch invented nitrogen fertilization.

76:42And in doing so, together with an older invention

76:45of irrigation, was able to increase the yield

76:49per agricultural land by a factor of 26.

76:52So a 2,500% increase in fertility of land.

76:57And that, so Steve Pinker argues,

77:00saved over two billion lives today.

77:03Two billion people who would be dead

77:05if this man hadn't done what he had done, okay?

77:08Think about that impact and what that means to society.

77:12That's the way I look at the world.

77:14I mean, it's just so amazing to be alive

77:16and to be part of this.

77:17And I'm so glad I lived after Carl Bosch and not before.

77:21- I don't think there's a better way to end this, Sebastian.

77:24It's an honor to talk to you,

77:25to have had the chance to learn from you.

77:27Thank you so much for talking to me.

77:28- Thanks for coming on, it's a real pleasure.

77:31- Thank you for listening to this conversation

77:32with Sebastian Thrun.

77:34And thank you to our presenting sponsor, Cash App.

77:37Download it, use code LEXPODCAST,

77:40you'll get $10 and $10 will go to FIRST,

77:43a STEM education nonprofit that inspires

77:45hundreds of thousands of young minds

77:47to learn and to dream of engineering our future.

77:50If you enjoy this podcast, subscribe on YouTube,

77:53get five stars on Apple Podcast, support on Patreon,

77:56or connect with me on Twitter.

77:58And now let me leave you with some words of wisdom

78:01from Sebastian Thrun.

78:03It's important to celebrate your failures

78:05as much as your successes.

78:07If you celebrate your failures really well,

78:09if you say, wow, I failed, I tried, I was wrong,

78:13but I learned something.

78:15Then you realize you have no fear.

78:18And when your fear goes away, you can move the world.

78:21Thank you for listening and hope to see you next time.

78:25(upbeat music)

78:28(upbeat music)

— 读到这里,多懂一点。 —