← Lex Fridman

Kate Darling: Social Robots, Ethics, Privacy and the Future of MIT

第329期2022-10-15English

嘉宾:Kate Darling

收听本集00:00 / 3:09:50
阅读设置
按你的习惯阅读
正文字号
下载播客精读
把这一篇,带走慢慢读

精读待补充

下载功能还未开放

§01Transcript · 00:00–08:06

00:00- I think that animals are a really great thought experiment

00:04when we're thinking about AI and robotics,

00:06because again, this comparing them to humans

00:09that leads us down the wrong path,

00:10both because it's not accurate,

00:12but also I think for the future, we don't want that.

00:16We want something that's a supplement.

00:17But I think animals,

00:18because we've used them throughout history

00:21for so many different things,

00:22we domesticated them not because they do what we do,

00:25but because what they do is different and that's useful.

00:28And it's just like,

00:30whether we're talking about companionship,

00:32whether we're talking about work integration,

00:34whether we're talking about responsibility for harm,

00:37there's just so many things we can draw on in that history

00:40from these entities that can sense, think,

00:43make autonomous decisions and learn

00:45that are applicable to how we should be thinking

00:48about robots and AI.

00:49- The following is a conversation with Kate Darling,

00:54her second time on the podcast.

00:56She's a research scientist at MIT Media Lab,

00:59interested in human robot interaction and robot ethics,

01:03which she writes about in her recent book

01:06called "The New Breed",

01:08what our history with animals reveals

01:10about our future with robots.

01:12Kate is one of my favorite people at MIT.

01:15She was a courageous voice of reason and compassion

01:18to the time of the Jeffrey Epstein scandal

01:20at MIT three years ago.

01:22We reflect on this time in this very conversation,

01:26including the lessons it revealed about human nature

01:29and our optimistic vision for the future of MIT,

01:33a university we both love and believe in.

01:36This is the Lex Friedman Podcast.

01:38To support it,

01:39please check out our sponsors in the description.

01:42And now, dear friends, here's Kate Darling.

01:45Last time we talked a few years back,

01:49you wore Justin Bieber's shirt for the podcast.

01:51So now looking back, you're a respected researcher,

01:56all the amazing accomplishments in robotics,

01:59you're an author.

02:00Was this one of the proudest moments of your life?

02:03Proudest decisions you've ever made?

02:05- Definitely.

02:06You handled it really well, though.

02:07It was cool, 'cause I walked in,

02:09I didn't know you were gonna be filming.

02:10I walked in and you're in a fucking suit.

02:13- Yeah.

02:14- And I'm like, why are you all dressed up?

02:16- Yeah.

02:16- And then you were so nice about it.

02:18You like made some excuses.

02:19You were like, oh, well, I'm interviewing some,

02:21didn't you say you were interviewing

02:22some military general afterwards to like--

02:24- Oh yeah, that was--

02:25- Make me feel better?

02:26- CTO of Lockheed Martin, I think.

02:27- Oh, that's what it was.

02:29- Yeah.

02:29- You didn't tell me, oh, I was dressed like this.

02:32- Are you an actual Bieber fan?

02:33Or was that like one of those T-shirts

02:36that's in the back of the closet

02:39that you use for painting?

02:40- I think I bought it for my husband as a joke.

02:42And yeah, we were gut renovating a house at the time

02:46and I had worn it to the site.

02:48- Got his joke and now you wear it.

02:50Okay, have you worn it since?

02:53Is this the one time?

02:54- No, like how could I touch it again?

02:57It was on your podcast.

02:58Now it's framed.

02:59- It's like a wedding dress or something like that.

03:01You don't, you only wear it once.

03:03You are the author of "The New Breed,

03:07What Our History With Animals Reveals

03:09About Our Future With Robots."

03:11You opened the book with the surprisingly tricky question,

03:14what is a robot?

03:15So let me ask you, let's try to sneak up to this question.

03:19What's a robot?

03:20That's not really sneaking up.

03:22- It's just asking it.

03:23- Yeah.

03:25- All right, well.

03:25(laughing)

03:27- What do you think a robot is?

03:29- What I think a robot is,

03:32is something that has some level of intelligence

03:36and some level of magic.

03:40That little shine in the eye, you know,

03:44that allows you to navigate the uncertainty of life.

03:50So that means, like autonomous vehicles to me in that sense,

03:53are robots because they navigate the uncertainty,

03:58the complexity of life.

04:00Obviously social robots are that.

04:02- I love that.

04:04I like that you mentioned magic 'cause that also,

04:07well, so first of all,

04:08I don't define robot definitively in the book

04:10because there is no definition.

04:13That everyone agrees on.

04:15And if you look back through time,

04:18people have called things robots until they lose the magic

04:21because they're more ubiquitous.

04:23Like a vending machine used to be called a robot

04:25and now it's not, right?

04:26So I do agree with you that there's this magic aspect

04:30which is how people understand robots.

04:35If you ask a roboticist,

04:37they have the definition of something that is,

04:39well, it has to be physical usually.

04:41It's not an AI agent.

04:43It has to be embodied.

04:44They'll say it has to be able to sense its environment

04:48in some way.

04:49It has to be able to make a decision autonomously

04:52and then act on its environment again.

04:55I think that's a pretty good technical definition

04:58even though it really breaks down

04:59when you come to things like the smartphone

05:01because the smartphone can do all of those things.

05:04And most robotists would not call it a robot.

05:06So there's really no one good definition.

05:09But part of why I wrote the book is because people have

05:14a definition of robot in their minds

05:17that is usually very focused on a comparison

05:21of robots to humans.

05:23So if you Google image search robot,

05:24you get a bunch of humanoid robots,

05:27robots with a torso and head and two arms and two legs.

05:30And that's the definition of robot

05:33that I'm trying to get us away from

05:35because I think that it trips us up a lot.

05:37- Why does the humanoid form trip us up a lot?

05:40- Well, because this constant comparison of robots to people,

05:45artificial intelligence to human intelligence,

05:47first of all, it doesn't make sense

05:48from a technical perspective

05:50because the early AI researchers,

05:54some of them were trying to recreate human intelligence.

05:56Some people still are,

05:57and there's a lot to be learned from that academically,

06:00et cetera, but that's not where we've ended up.

06:03AI doesn't think like people.

06:05We wind up in this fallacy where we're comparing these two.

06:09And when we talk about what intelligence even is,

06:13we're often comparing to our own intelligence.

06:15And then the second reason this bothers me

06:19is because it doesn't make sense.

06:21I just think it's boring to recreate intelligence

06:25that we already have.

06:26I see the scientific value

06:28of understanding our own intelligence,

06:30but from a practical,

06:32what could we use these technologies for perspective,

06:35it's much more interesting to create something new,

06:38to create a skillset that we don't have

06:40that we can partner with

06:41in what we're trying to achieve.

06:43- And it should be in some deep way similar to us,

06:48but in most ways different

06:51because you still want to have a connection,

06:53which is why the similarity might be necessary.

06:56- That's what people argue, yes.

06:58And I think that's true.

06:59So the two arguments for humanoid robots

07:02are people need to be able to communicate

07:05and relate to robots,

07:06and we relate most to things that are like ourselves.

07:10And we have a world that's built for humans.

07:12So we have stairs and narrow passageways and door handles.

07:15And so we need humanoid robots to be able to navigate that.

07:18And so you're speaking to the first one,

07:21which is absolutely true.

07:22But what we know from social robotics

07:24and a lot of human robot interaction research

07:26is that all you need is something that's enough

07:30like a person for it to give off cues

07:34that someone relates to,

07:35but that doesn't have to look human or even act human.

07:39You can take a robot like R2-D2

07:41and it just beeps and boops.

07:44And people love R2-D2, right?

07:45Even though it's just like a trash can on wheels.

07:47And they like R2-D2 more than C3PO, who's a humanoid.

07:50So there's lots of ways to make robots

07:55even better than humans in some ways

07:57and make us relate more to them.

08:00- Yeah, it's kind of amazing the variety of cues

08:03that can be used to anthropomorphize the thing,

08:06like a glowing orb or something like that.

§02Transcript · 08:08–17:06

08:08Just a voice, just subtle basic interaction.

08:13I think people sometimes over-engineer these things.

08:17Like simplicity can go a really long way.

08:19- Totally.

08:20I mean, ask any animator and they'll know that.

08:22- Yeah, yeah, those are actually,

08:24so the people behind Cosmo, the robot,

08:29the right people to design those is animators,

08:33like Disney type of people versus like roboticists.

08:38- Robotists, quote unquote, are mostly clueless.

08:41It seems like--

08:44- They just have their own discipline

08:45that they're very good at and they don't have--

08:47- Yeah, but that, don't, you know.

08:51I feel like robotics of the early 21st century

08:56is not going to be the robotics of the later 21st century.

09:01Like if you call yourself a roboticist,

09:03it'd be something very different.

09:05'Cause I think more and more you'd be like a,

09:10maybe like a control engineer or something,

09:12controls engineer, like you separate,

09:15because ultimately all the unsolved,

09:18all the big problems of robotics

09:21will be in the social aspect,

09:24in the interacting with humans aspect,

09:26in the perception interpreting the world aspect,

09:31in the brain part, not the basic control level part.

09:36- You call it basic, it's actually really complex.

09:40- It's very, very complicated.

09:41- And that's why, but like, I think you're so right

09:44and what a time to be alive, because for me, I just,

09:49we've had robots for so long

09:52and they've just been behind the scenes.

09:54And now finally robots are getting deployed into the world.

09:58- They're coming out of the closet.

10:00- Yeah, and we're seeing all these mistakes

10:02that companies are making because they focus so much

10:04on the engineering and getting that right

10:06and getting the robot to be even be able to function

10:09in a space that it shares with a human.

10:12- See what I feel like people don't understand

10:15is to solve the perception and the control problem.

10:19You shouldn't try to just solve

10:21the perception control problem.

10:22You should teach the robot how to say,

10:25"Oh shit, I'm sorry, I fucked up."

10:28- Yeah, or ask for help.

10:29- Or ask for help or be able to communicate the uncertainty.

10:34Yeah, exactly, all of those things,

10:36because you can't solve the perception control.

10:38We humans haven't solved it.

10:40We're really damn good at it.

10:42But the magic is in the self-deprecating humor

10:48and the self-awareness about where our flaws are,

10:51all that kind of stuff.

10:52- Yeah, and there's a whole body of research

10:54in human robot interaction showing like ways to do this.

10:58But a lot of these companies haven't, they don't do HRI.

11:01They like the, have you seen the grocery store robot

11:05in the Stop and Shop?

11:06- Yes.

11:07- Yeah, the Marty, it looks like a giant penis.

11:09It's like six feet tall, it roams the aisles.

11:11- I will never see Marty the same way again.

11:13Thank you for that.

11:14- You're welcome.

11:15But like, these poor people worked so hard

11:20on getting a functional robot together.

11:23And then people hate Marty because they didn't at all

11:26consider how people would react to Marty in their space.

11:30- Does everybody, I mean, you talk about this,

11:33do people mostly hate Marty?

11:34'Cause I like Marty.

11:36- Yeah, but you like Flippy.

11:38- Yeah, I do.

11:39- And actually like--

11:40- There's a parallel between the two?

11:43- I believe there is.

11:44So we were actually gonna do a study on this

11:45right before the pandemic hit, and then we canceled it

11:48because we didn't wanna go to the grocery store

11:49and neither did anyone else.

11:51But our theory, so this was with a student at MIT,

11:56Daniela Di Paola.

11:57She noticed that everyone on Facebook, in her circles,

12:00was complaining about Marty.

12:02They were like, "What is this creepy robot?

12:04"It's watching me, it's always in the way."

12:06And she did this quick and dirty sentiment analysis

12:09on Twitter where she was looking at positive

12:11and negative mentions of the robot.

12:13And she found that the biggest spike of negative mentions

12:16happened when Stop and Shop threw a birthday party

12:20for the Marty robots, like with free cake and balloons.

12:24Like, who complains about free cake?

12:26Well, people who hate Marty, apparently.

12:28And so we were like, "That's interesting."

12:31And then we did this online poll.

12:34We used Mechanical Turk, and we tried to get at

12:38what people don't like about Marty.

12:41And a lot of it wasn't, "Oh, Marty's taking jobs."

12:44It was, "Marty is the surveillance robot,"

12:47which it's not.

12:48It looks for spills on the floor.

12:48It doesn't actually look at any people.

12:52It's watching, it's creepy, it's getting in the way.

12:55Those were the things that people complained about.

12:56And so our hypothesis became, "Is Marty a real-life Clippy?"

13:01Because I know, Lex, you love Clippy,

13:05but many people hated Clippy.

13:07- Well, there's a complex thing there.

13:09It could be like marriage.

13:10A lot of people seem to like to complain about marriage,

13:13but they secretly love it.

13:15So it could be, the relationship you might have

13:18with Marty is like, "Oh, there he goes again,

13:23"doing his stupid surveillance thing."

13:26But you grow to love the,

13:28I mean, bitching about the thing

13:33that kind of releases a kind of tension.

13:35And there's, I mean, some people, a lot of people,

13:38show love by sort of busting each other's chops,

13:43like making fun of each other.

13:45And then I think people would really love it

13:48if Marty talked back.

13:49And there's so many possible options for humor there.

13:56One, you can lean in.

13:58You can be like, "Yes, I'm an agent of the CIA,

14:01"monitoring your every move,"

14:03like mocking people that are concerned,

14:05you know what I'm saying?

14:06Yes, I'm watching you because you're so important

14:09with your shopping patterns.

14:11I'm collecting all this data.

14:13Or just any kind of making fun of people, I don't know.

14:18But I think you hit on what exactly it is

14:20because when it comes to robots or artificial agents,

14:24I think people hate them more

14:26than they would some other machine or device or object.

14:30And it might be that thing,

14:34it might be combined with love or like whatever it is,

14:36it's a more extreme response

14:38because they view these things as social agents

14:41and not objects.

14:42And that was, so Clifford Nass

14:45was a big human-computer interaction person.

14:48And his theory about Clippy was that

14:52because people viewed Clippy as a social agent,

14:55when Clippy was annoying and would like bother them

14:58and interrupt them and like not remember what they told him,

15:02that's when people got upset

15:03because it wasn't fulfilling their social expectations.

15:06And so they complained about Clippy more

15:08than they would have if it had been a different,

15:10like not a virtual character.

15:14- So is complaining to you a sign

15:16that we're on the wrong path with a particular robot?

15:19Or is it possible, like again, like marriage,

15:23like family, that there still is a path

15:28towards that direction

15:29where we can find deep, meaningful relationships?

15:32- I think we absolutely can find

15:34deep, meaningful relationships with robots.

15:36And well, maybe with Marty.

15:38I mean, I just would,

15:40I would have designed Marty a little differently.

15:42- Like how?

15:43Isn't there a charm to the clumsiness, the slowness?

15:46- There is if you're not trying to get through

15:48with a shopping cart and a screaming child.

15:50You know, there's, I think,

15:53I think you could make it charming.

15:54I think there are lots of design tricks

15:56that they could have used.

15:58And one of the things they did,

16:00I think without thinking about it at all,

16:01is they slapped two big googly eyes on Marty.

16:04- Oh yeah.

16:05- And I wonder if that contributed maybe

16:07to people feeling watched

16:10because it's looking at them.

16:13And so like, is there a way to design the robot

16:18to do the function that it's doing

16:21in a way that people are actually attracted to

16:24rather than annoyed by?

16:25And there are many ways to do that,

16:27but companies aren't thinking about it.

16:29Now they're realizing

16:30that they should have thought about it.

16:31- Yeah.

16:32I wonder if there's a way to,

16:33if it would help to make Marty seem like an entity

16:38of its own versus the arm of a large corporation.

16:43So there's some sense where this is just the camera

16:50that's monitoring people versus this is an entity

16:54that's a standalone entity.

16:56It has its own task and it has its own personality.

16:59The more personality you give it,

17:01the more it feels like it's not sharing data

17:06with anybody else.

§03Transcript · 17:07–26:12

17:07Like when we see other human beings,

17:10our basic assumption is whatever I say to this human being,

17:14it's not like being immediately sent to the CIA.

17:17- Yeah, what I say to you,

17:18no one's gonna hear that, right?

17:19- Yeah, that's true.

17:20That's true.

17:21- No, I'm kidding.

17:22- But you forget it.

17:23I mean, you do forget it.

17:24I mean, I don't know if that even with microphones here,

17:26you forget that that's happening,

17:28but for some reason, I think probably with Marty,

17:31I think when it's done really crudely and crappily,

17:36you start to realize, oh, this is like PR people

17:39trying to make a friendly version of a surveillance machine.

17:44But I mean, that reminds me of the slight clumsiness

17:50or significant clumsiness on the initial releases

17:53of the avatars for the metaverse.

17:55I don't know, what are your actually thoughts about that?

17:58The way the avatars,

18:04the way Mark Zuckerberg looks in that world,

18:08in the metaverse, the virtual reality world

18:12where you can have virtual meetings and stuff like that.

18:14How do we get that right?

18:16Do you have thoughts about that?

18:17'Cause it's a kind of,

18:18it feels like a similar problem to social robotics,

18:25which is how you design a digital virtual world

18:29that is compelling when you connect to others

18:34there in the same way that physical connection is.

18:38- Right, I haven't looked into,

18:40I mean, I've seen people joking about it on Twitter

18:42and posting whatever.

18:44- Yeah, but I mean, have you seen it?

18:45'Cause there's something you can't quite put into words

18:49that doesn't feel genuine about the way it looks.

18:54And so the question is, if you and I were to meet virtually,

18:58what should the avatars look like

19:02for us to have similar kind of connection?

19:04Should it be really simplified?

19:07Should it be a little bit more realistic?

19:09Should it be cartoonish?

19:11Should it be more,

19:12better capturing of expressions

19:18in interesting, complex ways

19:21versus like cartoonish, oversimplified ways?

19:24- But haven't video games figured this out?

19:26I'm not a gamer, so I don't have any examples,

19:28but I feel like there's this whole world in video games

19:31where they've thought about all of this,

19:33and depending on the game, they have different avatars,

19:36and a lot of the games are about connecting with others.

19:40The thing that I don't know is,

19:42and again, I haven't looked into this at all.

19:45I've been shockingly not very interested in the metaverse,

19:48but they must've poured so much investment into this meta.

19:53And why is it so bad?

20:02Like, there's gotta be a reason.

20:04There's gotta be some thinking behind it, right?

20:06- Well, I talked to Carmack about this,

20:10John Carmack, who's a part-time Oculus CTO.

20:15I think there's several things to say.

20:20One is, as you probably know,

20:22that I mean, there's bureaucracy,

20:23there's large corporations,

20:25and they often, large corporations have a way

20:28of killing the indie kind of artistic flame

20:33that's required to create something really compelling.

20:38Somehow they make everything boring,

20:40'cause they run through this whole process

20:42through the PR department,

20:44through all that kind of stuff,

20:45and it somehow becomes generic through that process.

20:48- 'Cause they strip out anything interesting

20:50because it could be controversial, is that, or?

20:52- Yeah, right, exactly.

20:54Like, what, I mean, we're living through this now,

20:58like, with a lot of people with cancellations

21:03and all those kinds of stuff,

21:04people are nervous, and nervousness results in,

21:07like usual, the assholes are ruining everything.

21:11But, you know, the magic of human connection

21:13is taking risks, of making a risky joke,

21:16of, like, with people you like who are not assholes,

21:20good people, like, some of the fun in the metaverse

21:24or in video games is, you know, being edgier,

21:28being interesting, revealing your personality

21:30in interesting ways.

21:31In the sexual tension or in,

21:36they're definitely paranoid about that.

21:38- Oh, yeah. - Because, like,

21:39in metaverse, the possibility of sexual assault

21:42and sexual harassment and all that kind of stuff,

21:44it's obviously very high, but they're,

21:47so you should be paranoid to some degree,

21:50but not too much, because then you remove completely

21:53the personality of the whole thing.

21:54Then everybody's just like a vanilla bot that,

21:58like, you have to have ability

22:01to be a little bit political, to be a little bit edgy,

22:05all that kind of stuff,

22:06and large companies tend to suffocate that.

22:09So, but in general, just forget all that,

22:12just the ability to come up

22:14with really cool, beautiful ideas.

22:19If you look at, I think Grimes tweeted about this,

22:23she's very critical about the metaverse,

22:25is that,

22:26you know, independent game designers

22:33have solved this problem

22:34of how to create something beautiful

22:35and interesting and compelling.

22:37They do a really good job.

22:39So you have to let those kinds of minds,

22:41the small groups of people, design things

22:44and let them run with it, let them run wild

22:47and do edgy stuff, yeah.

22:49But otherwise you get this kind of,

22:53you get a clippy type of situation, right?

22:55Which is like a very generic looking thing.

22:59But even clippy has some, like,

23:02that's kind of wild that you would take a paperclip

23:07and put eyes on it.

23:08- And suddenly people are like, oh, you're annoying,

23:10but you're definitely a social agent.

23:13- And I just feel like that wouldn't even,

23:15that clippy thing wouldn't even survive Microsoft

23:19or Facebook of today, meta of today.

23:23'Cause it would be like, well,

23:24there'll be these meetings about why is it a paperclip?

23:28Like, why don't we, it's not sufficiently friendly,

23:30let's make it, you know.

23:32And then all of a sudden the artist

23:34that with whom it originated is killed

23:37and it's all PR, marketing people

23:40and all of that kind of stuff.

23:41Now, they do important work to some degree,

23:45but they kill the creativity.

23:47- I think the killing of the creativity is in the whole,

23:50like, okay, so what I know from social robotics is like,

23:53obviously if you create agents that,

23:57okay, so take for an example,

23:59you'd create a robot that looks like a humanoid

24:01and it's, you know, Sophia or whatever.

24:04Now, suddenly you do have all of these issues

24:07where are you reinforcing an unrealistic beauty standard?

24:11Are you objectifying women?

24:14Why is the robot?

24:15Why is it white?

24:16So you have, but the thing is,

24:17I think that with creativity,

24:20you can find a solution that's even better

24:25where you're not even harming anyone

24:28and you're creating a robot that looks like,

24:31not humanoid, but like something

24:33that people relate to even more.

24:35And now you don't even have any of these bias issues

24:38that you're creating.

24:39And so how do we create that within companies?

24:42Because I don't think it's really about,

24:44like, 'cause I, you know, maybe we disagree on that.

24:48I don't think that edginess or humor or interesting things

24:52need to be things that harm or hurt people

24:55or that people are against.

24:56There are ways to find things that everyone is fine with.

24:59Why aren't we doing that?

25:01- The problem is there's departments

25:03that look for harm in things.

25:05- Yeah.

25:06- And so they will find harm in things that have no harm.

25:09- Okay.

25:10- That's the big problem

25:11because their whole job is to find harm in things.

25:13So what you said is completely correct,

25:16which is edginess should not hurt,

25:19doesn't necessarily, doesn't need to be a thing

25:22that hurts people, obviously.

25:25Great humor, great personality doesn't have to,

25:30like Clippy.

25:31But yeah, I mean, but it's tricky to get right.

25:36I'm not exactly sure.

25:37I don't know.

25:38I don't know why a large corporation

25:40with a lot of funding can't get this right.

25:41- I do think you're right

25:42that there's a lot of aversion to risk.

25:44And so if you get lawyers involved

25:46or people whose job it is, like you say, to mitigate risk,

25:50they're just gonna say no to most things

25:52that could even be in some way.

25:54Yeah.

25:56Yeah, you get the problem in all organizations.

25:58So I think that you're right, that that is a problem.

26:00- I think what's the way to solve that

26:02in large organizations is to have Steve Jobs

26:04type of characters.

26:06Unfortunately, you do need to have, I think,

26:10from a designer perspective,

26:12or maybe like a Johnny Ive,

§04Transcript · 26:14–35:13

26:14that is almost like a dictator.

26:17- Yeah, you want a benevolent dictator.

26:18- Yeah, who rolls in and says,

26:20cuts through the lawyers, the PR,

26:24but has a benevolent aspect.

26:26Like, yeah, there's a good heart and make sure,

26:29like I think all great artists and designers

26:32create stuff that doesn't hurt people.

26:35Like if you have a good heart,

26:36you're going to create something

26:37that's going to actually make a lot of people feel good.

26:41That's what like people like Johnny Ive,

26:43what they love doing is creating a thing

26:46that brings a lot of love to the world.

26:48They imagine like millions of people using the thing

26:50and it instills them with joy.

26:53That's that, you could say that about social robotics,

26:56you could say that about the metaverse.

26:59It shouldn't be done by the PR people,

27:01should be done by the designers.

27:03- I agree, PR people ruin everything.

27:06- Yeah, all the fun.

27:07(laughs)

27:09In the book, you have a picture,

27:11I just have a lot of ridiculous questions.

27:13You have a picture of two hospital delivery robots

27:16with a caption that reads, by the way,

27:18see your book, I appreciate that it keeps the humor in.

27:23You didn't run it by the PR department.

27:25- No, no one edited the book, we got rushed through.

27:28(laughs)

27:29- The caption reads, two hospital delivery robots

27:33whose sexy nurse names Roxy and Lola

27:36made me roll my eyes so hard they almost fell out.

27:39What aspect of it made you roll your eyes?

27:42Is it the naming?

27:44- It was the naming.

27:45The form factor is fine, it's like a little box on wheels.

27:48The fact that they named them, also great.

27:50That'll let people enjoy interacting with them.

27:53We know that even just giving a robot a name,

27:56people will, it facilitates technology adoption,

27:59people will be like, oh, you know,

28:02Betsy made a mistake, let's help her out

28:04instead of the stupid robot doesn't work.

28:06But why Lola and Roxy?

28:09Like--

28:10- Those are to you, too sexy?

28:12- I mean, there's research showing that

28:14a lot of robots are named according to gender biases

28:21about the function that they're fulfilling.

28:24So, you know, robots that are helpful and assistance

28:27and are like nurses are usually female-gendered.

28:32Robots that are powerful, all wise computers like Watson

28:35usually have like a booming male coded voice and name.

28:40So, like that's one of those things, right?

28:45You're opening a can of worms for no reason, for no reason.

28:48- You can avoid this whole can of worms.

28:49- Yeah, just give it a different name.

28:51Like why Roxy?

28:53It's because people aren't even thinking.

28:55So to some extent, I don't like PR departments,

28:59but getting some feedback on your work

29:02from a diverse set of participants,

29:04listening and taking in things

29:08that help you identify your own blind spots.

29:11And then you can always make your good leadership choices

29:14and good, like you can still ignore things

29:16that you don't believe are an issue,

29:19but having the openness to take in feedback

29:23and making sure that you're getting the right feedback

29:25from the right people, I think that's really important.

29:28- So don't unnecessarily propagate the biases of society.

29:32- Yeah, why?

29:33- In the design.

29:35But if you're not careful when you do the research of,

29:40like you might, if you ran a poll with a lot of people

29:45of all the possible names these robots have,

29:48they might come up with Roxy and Lola

29:50as names they would enjoy most.

29:55That could come up as the highest.

29:58- As in you do marketing research and then,

30:02well, that's what they did with Alexa.

30:03They did marketing research and nobody wanted the male voice.

30:07Everyone wanted it to be female.

30:09- Well, what do you think about that?

30:10If I were to say, I think the role of a great designer,

30:17again, to go back to Johnny Ive,

30:19is to throw out the marketing research.

30:23Like take it in, do it, learn from it.

30:26But if everyone wants Alexa to be a female voice,

30:31the role of the designer is to think deeply

30:33about the future of social agents in the home and think.

30:38Like what does that future look like?

30:40And try to reverse engineer that future.

30:43So in some sense, there's this weird tension.

30:46Like you want to listen to a lot of people,

30:49but at the same time, you're creating a thing

30:52that defines the future of the world.

30:54And the people that you're listening to

30:57are part of the past.

30:59So like that weird tension.

31:02- Yeah, I think that's true.

31:03And I think some companies like Apple

31:06have historically done very well at understanding a market

31:10and saying, you know what our role is?

31:11It's not to listen to what the current market says.

31:14It's to actually shape the market

31:16and shape consumer preferences.

31:18And companies have the power to do that.

31:20They can be forward thinking

31:22and they can actually shift

31:24what the future of technology looks like.

31:27And I agree with you that I would like to see more of that,

31:29especially when it comes to existing biases that we know.

31:34I think there's the low hanging fruit

31:39of companies that don't even think about it at all

31:41and aren't talking to the right people

31:42and aren't getting the full information.

31:44And then there's companies

31:45that are just like doing the safe thing

31:47and giving consumers what they want now.

31:49But to be really forward looking and be really successful,

31:52I think you have to make some judgment calls

31:55about what the future is gonna be.

31:57- But do you think it's still useful to gender

31:59and to name the robots?

32:01- Yes, I mean, gender is a minefield,

32:06but people, it's really hard to get people

32:10to not gender a robot in some way.

32:14So if you don't give it a name

32:16or you give it a ambiguous voice,

32:20people will just choose something.

32:22And maybe that's better than just entrenching something

32:27that you've decided is best.

32:30But I do think it can be helpful

32:33on the anthropomorphism engagement level

32:36to give it attributes that people identify with.

32:39- Yeah, I think a lot of roboticists I know,

32:42they don't gender the robot.

32:44They even try to avoid naming the robot

32:46or naming it something that can be used

32:50as a name in conversation kind of thing.

32:53And I think that actually that's irresponsible

32:57because people are going to anthropomorphize

33:02the thing anyway.

33:03So you're just removing from yourself

33:06the responsibility of how they're going

33:08to anthropomorphize it.

33:09- That's a good point.

33:11- And so you want to be able to,

33:13they're going to do it.

33:15You have to start to think about how they're going to do it.

33:17Even if the robot is a Boston Dynamics robot

33:20that's not supposed to have any kind of social component,

33:25they're obviously going to project

33:27a social component to it.

33:28Like that arm, I worked a lot with quadrupeds now

33:33with robot dogs.

33:35You know, that arm, people think is the head immediately.

33:39It's supposed to be an arm,

33:40but they start to think it's a head.

33:41And you have to like acknowledge that.

33:44You can't, I mean--

33:45- They do now.

33:46- They do now?

33:47- Well, they've deployed the robots

33:48and people are like, oh my God,

33:50the cops are using a robot dog.

33:53And so they have this PR nightmare.

33:54And so they're like, oh yeah.

33:58Okay, maybe we should hire some HR people.

34:00- Well, Boston Dynamics is an interesting company,

34:04or any of the others that are doing a similar thing

34:07because their main source of money

34:11is in the industrial application.

34:14So like surveillance of factories and doing dangerous jobs.

34:18So to them, it's almost good PR

34:22for people to be scared of these things

34:25'cause it's for some reason, as you talk about,

34:28people are naturally for some reason scared.

34:31We could talk about that, of robots.

34:33And so it becomes more viral.

34:35Like playing with that little fear.

34:38And so it's almost like a good PR

34:40because ultimately they're not trying

34:41to put them in the home and have a good social connection.

34:44They're trying to put them in factories.

34:46And so they have fun with it.

34:48If you watch Boston Dynamics videos,

34:50they're aware of it.

34:52- Oh yeah.

34:53- They're, I mean, I was--

34:54- The videos for sure that they put out.

34:57- It's almost like an unspoken tongue in cheek thing.

35:01They're aware of how people are going to feel

35:05when you have a robot that does like a flip.

35:08Now most of the people are just like excited

35:11about the control problem of it.

35:13Like how to make the whole thing happen.

§05Transcript · 35:15–44:12

35:15But they're aware when people see.

35:18- Well, I think they became aware.

35:20I think that in the beginning,

35:21they were really, really focused on just the engineering.

35:24I mean, they're at the forefront of robotics,

35:27like locomotion and stuff.

35:28And then when they started doing the videos,

35:31I think that was kind of a labor of love.

35:34I know that the former CEO, Mark,

35:37like he oversaw a lot of the videos

35:38and made a lot of them himself.

35:40And like, he's even really detail-oriented.

35:42Like there can't be like some sort of incline

35:45that would give the robot an advantage.

35:46They're very, like he was very,

35:48a lot of integrity about the authenticity of them.

35:51But then when they started to go viral,

35:54I think that's when they started to realize,

35:56oh, there's something interesting here that,

36:03I don't know how much they took it seriously

36:05in the beginning, other than realizing

36:07that they could play with it in the videos.

36:10I know that they take it very seriously now.

36:13- What I like about Boston Dynamics and similar companies,

36:17it's still mostly run by engineers.

36:19But, you know, I've had my criticisms.

36:25There's a bit more PR leaking in.

36:28But those videos are made by engineers

36:31'cause that's what they find fun.

36:33It's like testing the robustness of the system.

36:36I mean, they're having a lot of fun there with the robots.

36:41- Totally.

36:42Have you been to visit?

36:45- Yeah, yeah, yeah.

36:46It's one of the most,

36:48I mean, 'cause I have eight robot dogs now.

36:55- Wait, you have eight robot dogs?

36:58What?

36:58Are they just walking around your place?

37:00Like where do you keep them? - Yeah, I'm working on them.

37:02That's actually one of my goals

37:04is to have at any one time always a robot moving.

37:09- Oh. - I'm far away from that.

37:10- That's an ambitious goal.

37:13- Well, I have like more Roombas that I know what to do with.

37:15The Roomba that I program.

37:17So the programmable Roombas.

37:20- Nice.

37:20- And I have a bunch of little, like I built,

37:23I'm not finished with it yet,

37:24but bought a robot from Rick and Morty.

37:27I still have a bunch of robots everywhere.

37:29But the thing is, what happens is

37:32you're working on one robot at a time

37:34and that becomes like a little project.

37:38It's actually very difficult to have

37:40just a passively functioning robot always moving.

37:46- Yeah.

37:47- And that's a dream for me

37:48'cause I'd love to create that kind of a little world.

37:51So the impressive thing about Boston Dynamics to me

37:54was to see like hundreds of spots.

37:59And like there was a,

38:00the most impressive thing that still sticks with me

38:02is there was a spot robot walking down the hall

38:07seemingly with no supervision whatsoever.

38:12And he was wearing, he or she, I don't know,

38:13was wearing a cowboy hat.

38:15It was just walking down the hall

38:18and nobody paying attention.

38:19And it's just like walking down this long hall.

38:22And I'm like looking around, is anyone,

38:26like what's happening here?

38:28So presumably some kind of automation was doing the map.

38:30I mean, the whole environment is probably really well mapped.

38:33But it was just, it gave me a picture of a world

38:38where a robot is doing his thing, wearing a cowboy hat,

38:41just going down the hall,

38:44like getting some coffee or whatever.

38:45Like I don't know what it's doing, what's the mission.

38:47But I don't know, for some reason it really stuck with me.

38:49You don't often see robots that aren't part of a demo

38:53or that aren't, you know, like with a semi-autonomous

38:57or autonomous vehicle, like directly doing a task.

39:01This was just chilling.

39:02- Yeah. - Walking around.

39:04I don't know.

39:05- Well, yeah, you know, I mean, we're at MIT.

39:07Like when I first got to MIT, I was like,

39:09okay, where's all the robots?

39:11And they were all like broken or like not demoing.

39:14So yeah.

39:16And what really excites me is that we're about to have that.

39:21We're about to have so many moving about too.

39:24Well, it's coming.

39:25It's coming in our lifetime

39:26that we will just have robots moving around.

39:29We're already seeing the beginnings of it.

39:30There's delivery robots in some cities, on the sidewalks.

39:34And I just love seeing like the TikToks

39:36of people reacting to that.

39:38Because yeah, you see a robot walking down the hall

39:40with a cowboy hat.

39:42You're like, what the fuck?

39:43What is this?

39:44This is awesome and scary and kind of awesome.

39:47And people either love or hate it.

39:49That's one of the things that I think companies

39:51are underestimating that people will either love a robot

39:54or hate a robot and nothing in between.

39:56So it's just, again, an exciting time to be alive.

40:00- Yeah, I think kids almost universally,

40:03at least in my experience, love them.

40:05Love legged robots.

40:08- If they're not loud.

40:09My son hates the Roomba because ours is loud.

40:12- Oh, that, yeah.

40:14No, the legs, the legs make a difference.

40:16'Cause I don't, your son,

40:18do they understand Roomba to be a robot?

40:23- Oh yeah, my kids, that's one of the first words

40:25they learned.

40:26They know how to say beep boop.

40:27And yes, they think the Roomba's a robot.

40:29- Do they project intelligence out of the thing?

40:32- Well, we don't really use it around them anymore

40:34for the reason that my son is scared of it.

40:37- Yeah, that's really interesting.

40:41- I think they would.

40:42Even a Roomba, because it's moving around on its own,

40:47I think kids and animals view it as an agent.

40:51- So what do you think, if we just look at the state

40:54of the art of robotics, what do you think robots

40:56are actually good at today?

40:58So if we look at today.

40:59- You mean physical robots?

41:01- Yeah, physical robots.

41:02- Wow.

41:05- Like what are you impressed by?

41:07So I think a lot of people, I mean,

41:09that's what your book is about,

41:10is maybe not a perfectly calibrated understanding

41:15of where we are in terms of robotics,

41:20what's difficult in robotics, what's easy in robotics.

41:22- Yeah, we're way behind where people think we are.

41:26So what's impressive to me, so let's see.

41:31Oh, one thing that came out recently

41:34was Amazon has this new warehouse robot,

41:36and it's the first autonomous warehouse robot

41:41that is safe for people to be around.

41:44And so it's kind of, most people I think envision

41:48that our warehouses are already fully automated

41:51and that there's just robots doing things.

41:54It's actually still really difficult

41:56to have robots and people in the same space

41:59because it's dangerous for the most part.

42:01Robots, because especially robots

42:04that have to be strong enough to move something heavy,

42:06for example, they can really hurt somebody.

42:09And so until now, a lot of the warehouse robots

42:12had to just move along like preexisting lines,

42:15which really restricts what you can do.

42:17And so having, I think that's one of the big challenges

42:23and one of the big exciting things that's happening

42:25is that we're starting to see more cobotics

42:29in industrial spaces like that,

42:30where people and robots can work side by side

42:33and not get harmed.

42:35- Yeah, that's what people don't realize,

42:37sort of the physical manipulation task with humans.

42:41It's not that the robots wanna hurt you.

42:44I think that's what people are worried about,

42:46like this malevolent robot gets mad of its own

42:50and wants to destroy all humans.

42:52No, it's actually very difficult to know where the human is

42:55and to respond to the human and dynamically

43:00and collaborate with them on a task,

43:03especially if you're something like

43:04an industrial robotic arm, which is extremely powerful.

43:08Some of those arms are pretty impressive now

43:13that you can grab it, you can move it.

43:17So the collaboration between human and robot

43:21in the factory setting is really fascinating.

43:23Do you think they'll take our jobs?

43:27- I don't think it's that simple.

43:29I think that there's a ton of disruption that's happening

43:33and will continue to happen.

43:35I think speaking specifically of the Amazon warehouses,

43:40that might be an area where it would be good for robots

43:43to take some of the jobs that are,

43:45where people are put in a position where it's unsafe

43:48and they're treated horribly.

43:50And probably it would be better if a robot did that.

43:53And Amazon is clearly trying to automate that job away.

43:57So I think there's gonna be a lot of disruption.

44:00I do think that robots and humans

44:03have very different skillsets.

44:05So while a robot might take over a task,

44:08it's not gonna take over most jobs.

44:12I think just things will change a lot.

§06Transcript · 44:16–53:52

44:16Like, I don't know, one of the examples

44:18I have in the book is mining.

44:20So there you have this job that is very unsafe

44:26and that requires a bunch of workers

44:28and puts them in unsafe conditions.

44:30And now you have all these different robotic machines

44:33that can help make the job safer.

44:36And as a result, now people can sit in these

44:38like air conditioned remote control stations

44:42and like control these autonomous mining trucks.

44:45And so that's a much better job,

44:47but also they're employing less people now.

44:49So it's just a lot of,

44:54I think from a bird's eye perspective,

44:57you're not gonna see job loss.

44:58You're gonna see more jobs created because that's,

45:03the future is not robots just becoming like people

45:07and taking their jobs.

45:08The future is really a combination of our skills

45:11and then the supplemental skillset that robots have

45:14to increase productivity,

45:15to help people have better, safer jobs,

45:18to give people work that they actually enjoy doing

45:22and are good at.

45:24But it's really easy to say that

45:26from a bird's eye perspective

45:28and ignore kind of the rubble on the ground

45:33as we go through these transitions,

45:35because of course specific jobs are going to get lost.

45:39- If you look at the history of the 20th century,

45:41it seems like automation constantly increases productivity

45:46and improves the average quality of life.

45:51So it's been always good.

45:53So like thinking about this time being different

45:58is that we would need to go against the lessons of history.

46:01- It's true.

46:03- And the other thing is I think people think

46:06that the automation of the physical tasks is easy.

46:10I was just in Ukraine and the interesting thing is,

46:13I mean, there's a lot of difficult and dark lessons

46:18just about a war zone.

46:20But one of the things that happens in war

46:22is there's a lot of mines that are placed.

46:25This one of the big problems for years

46:31after a war is even over

46:33is the entire landscape is covered in mines.

46:35And so there's a demining effort.

46:39And you would think robots would be good

46:43at this kind of thing.

46:44Or like your intuition would be like,

46:45well, say you have unlimited money

46:48and you wanna do a good job of it, unlimited money.

46:51You would get a lot of really nice robots.

46:53But no, humans are still far superior.

46:57- Or animals. - At this kind of tech.

46:58Or animals.

46:59But humans with animals together.

47:02- Yeah. - You can't just have--

47:03- That's true. - A dog with a hat.

47:05(both laughing)

47:06- That's fair.

47:07- But yes, but figuring out also how to disable the mine.

47:13Obviously the easy thing,

47:17the thing a robot can help with

47:19is to find the mine and blow it up.

47:24But that's gonna destroy the landscape.

47:27That really does a lot of damage to the land.

47:30You wanna disable the mine.

47:32And to do that because of all the different,

47:34all the different edge cases of the problem.

47:37It requires a huge amount of human-like experience,

47:40it seems like.

47:41So it's mostly done by humans.

47:42They have no use for robots.

47:43They don't want robots.

47:45- Yeah, I think we overestimate what we can automate.

47:49- Especially in the physical realm.

47:51- Yeah. - It's weird.

47:53I mean, it continues that the story of humans,

47:57we think we're shitty at everything in the physical world,

48:00including driving.

48:01We think everybody makes fun of themselves

48:04and others for being shitty drivers,

48:06but we're actually kind of incredible.

48:07- No, we're incredible.

48:08And that's why Tesla still says

48:12that if you're in the driver's seat,

48:13like you are ultimately responsible.

48:17Because the ideal for, I mean,

48:18I mean, you know more about this than I do,

48:20but like robot cars are great at predictable things

48:25and can react faster and more precisely than a person

48:31and can do a lot of the driving.

48:33And then the reason that we still don't have

48:35autonomous vehicles on all the roads yet

48:37is because of this long tail of just unexpected occurrences

48:41where a human immediately understands

48:44that's a sunset and not a traffic light.

48:46That's a horse and carriage ahead of me on the highway,

48:48but the car has never encountered that before.

48:50So like in theory, combining those skill sets

48:53is what's gonna really be powerful.

48:57The only problem is figuring out

48:59the human-robot interaction and the handoffs.

49:01So like in cars, that's a huge problem right now,

49:03figuring out the handoffs.

49:06But in other areas, it might be easier.

49:08And that's really the future is human-robot interaction.

49:12- What's really hard to improve,

49:15it's terrible that people die in car accidents,

49:19but I mean, it's like 70, 80, 100 million miles,

49:24one death per 80 million miles.

49:28That's like really hard to beat for a robot.

49:31That's like incredible.

49:33Like think about it, like the, how many people?

49:37Think just the number of people throughout the world

49:38that are driving every single day,

49:41all of this, you know, sleep deprived, drunk,

49:45distracted, all of that, and still very few die

49:51relative to what I would imagine.

49:53If I were to guess, back in the horse,

49:55see, when I was like in the beginning of the 20th century,

49:58riding my horse, I would talk so much shit about these cars.

50:02I'd be like, this is extremely dangerous,

50:05these machines traveling at 30 miles an hour

50:08or whatever the hell they're going at.

50:10This is irresponsible, it's unnatural,

50:13and it's going to be destructive to all of human society.

50:16But then it's extremely surprising

50:18how humans adapt to the thing,

50:19and they know how to not kill each other.

50:22I mean, that ability to adapt is incredible,

50:27and to mimic that in the machine is really tricky.

50:30Now, that said, what Tesla is doing,

50:33I mean, I wouldn't have guessed

50:35how far machine learning can go on vision alone.

50:38It's really, really incredible,

50:39and people that are, at least from my perspective,

50:43people that are kind of critical of Elon and those efforts,

50:48I think don't give enough credit

50:54at how much incredible progress

50:57has been made in that direction.

50:59I think most of the robotics community

51:00wouldn't have guessed how much you can do on vision alone.

51:03It's kind of incredible, because we would be,

51:07I think it's that approach, which is relatively unique,

51:11has challenged the other competitors to step up their game.

51:16So if you're using LiDAR, if you're using mapping,

51:19that challenges them to do better, to scale faster,

51:26and to use machine learning and computer vision as well

51:30to integrate both LiDAR and vision.

51:32So it's kind of incredible.

51:35And I'm not, I don't know if I even have a good intuition

51:40of how hard driving is anymore.

51:43Maybe it is possible to solve.

51:45So all the sunset, all the edge cases you mentioned.

51:48Yeah, the question is when.

51:49- Yeah, I think it's not happening

51:51as quickly as people thought it would,

51:53because it is more complicated.

51:55- But I wouldn't have, I agree with you.

51:59My current intuition is that we're gonna get there.

52:02- I think we're gonna get there too.

52:04- But I didn't before, I wasn't sure we're gonna get there

52:09without, like with current technology.

52:13So I was kind of, this is like with vision alone,

52:19my intuition was you're gonna have to solve

52:23like common sense reasoning.

52:25You're gonna have to solve some of the big problems

52:28in artificial intelligence, not just perception.

52:34- Yeah.

52:35- Like you have to have a deep understanding of the world,

52:37is what was my sense.

52:38But now I'm starting to like, well, this,

52:41I mean, I'm continually surprised how well the thing works.

52:44Obviously Elon and others, others have stopped,

52:47but Elon continues saying we're gonna solve it in a year.

52:51- Well, yeah, that's the thing, bold predictions.

52:54- Yeah, well, everyone else used to be doing that,

52:57but they kind of like, all right.

52:59- Yeah, maybe we'll.

53:00- Maybe let's not promise we're gonna solve

53:03level four driving by 2020.

53:05Let's chill on that.

53:07- Well, people are still trying silently.

53:09I mean, the UK just committed 100 million pounds

53:14to research and development to speed up the process

53:18of getting autonomous vehicles on the road.

53:19Like everyone can see that it is solvable

53:23and it's going to happen and it's gonna change everything.

53:26And they're still investing in it.

53:28And like Waymo, low key has driverless cars in Arizona.

53:33Like you can get, you know, there's like robots.

53:40It's weird, have you ever been in one?

53:42- No.

53:43- It's so weird.

53:44It's so awesome.

53:45'Cause the most awesome experience is the wheel turning

53:50and you're sitting in the back.

53:52It's like, I don't know, it's,

§07Transcript · 53:57–1:02:15

53:57it feels like you're a passenger with that friend

53:59who's a little crazy of a driver.

54:01It feels like, shit, I don't know.

54:05Are you all right to drive, bro?

54:06You know, that kind of feeling.

54:07But then you kind of, that experience, that nervousness

54:12and the excitement of trusting another being,

54:18and in this case, it's a machine, is really interesting.

54:20Just even introspecting your own feelings about the thing.

54:26- Yeah.

54:27- They're not doing anything in terms of making you feel

54:32better about, like at least Waymo.

54:37I think they went with the approach of like,

54:40let's not try to put eyes on the thing.

54:42It's a wheel, we know what that looks like.

54:46It's just a car.

54:47It's a car, get in the back.

54:48Let's not like discuss this at all.

54:50Let's not discuss the fact that this is a robot driving you

54:53and you're in the back.

54:55And if the robot wants to start driving 80 miles an hour

54:57and run off of a bridge, you have no recourse.

55:00Let's not discuss this.

55:02You're just getting in the back.

55:03There's no discussion about like how shit can go wrong.

55:06There's no eyes, there's nothing.

55:08There's like a map showing what the car can see.

55:12Like, you know, what happens if it's like

55:15a HAL 9000 situation?

55:17Like, I'm sorry, I can't.

55:21You have a button you can like call customer service.

55:24- Oh God, then you get put on hold for two hours.

55:27- Probably.

55:28But you know, currently what they're doing,

55:31which I think is understandable,

55:34but you know, the car just can pull over and stop

55:37and wait for help to arrive.

55:39And then a driver will come

55:40and then they'll actually drive the car for you.

55:43But that's like, you know, what if you're late for a meeting

55:47or all that kind of stuff.

55:48- Or like the more dystopian, isn't it the fifth element

55:51where, is Will Smith in that movie?

55:53Who's in that movie?

55:54- No, Bruce Willis?

55:54- Bruce Willis.

55:55- Oh yeah, and he gets into like a robotic cab

55:58or car or something.

56:00And then because he's violated a traffic rule,

56:02it locks him in and he has to wait for the cops to come

56:05and he can't get out.

56:06So like, we're gonna see stuff like that maybe.

56:09- Well, that's, I believe that the companies

56:13that have robots, the only ones that will succeed

56:18are the ones that don't do that.

56:21Meaning they respect privacy.

56:25- You think so?

56:26- Yeah, because people,

56:28'cause they're gonna have to earn people's trust.

56:31- Yeah, but like Amazon works with law enforcement

56:34and gives them the data from the ring cameras.

56:36So why should it, yeah.

56:39Oh yeah.

56:40Do you have a ring camera?

56:42- No.

56:43- Okay.

56:44- No, no, but basically any security camera, right?

56:48I have a Google's, whatever they have.

56:51- We have one that's not the data.

56:54We store the data on a local server

56:56because we don't want it to go to law enforcement

56:58'cause all the companies are doing it.

57:00They're doing it.

57:01I bet Apple wouldn't.

57:02- Yeah.

57:03- Apple's the only company I trust

57:04and I don't know how much longer.

57:06- I don't know.

57:09Maybe that's true for cameras, but with robots,

57:15people are just not gonna let a robot inside their home

57:19where like one time where somebody gets arrested

57:22because of something a robot sees,

57:24that's gonna destroy a company.

57:27- You don't think people are gonna be like,

57:29well, that wouldn't happen to me,

57:30that happened to a bad person.

57:31- I think they would.

57:35- Yeah.

57:36- 'Cause in the modern world, people are get,

57:38have you seen Twitter?

57:39They get extremely paranoid about any kind of surveillance.

57:43- But the thing that I've had to learn

57:45is that Twitter is not the modern world.

57:47Like when I go inland to visit my relatives,

57:52like they don't, that's a different discourse

57:55that's happening.

57:56I think like the whole tech criticism world,

57:59it's loud in our ears 'cause we're in those circles.

58:01- Do you think you can be a company

58:04that does social robotics and not win over Twitter?

58:07- That's a good question.

58:09- I feel like the early adopters are all on Twitter

58:12and it feels like you have to win them over.

58:15Feels like nowadays you'd have to win over TikTok, honestly.

58:18- TikTok, is that a website?

58:21I need to check it out.

58:25And that's an interesting one

58:29because China is behind that one.

58:31- Exactly.

58:32- So if it's compelling enough,

58:35maybe people would be able to give up privacy

58:40and that kind of stuff.

58:41That's really scary.

58:44- I mean, I'm worried about it.

58:46I'm worried about it.

58:47There've been some developments recently

58:51that are like super exciting,

58:53like the large language learning models.

58:55Like, wow, I did not anticipate those improving so quickly

58:59and those are gonna change everything.

59:03And one of the things that I'm trying to be cynical about

59:06is that I think they're gonna have a big impact

59:09on privacy and data security and like manipulating consumers

59:12and manipulating people because suddenly

59:14you'll have these agents that people will talk to

59:16and they won't care or won't know,

59:20at least on a conscious level,

59:21that it's recording the conversations.

59:22So kind of like we were talking about before.

59:24And at the same time, the technology is so freaking exciting

59:29that it's gonna get adopted.

59:31- Well, it's not even just the collection of data

59:32but the ability to manipulate at scale.

59:36So what do you think about the AI,

59:41the engineer from Google

59:45that thought Lambda is sentient?

59:49He had actually a really good post from somebody else.

59:51I forgot her name.

59:52It's brilliant.

59:53I can't believe I didn't know about her.

59:54Thanks to you. - Janelle Shane?

59:55- Yeah, from Weird AI.

59:57- Oh yeah, I love her book.

59:59- She's great.

59:59I left a note for myself to reach out to her.

60:01She's amazing.

60:02She's hilarious and brilliant

60:04and just a great summarizer of the state of AI.

60:07But she has, I think that was from her,

60:11where it was looking at AI explaining that it's a squirrel.

60:16- Oh yeah, because the transcripts

60:20that the engineer released,

60:22Lambda kind of talks about the experience

60:25of human-like feelings and I think even consciousness.

60:30And so she was like, oh cool, that's impressive.

60:33I wonder if an AI can also describe the experience

60:36of being a squirrel.

60:37And so she interviewed, I think she did GPT-3

60:40about the experience of being a squirrel.

60:42And then she did a bunch of other ones too,

60:44like what's it like being a flock of crows?

60:46What's it like being an algorithm that powers a Roomba?

60:49And you can have a conversation about any of those things

60:53and they're very convincing. - It's pretty convincing, yeah.

60:55Even GPT-3, which is not state of the art.

60:58It's convincing of being a squirrel.

61:00It's like what it's like.

61:02I mean, you should check it out,

61:04'cause it really is.

61:05It's like, yeah, that probably is what a squirrel would--

61:09- I would say. (laughs)

61:11- Are you excited?

61:12Like what's it like being a squirrel?

61:13It's fun.

61:14- Oh yeah, I get to eat nuts and run around all day.

61:17- Like how do you think people feel

61:20like when you tell them that you're a squirrel?

61:22You know, or like, I forget what it was.

61:25Like a lot of people might be scared

61:27to find out that you're a squirrel or something like this.

61:29And then the system answers pretty well.

61:33Like yeah, I hope they'll,

61:36like what do you think when they find out you're a squirrel?

61:39(laughs)

61:41I hope they'll see how fun it is to be a squirrel

61:44or something like that.

61:45- What do you say to people who don't believe you're a squirrel

61:48I say, "Come see for yourself."

61:49I am a squirrel.

61:50- That's great.

61:51- Well, I think it's really great

61:53because the two things to note about it are,

61:57first of all, just because the machine

61:58is describing an experience

61:59doesn't mean it actually has that experience.

62:02But then secondly, these things are getting so advanced

62:05and so convincing at describing these things

62:08and talking to people.

62:10That's, I mean, just the implications for health,

62:15education, communication, entertainment, gaming.

§08Transcript · 1:02:19–1:10:35

62:19Like I just feel like all of the applications,

62:22it's mind boggling what we're gonna be able to do with this.

62:25And that my kids are not gonna remember a time

62:28before they could have conversations with artificial agents.

62:32- Do you think they would?

62:34Because to me, this is,

62:35the focus in the ad community has been,

62:39well, this engineer surely is hallucinating.

62:42The thing is not sentient.

62:44But to me, first of all,

62:48it doesn't matter if he is or not, this is coming.

62:52Where a large number of people

62:54would believe a system is sentient,

62:56including engineers within companies.

62:59So in that sense, you start to think about a world

63:02where your kids aren't just used

63:05to having a conversation with a bot,

63:07but used to believing,

63:08kind of having an implied belief that the thing is sentient.

63:13- Yeah, I think that's true.

63:15And I think that one of the things that bothered me

63:18about all of the coverage in the tech press

63:20about this incident,

63:21like obviously I don't believe the system is sentient.

63:25Like I think that it can convincingly describe that it is.

63:28I don't think it's doing what he thought it was doing

63:31and actually experiencing feelings.

63:33But a lot of the tech press was about how he was wrong

63:38and depicting him as kind of naive.

63:40And it's not naive.

63:42Like there's so much research in my field

63:45showing that people do this, even experts.

63:48They might be very clinical

63:50when they're doing human robot interaction experiments

63:52with a robot that they've built.

63:54And then you bring in a different robot

63:55and they're like, "Oh, look at it.

63:56It's having fun, it's doing this."

63:58Like that happens in our lab all the time.

64:01We are all this guy and it's gonna be huge.

64:06So I think that the goal is not to discourage

64:10this kind of belief or like design systems

64:13that people won't think are sentient.

64:15I don't think that's possible.

64:16I think you're right, this is coming.

64:18It's something that we have to acknowledge

64:21and even embrace and be very aware of.

64:25- So one of the really interesting perspectives

64:28that your book takes on a system like this

64:32is to see them, not to compare a system like this to humans,

64:35but to compare it to animals, of how we see animals.

64:39Can you kind of try to, again, sneak up,

64:42try to explain why this analogy is better

64:45than the human analogy, the analogy of robots as animals?

64:48- Yeah, and it gets trickier with the language stuff,

64:52but we'll get into that too.

64:54I think that animals are a really great thought experiment

64:59when we're thinking about AI and robotics,

65:01because again, this comparing them to humans

65:04that leads us down the wrong path,

65:05both because it's not accurate,

65:07but also I think for the future, we don't want that.

65:10We want something that's a supplement.

65:12But I think animals, because we've used them

65:15throughout history for so many different things,

65:17we domesticated them, not because they do what we do,

65:19but because what they do is different and that's useful.

65:23And it's just like,

65:25whether we're talking about companionship,

65:27whether we're talking about work integration,

65:29whether we're talking about responsibility for harm,

65:32there's just so many things we can draw on in that history

65:35from these entities that can sense, think,

65:38make autonomous decisions and learn

65:40that are applicable to how we should be thinking

65:43about robots and AI.

65:44And the point of the book is not

65:45that they're the same thing,

65:46that animals and robots are the same.

65:49Obviously, there are tons of differences there.

65:50Like you can't have a conversation with a squirrel, right?

65:54But the point is- - I do it all the time.

65:57- Oh, really?

65:58- By the way, squirrels are the cutest.

66:00I project so much on squirrels.

66:02I wonder what their inner life is.

66:04I suspect they're much bigger assholes than we imagine.

66:09- Really?

66:10- Like if it was a giant squirrel,

66:12it would fuck you over so fast if it had the chance.

66:15It would take everything you own.

66:16It would eat all your stuff,

66:18but 'cause it's small and the furry tail,

66:20the furry tail is a weapon

66:25against human consciousness and cognition.

66:28It wins us over.

66:29That's what cats do too.

66:30Cats out-competed squirrels.

66:33- And dogs.

66:35- Yeah.

66:35No, dogs have love.

66:37Cats have no soul.

66:39They, no, I'm just kidding.

66:40People get so angry when I talk shit about cats.

66:43I love cats.

66:44Anyway, so yeah, you're describing

66:47all the different kinds of animals that get domesticated.

66:51And it's a really interesting idea

66:54that it's not just sort of pets.

66:55There's all kinds of domestication going on.

66:57They all have all kinds of uses.

67:00- Yes.

67:01- Like the ox that you propose might be,

67:05at least historically,

67:06one of the most useful domesticated animals.

67:09- It was a game changer because it revolutionized

67:12what people could do economically, et cetera.

67:15So, I mean, just like robots,

67:17they're gonna change things economically.

67:20They're gonna change landscapes.

67:22Like cities might even get rebuilt

67:24around autonomous vehicles or drones or delivery robots.

67:28I think just the same ways that animals

67:30have really shifted society.

67:33And society has adapted also

67:35to like socially accepting animals as pets.

67:37I think we're gonna see very similar things with robots.

67:40So I think it's a useful analogy.

67:42It's not a perfect one,

67:42but I think it helps us get away from this idea

67:45that robots can, should, or will replace people.

67:49- If you remember,

67:50what are some interesting uses of animals?

67:52Ferrets, for example.

67:54- Oh yeah, the ferrets.

67:55They still do this.

67:56They use ferrets to go into narrow spaces

67:59that people can't go into, like a pipe.

68:01Or like they'll use them to run electrical wire.

68:03I think they did that for Princess Di's wedding.

68:05There's so many weird ways that--

68:07- Work is work.

68:08- We've used animals and still use animals

68:11for things that robots can't do.

68:13Like the dolphins that they used in the military.

68:18I think Russia still has dolphins

68:21and the US still has dolphins in their navies.

68:24Mine detection, looking for lost underwater equipment,

68:30some rumors about using them for weaponry.

68:33Which I think Russia's like, "Sure, believe that."

68:39And America's like, "No, no, we don't do that."

68:41Who knows?

68:42But they started doing that in like the 60s, 70s.

68:45They started training these dolphins

68:46because they were like, "Oh, dolphins have

68:48this amazing echolocation system

68:49that we can't replicate with machines

68:52and they're trainable.

68:52So we're gonna use them for all the stuff

68:54that we can't do with machines or by ourselves."

68:57And they've tried to phase out the dolphins.

68:59I know the US has invested a lot of money

69:02in trying to make robots do the mine detection.

69:05But like you were saying,

69:07there are some things that the robots are good at

69:09and there's some things that biological creatures

69:11are better at, so they still have the dolphins.

69:13- So there's also pigeons, of course.

69:16- Oh yeah, pigeons.

69:17Oh my gosh, there's so many examples.

69:19The pigeons were the original hobby photography drone.

69:23They also carried mail for thousands of years,

69:26letting people communicate with each other in new ways.

69:28So the thing that I like about the animal analogies,

69:31they have all these physical abilities

69:33but also sensing abilities

69:35that we don't have and that's just so useful.

69:40And that's robots, right?

69:43Robots have physical abilities.

69:44They can help us lift things

69:46or do things that we're not physically capable of.

69:48They can also sense things.

69:50It's just, I just feel like,

69:52I still feel like it's a really good analogy.

69:54- Yeah, it's really strong.

69:55- And it works because people are familiar with it.

69:58- What about companionship?

70:00And when we start to think about cats and dogs,

70:03they're pets that seem to serve no purpose whatsoever

70:06except the social connection.

70:08- Yeah, I mean, it's kind of a newer thing.

70:11At least in the United States,

70:13like dogs used to have,

70:16like they used to have a purpose.

70:18They used to be guard dogs or they had some sort of function.

70:21And then at some point they became just part of the family.

70:24And it's so interesting how there's some animals

70:30that we've treated as workers,

70:33some that we've treated as objects,

70:35some that we eat,

§09Transcript · 1:10:36–1:19:17

70:36and some that are parts of our families.

70:39And that's different across cultures.

70:41And I'm convinced that we're gonna see

70:43the same thing with robots,

70:45where people are gonna develop

70:47strong emotional connections to certain robots

70:49that they relate to, either culturally

70:51or personally, emotionally.

70:53And then there's gonna be other robots

70:54that we don't treat the same way.

70:57- I wonder, does that have to do more

71:00with the culture and the people or the robot design?

71:02Is there an interplay between the two?

71:04Like why did dogs and cats out-compete

71:09ox and I don't know, what else?

71:13Like farm animals to really get inside the home

71:16and get inside our hearts?

71:18- Yeah, I mean, people point to the fact

71:21that dogs are very genetically flexible

71:24and they can evolve much more quickly than other animals.

71:28And so they, evolutionary biologists think

71:32that dogs evolved to be more appealing to us.

71:36And then once we learned how to breed them,

71:38we started breeding them to be more appealing to us too,

71:40which is not something that we necessarily

71:43would be able to do with cows,

71:45although we've bred them to make more milk for us.

71:48So, but part of it is also culture.

71:50I mean, there are cultures where people eat dogs still today

71:53and then there's other cultures where we're like,

71:55oh no, that's terrible, we would never do that.

71:58And so I think there's a lot of different elements

72:00that play in.

72:01- I wonder if there's good,

72:03'cause I understand dogs 'cause they use their eyes,

72:05they're able to communicate affection,

72:07all those kinds of things.

72:08It's really interesting what dogs do.

72:10There's a whole conferences on dog consciousness

72:13and cognition and all that kind of stuff.

72:16Now cats is a mystery to me

72:18because they seem to not give a shit about the human.

72:22- But they're warm and fluffy.

72:25- But they're also passive aggressive.

72:26So they're at the same time,

72:28they're dismissive of you in some sense.

72:33- I think some people like that about people.

72:36- Yeah, they want to push and pull of a relationship.

72:40- They don't want loyalty or unconditional love.

72:43That means they haven't earned it.

72:45- Yeah.

72:47And maybe that says a lot more about the people

72:51than it does about the animals.

72:53- Oh yeah, we all need therapy.

72:54- Yeah.

72:55So I'm judging harshly the people that have cats

72:59or the people that have dogs.

73:02Maybe the people that have dogs

73:03are desperate for attention and unconditional love

73:08and they're unable to sort of struggle

73:11to earn meaningful connections.

73:19I don't know.

73:22- Maybe people are talking about you

73:23and your robot pets in the same way.

73:26- Yeah, that's...

73:27It is kind of sad.

73:30There's just robots everywhere.

73:31But I mean, I'm joking about it being sad

73:34'cause I think it's kind of beautiful.

73:35I think robots are beautiful in the same way that pets are,

73:40even children, in that they capture some kind of magic

73:44of social robots.

73:46They have the capacity to have the same kind of magic

73:50of connection.

73:52I don't know what that is.

73:53Like when they're brought to life and they move around,

73:57the way they make me feel, I'm pretty convinced,

74:02is as you know, they will make billions of people feel.

74:07Like I don't think I'm like some weird robotics guy.

74:12I'm not.

74:13- I mean, you are, but not in this way.

74:15- Not in this way.

74:15I mean, I just, I can put on my like normal human hat

74:19and just see this, oh, this is like,

74:22there's a lot of possibility there of something cool,

74:25just like with dogs.

74:27Like what is it?

74:28Why are we so into dogs or cats?

74:30Like it's like, it's way different than us.

74:33- It is.

74:35- It's like drooling all over the place

74:37with its tongue out.

74:38It's like a weird creature that used to be a wolf.

74:42Why are we into this thing?

74:43- Well, dogs can either express or mimic a lot of emotions

74:49that we recognize.

74:50And I think that's a big thing.

74:53Like a lot of the magic of animals and robots

74:55is our own self projection.

74:59And the easier it is for us to see ourselves in something

75:03and project human emotions or qualities or traits onto it,

75:06the more we'll relate to it.

75:08And then you also have the movement, of course.

75:10I think that's also really,

75:11that's why I'm so interested in physical robots

75:14because that's, I think the visceral magic of them.

75:17I think we're, I mean, there's research showing

75:19that we're probably biologically hardwired

75:22to respond to autonomous movement in our physical space

75:26because we've had to watch out for predators

75:28or whatever the reason is.

75:29And so animals and robots are very appealing to us

75:34as these autonomously moving things

75:37that we view as agents instead of objects.

75:39- I mean, I love the moment,

75:42which is I've been particularly working on,

75:44which is when a robot like the cowboy hat

75:47is doing its own thing and then it recognizes you.

75:52I mean, the way a dog does.

75:53And it looks like this.

75:56And the moment of recognition,

75:59like you're walking,

76:01say you're walking in an airport on the street

76:04and there's just hundreds of strangers,

76:08but then you see somebody you know,

76:09and that like, well, you wake up to like that excitement

76:14of seeing somebody you know and saying hello

76:16and all that kind of stuff.

76:17That's a magical moment.

76:19Like I think, especially with the dog,

76:22it makes you feel noticed and heard and loved.

76:27Like that somebody looks at you and recognizes you

76:30that it matters that you exist.

76:33- Yeah, you feel seen.

76:34- Yeah, and that's a cool feeling.

76:36And I honestly think robots can give that feeling too.

76:39- Oh yeah, totally.

76:41- Currently Alexa, I mean,

76:42one of the downsides of these systems is they don't,

76:46they're servants.

76:48Part of the, you know,

76:52they're trying to maintain privacy, I suppose,

76:55but I don't feel seen with Alexa, right?

77:00- I think that's gonna change.

77:01I think you're right.

77:03And I think that that's the game changing nature

77:06of things like these large language learning models.

77:09And the fact that these companies are investing

77:11in embodied versions that move around of Alexa, like Astro.

77:16- Can I just say, yeah, I haven't, is that out?

77:22- I mean, it's out.

77:23You can't just like buy one commercially yet,

77:25but you can apply for one.

77:26- Yeah.

77:28My gut says that these companies don't have the guts

77:33to do the personalization.

77:38This goes to the, because it's edgy, it's dangerous.

77:42It's gonna make a lot of people very angry.

77:44Like in a way that, you know, just imagine, okay.

77:49All right.

77:50If you do the full landscape of human civilization,

77:53just visualize the number of people

77:56that are going through breakups right now.

77:58Just the amount of really passionate,

78:01just even if we just look at teenagers,

78:03the amount of deep heartbreak that's happening.

78:07And like, if you're going to have Alexa

78:09have more of a personal connection with the human,

78:13you're gonna have humans that like have existential crises.

78:16There's a lot of people that suffer

78:18from loneliness and depression.

78:20And like, you're now taking on the full responsibility

78:24of being a companion to the rollercoaster

78:27of the human condition.

78:29As a company, like imagine PR and marketing people,

78:32they're gonna freak out.

78:33They don't have the guts.

78:34It's gonna have to come from somebody

78:36from a new Apple, from those kinds of folks,

78:39like a small startup.

78:41- And it might.

78:42- Yeah.

78:42- Like they're coming.

78:43There's already virtual therapists.

78:44There's that Replica app.

78:46I haven't tried it, but Replica's like a virtual companion.

78:49Like it's coming.

78:51And if big companies don't do it, someone else will.

78:53- Yeah, I think the next, the future,

78:55the next trillion dollar company

78:57will be those personalizations.

78:59'Cause if you think,

79:00if you think about all the AI we have around us,

79:06all the smartphones and so on,

79:08there's very minimal personalization.

79:10- You don't think that's just because they weren't able?

79:14- No.

79:15- Really?

79:15- I don't think they have the guts.

79:17- I mean, it might be true, but I have to wonder,

§10Transcript · 1:19:19–1:28:30

79:19I mean, Google is clearly gonna do something

79:22with the language, I mean.

79:24- They don't have the guts.

79:25(Donna laughs)

79:26- Are you challenging them?

79:28- Partially, but not really.

79:30'Cause I know they're not gonna do it.

79:32- I mean.

79:33- They don't have to, it's bad for business in the short term.

79:35- I'm gonna be honest, maybe it's not such a bad thing

79:38if they don't just roll this out quickly,

79:41because I do think there are huge issues.

79:44- Yeah.

79:45- And there's, and not just issues

79:48with the responsibility of unforeseen effects on people,

79:53but what's the business model?

79:56And if you are using the business model

79:59that you've used in other domains,

80:01then you're gonna have to collect data from people,

80:04which you will anyway to personalize the thing,

80:06and you're gonna be somehow monetizing the data,

80:10or you're gonna be doing some like ad model.

80:12It just, it seems like now we're suddenly getting

80:15into the realm of like severe consumer protection issues,

80:18and I'm really worried about that.

80:22I see massive potential for this technology to be used

80:25in a way that's not for the public good,

80:28and not, I mean, that's in an individual user's interest

80:32maybe, but not in society's interest.

80:35- Yeah, see, I think that kind of personalization

80:39should be like redefine how we treat data.

80:44I think you should own all the data your phone knows

80:49about you, like, and be able to delete it

80:51with a single click, and walk away.

80:55And that data cannot be monetized, or used,

80:59or shared anywhere without your permission.

81:02I think that's the only way people will trust you

81:04to give, for you to use that data.

81:07- But then how are companies gonna,

81:10I mean, a lot of these applications rely

81:12on massive troves of data to train the AI system.

81:17- Right, so you have to opt in constantly,

81:22and opt in not in some legal, I agree,

81:25but obvious, like show, like in the way I opt in

81:30and tell you a secret.

81:32Like, we understand, like, that, like,

81:37I have to choose, like, how well do I know you?

81:39And then I say, like, don't tell this to anyone.

81:42(laughs)

81:44And then I have to judge how leaky that,

81:47like, how good you are at keeping secrets.

81:50In that same way, like, it's very transparent

81:53in which data you're allowed to use for which purposes.

81:56- That's what people are saying is the solution,

81:58and I think that works to some extent,

82:00having transparency, having people consent.

82:03I think it breaks down at the point at which,

82:07we've seen this happen on social media, too,

82:08like, people are willingly giving up their data

82:10because they're getting a functionality from that,

82:13and then the harm that that causes is on a,

82:17like, maybe to someone else, and not to them personally.

82:20So--

82:21- I don't think people are giving their data.

82:22They're not being asked.

82:24Like, it's not consensual. - But if you were asked,

82:27if you were like, tell me a secret about yourself

82:31and I'll give you $100, I'd tell you a secret.

82:34- No, not $100.

82:34First of all, you wouldn't.

82:38You wouldn't trust, like, why are you giving me $100?

82:41- It's a bad example.

82:43- But, like, I need, I would ask for your specific,

82:48like, fashion interest in order to give recommendations

82:54to you for shopping, and I'd be very clear for that,

82:57and you could disable that, you can delete that.

83:00But then you can be, have a deep, meaningful,

83:04rich connection with the system

83:06about what you think you look fat in,

83:08what you look great in, what, like,

83:11the full history of all the things you've worn,

83:14whether you regret the Justin Bieber

83:17or enjoy the Justin Bieber shirt,

83:19all of that information that's mostly private to even you,

83:23not even your loved ones, that, a system should have that,

83:26'cause then a system, if you trust it,

83:29to keep control of that data that you own,

83:32you could walk away with,

83:33that system could tell you a damn good thing to wear.

83:35- It could, and the harm that I'm concerned about

83:40is not that the system is gonna then suggest a dress for me

83:43that is based on my preferences.

83:45So I went to this conference once

83:47where I was talking to the people who do the analytics

83:49in, like, the big ad companies,

83:52and, like, literally a woman there was like,

83:55I can ask you three totally unrelated questions

83:58and tell you what menstrual product you use.

84:01And so what they do is they aggregate the data

84:04and they map out different personalities

84:06and different people and demographics,

84:08and then they have a lot of power and control

84:10to market to people.

84:13So, like, I might not be sharing my data

84:15with any of the systems because I'm like,

84:17I'm on Twitter, I know that this is bad.

84:19Other people might be sharing data

84:23that can be used against me.

84:25Like, I think it's way more complex than just

84:30I share a piece of personal information

84:32and it gets used against me.

84:33I think that at a more systemic level,

84:36and then it's always, you know,

84:38vulnerable populations that are targeted by this,

84:41low-income people being targeted for scammy loans,

84:45or, I don't know, like, I could get targeted,

84:48like, someone, not me,

84:51because someone who doesn't have kids yet

84:53and is my age could get targeted for, like,

84:56freezing their eggs.

84:57And there's all these ways that you can manipulate people

84:59where it's not really clear that that came from

85:02that person's data,

85:06it came from all of us, all of us opting into this.

85:11- But there's a bunch of sneaky decisions along the way

85:15that could be avoided if there's transparency.

85:18So one of the ways that goes wrong

85:21if you share that data with too many ad networks,

85:23don't run your own ad network.

85:27Don't share with anybody.

85:29- Okay, and that's something that you could regulate.

85:32- That belongs to just you,

85:35and all of the ways you allow the company to use it,

85:38the default is in no way at all.

85:40And you are consciously, constantly

85:43saying exactly how to use it.

85:46And also, it has to do with the recommender system itself

85:51from the company, which is freezing your eggs.

85:57If that doesn't make you happy,

86:00if that idea doesn't make you happy,

86:02then the system shouldn't recommend it.

86:04It should be very good at learning.

86:06So not the kind of things that the category of people

86:11it thinks you belong to would do,

86:13but more you specifically,

86:16what makes you happy, what is helping you grow.

86:19- But you're assuming that people's preferences

86:21and what makes them happy is static.

86:24Whereas when we were talking before

86:25about how a company like Apple

86:28can tell people what they want,

86:31and they will start to want it,

86:33that's the thing that I'm more concerned about.

86:36- Yeah, that is a huge problem.

86:37It's not just listening to people,

86:39but manipulating them into wanting something.

86:42- And that's like, we have a long history

86:45of using technology for that purpose.

86:48Like the persuasive design in casinos

86:50to get people to gamble more.

86:52It's just, I'm...

86:55The other thing that I'm worried about

86:59is as we have more social technology,

87:02suddenly you have this on a new level.

87:05If you look at the influencer marketing

87:07that happens online now.

87:09- What's influencer marketing?

87:10- So like on Instagram, there will be some person

87:14who has a bunch of followers.

87:15And then a brand will hire them to promote some product.

87:20And it's above board.

87:21They disclose, this is an ad that I'm promoting,

87:24but they have so many young followers

87:26who deeply admire and trust them.

87:29I mean, this must work for you too.

87:30Don't you have ads on the podcast?

87:32People trust you.

87:33- Magic spoon cereal, low carb, yes.

87:37- If you say that, I guarantee you

87:38some people will buy that just because

87:40even though they know that you're being paid,

87:42they trust you.

87:44- Yeah, it's different with podcasts

87:46'cause well, my particular situation,

87:48but it's true for a lot of podcasts,

87:49especially big ones is, you know,

87:52I have 10 times more sponsors that wanna be sponsors

87:57than I have...

88:00- So you get to select the ones

88:00that you actually wanna support.

88:02- And so like you end up using it

88:04and then you're able to actually...

88:06Like there's no incentive to like shill for anybody.

88:12- Sure, and that's why it's fine

88:14when it's still human influencers.

88:17Now, if you're a bot, you're not gonna discriminate.

88:21You're not gonna be like,

88:23oh, well, I think this product is good for people.

88:27- You think there'll be like bots essentially

88:30with millions of followers.

§11Transcript · 1:28:32–1:37:32

88:32- There already are.

88:33There are virtual influencers in South Korea

88:36who shill products.

88:37And like that's just the tip of the iceberg

88:41because that's still very primitive.

88:42Now with the new image generation

88:44and the language learning models.

88:46And like, so we're starting to do some research

88:49around kids and like young adults

88:53because a lot of the research

88:56on like what's okay to advertise to kids

88:58and what is too manipulative

88:59has to do with television ads.

89:01Back in the day where like a kid who's 12 understands,

89:04oh, that's an advertisement.

89:06I can distinguish that from entertainment.

89:07I know it's trying to sell me something.

89:09Now it's getting really, really murky with influencers.

89:12And then if you have like a bot

89:15that a kid has developed a relationship with,

89:18is it okay to market products through that or not?

89:20Like you're getting into

89:21all these consumer protection issues

89:23because you're developing a trusted relationship

89:26with a social entity, but it's...

89:30And so now it's like personalized, it's scalable,

89:34it's automated and it can...

89:39So some of the research showing

89:42that kids are already very confused

89:44about like the incentives of the company

89:46versus what the robot is doing.

89:48- Meaning they're not deeply understanding

89:54the incentives of the system.

89:57- Well, yeah, so like kids who are old enough to understand

90:01this is a television advertisement

90:02is trying to advertise to me.

90:04I might still decide I want this product,

90:05but they understand what's going on.

90:06So there's some transparency there.

90:09That age child, so Daniela Di Paola, Anastasia Ostrovsky,

90:14and I advised on this project, they did this.

90:18They asked kids who had interacted with social robots,

90:21whether they would like a policy that allows robots

90:27to market to people through casual conversation,

90:31or whether they would prefer

90:32that it has to be transparent,

90:34that it's like an ad coming from a company.

90:36And the majority said they preferred the casual conversation.

90:40And when asked why, there was a lot of confusion about,

90:43they were like, well, the robot knows me better

90:45than the company does.

90:46So the robot's only gonna market things that I like.

90:49And so they don't really, they're not connecting the fact

90:52that the robot is an agent of the company.

90:54They're viewing it as something separate.

90:57And I think that even happens subconsciously with grownups

91:00when it comes to robots and artificial agents.

91:02And it will, like this Blake guy at Google,

91:04sorry I'm going on and on, but like his main concern

91:07was that Google owned this sentient agent

91:10and that it was being mistreated.

91:12His concern was not that the agent

91:14was gonna mistreat people.

91:15So I think we're gonna see a lot of this.

91:19- Yeah, but shitty companies will do that.

91:21I think ultimately that confusion should be alleviated

91:25by the robot should actually know you better

91:28and should not have any control from the company.

91:32- But what's the business model for that?

91:34- If you use the robot to buy, first of all,

91:38the robot should probably cost money.

91:41- Should what?

91:41- Cost money, like the way Windows operating system does.

91:44I see it more like an operating system.

91:46Then like this thing is your window,

91:51no pun intended, into the world.

91:55So it's helping you, it's like a personal assistant.

91:58Right, and so that should cost money.

92:01You should, you know, whatever it is, 10 bucks, 20 bucks.

92:06Like that's the thing that makes

92:07your life significantly better.

92:09This idea that everything should be free is,

92:12like it should actually help educate you.

92:14You should talk shit about all the other companies

92:16that do stuff for free.

92:18But also, yeah, in terms of if you purchase stuff

92:22based on its recommendation, it gets money.

92:25So it's kind of ad driven, but it's not ads.

92:30It's like, it's not controlled.

92:35Like no external entities can control it

92:41to try to manipulate you to want a thing.

92:45- That would be amazing.

92:46- It's actually trying to discover what you want.

92:48So it's not allowed to have any influence.

92:52No promoted ad, no anything.

92:55So it's finding, I don't know,

92:58the thing that would actually make you happy.

93:01That's the only thing it cares about.

93:03I think companies like this can win out.

93:08- Yes, I think eventually,

93:09once people understand the value of the robot,

93:14even just, like I think that robots

93:16would be valuable to people,

93:18even if they're not marketing something

93:20or helping with like preferences or anything.

93:23Like just a simple, the same thing as a pet,

93:25like a dog that has no function

93:28other than being a member of your family.

93:29I think robots could really be that

93:31and people would pay for that.

93:32I don't think the market realizes that yet.

93:35And so my concern is that companies

93:38are not gonna go in that direction,

93:40at least not yet, of making like this contained thing

93:43that you buy.

93:44It seems almost old fashioned, right,

93:46to have a disconnected object that you buy,

93:51that you're not like paying a subscription for.

93:53It's not like controlled by one of the big corporations.

93:56- But that's the old fashioned things

93:57that people yearn for,

94:01because I think it's very popular now

94:05and people understand the negative effects of social media,

94:09the negative effects of the data being used

94:11in all these kinds of ways.

94:13I think we're just waking up to the realization

94:16we tried, we're like baby deer,

94:19finding our legs in this new world of social media,

94:21of ad driven companies and realizing,

94:24okay, this has to be done somehow different.

94:27- Yeah.

94:27- Like one of the most popular notions,

94:31at least in the United States,

94:32is social media is evil and it's doing bad by us.

94:36It's not like it's totally tricked us

94:39into believing that it's good for us.

94:42I think everybody knows it's bad for us.

94:44And so there's a hunger for other ideas.

94:47- All right, it's time for us to start that company.

94:49- I think so.

94:50- Let's do it.

94:50- I think let's go.

94:51- Hopefully no one listens to this and steals the idea.

94:54- There's no, see that's the other thing.

94:55I think I'm a big person on,

94:58execution is what matters.

95:01I mean, it's like ideas are kind of true.

95:04The social robotics is a good example

95:06that there's been so many amazing companies

95:08that went out of business.

95:11I mean, to me it's obvious,

95:12like it's obvious that there will be a robotics company

95:17that puts a social robot in the home of billions of homes.

95:22- Yeah.

95:23- And it'll be a companion.

95:24Okay, there you go.

95:25You can steal that idea.

95:27Do it.

95:28- Okay, I have a question for you.

95:31What about Elon Musk's humanoid?

95:33Is he gonna execute on that?

95:35- There might be a lot to say.

95:38So for people who are not aware,

95:40there's an optimist, Tesla's optimist robot that's,

95:43I guess the stated reason for that robot

95:48is a humanoid robot in the factory

95:50that's able to automate some of the tasks

95:52that humans are currently doing.

95:54And the reason you wanna do,

95:55it's the second reason you mentioned,

95:57the reason you wanna do a humanoid robot

95:59is because the factory's built for,

96:01there's certain tasks that are designed for humans.

96:05So it's hard to automate with any other form factor

96:08than a humanoid.

96:09And then the other reason is because so much effort

96:13has been put into this giant data engine machine

96:16of perception that's inside Tesla autopilot

96:21that's seemingly, at least the machine, if not the data,

96:25is transferable to the factory setting, to any setting.

96:28- Yeah, he said it would do anything that's boring to us.

96:32- Yeah, yeah.

96:34The interesting thing about that

96:36is there's no interest

96:40and no discussion about the social aspect.

96:43Like I talked to him on mic and off mic about it quite a bit.

96:50And there's not a discussion about like,

96:55to me it's obvious if a thing like that works at all,

97:01at all.

97:02In fact, it has to work really well in a factory.

97:06If it works kind of shitty, it's much more useful in the home

97:10'cause we're much,

97:13I think being shitty at stuff

97:16is kind of what makes relationships great.

97:20Like you wanna be flawed

97:24and be able to communicate your flaws

97:26and be unpredictable in certain ways.

97:28Like if you fell over every once in a while

97:30for no reason whatsoever,

97:32I think that's essential for like--

§12Transcript · 1:37:34–1:46:26

97:34- Very charming.

97:36- It's charming, but also concerning

97:38and also like, are you okay?

97:42I mean, it's both hilarious.

97:45Whenever somebody you love like falls down the stairs,

97:47it was both hilarious and concerning.

97:50It's some dance between the two.

97:54And I think that's essential for like,

97:56you almost wanna engineer that in,

97:58except you don't have to

97:59because of robotics in the physical space

98:02is really difficult.

98:04So I think I've learned to not discount

98:09the efforts that Elon does.

98:13There's a few things that are really interesting there.

98:16One, because he's taking it extremely seriously.

98:21What I like is the humanoid form,

98:24the cost of building a robot.

98:25I talked to Jim Keller offline about this a lot.

98:28And currently humanoid robots cost a lot of money.

98:31And the way they're thinking about it,

98:34now they're not talking about all the social robotics stuff

98:36that you and I care about.

98:38They are thinking, how can we manufacture this thing cheaply

98:43and do it like well?

98:45And the kind of discussions they're having

98:47is really great engineering.

98:49It's like first principles question of like,

98:52why is this cost so much?

98:54Like, what's the cheap way?

98:56Why can't we build?

98:57And there's not a good answer.

98:59Why can't we build this humanoid form for under $1,000?

99:03And like, I've sat and had these conversations.

99:07There's no reason.

99:08I think the reason they've been so expensive

99:11is because they were focused on trying to,

99:15they weren't focused on doing the mass manufacture.

99:20People are focused on getting a thing that's,

99:23I don't know exactly what the reasoning is,

99:25but it's the same like Waymo.

99:27It's like, let's build a million dollar car

99:30in the beginning, or like multi-million dollar car.

99:33Let's try to solve that problem.

99:36The way Elon, the way Jim Keller,

99:38the way some of those folks are thinking is,

99:40let's like at the same time,

99:43try to actually build a system that's cheap.

99:46Not crappy, but cheap.

99:47And let's, first principles,

99:49what is the minimum amount of degrees of freedom we need?

99:54What are the joints?

99:55Where's the control set?

99:57Like how many, how do we, like where are the activators?

100:00What's the way to power this

100:03in the lowest cost way possible?

100:04But also in a way that's like actually works.

100:07How do we make the whole thing not part of the components

100:10where there's a supply chain,

100:11you have to have all these different parts

100:14that have to feed us.

100:15Do it all from scratch and do the learning.

100:19I mean, it's like immediately certain things

100:22like become obvious.

100:23Do the exact same pipeline as you do for autonomous driving.

100:27Just the exact, I mean,

100:28the infrastructure there is incredible.

100:31For the computer vision, for the manipulation task,

100:33the control problem changes,

100:34the perception problem changes,

100:37but the pipeline doesn't change.

100:40Do it.

100:41And so I don't,

100:42obviously the optimism about how long it's gonna take,

100:47I don't share.

100:48But it's a really interesting problem.

100:51And I don't wanna say anything

100:53because my first gut is to say that

100:56why the humanoid form, that doesn't make sense.

100:58- Yeah, that's my second gut too, but.

101:01- But then there's a lot of people

101:04that are really excited about the humanoid form there.

101:06- That's true. - And it's like,

101:06I don't wanna get in the way,

101:08like they might solve this thing.

101:10And they might, it's like similar with Boston Dynamics.

101:13Like, why?

101:15Like, if I were to, you can be a hater

101:17and you go up to Mark Ryber and just,

101:21like, how are you gonna make money

101:22with these super expensive legged robots?

101:25What's your business plan?

101:27This doesn't make any sense.

101:28Why are you doing these legged robots?

101:30But at the same time, they're pushing forward

101:33the science, the art of robotics

101:35in a way that nobody else does.

101:37- Yeah.

101:38- And with Elon, they're not just going to do that,

101:43they're gonna drive down the cost

101:44to where we can have humanoid bots in the home potentially.

101:49- So the part I agree with is,

101:52a lot of people find it fascinating

101:54and it probably also attracts talent

101:56who wanna work on humanoid robots.

101:57I think it's a fascinating scientific problem

102:00and engineering problem,

102:01and it can teach us more about human body

102:04and locomotion and all of that.

102:06I think there's a lot to learn from it.

102:07Where I get tripped up is why we need them

102:11for anything other than art and entertainment

102:13in the real world.

102:15Like, I get that there are some areas

102:18where you can't just rebuild like a spaceship.

102:23You can't just like,

102:25they've worked for so many years on these spaceships,

102:28you can't just re-engineer it.

102:30You have some things that are just built for human bodies,

102:33a submarine, a spaceship.

102:34But a factory, maybe I'm naive,

102:38but it seems like we've already rebuilt factories

102:41to accommodate other types of robots.

102:43Why would we want to just like make a humanoid robot

102:46to go in there?

102:48I just get really tripped up on,

102:50I think that people want humanoids.

102:53I think people are fascinated by them.

102:56I think it's a little overhyped.

102:58- Well, most of our world is still built for humanoids.

103:03- I know, but it shouldn't be.

103:04It should be built so that it's wheelchair accessible.

103:07- Right, so the question is,

103:08do you build a world that's the general form

103:11of wheelchair accessible?

103:15All robot form factor accessible?

103:18Or do you build humanoid robots?

103:22- I mean, it doesn't have to be all,

103:23and it also doesn't have to be either or.

103:26I just feel like we're thinking so little

103:28about the system in general

103:30and how to create infrastructure that works for everyone,

103:34all kinds of people, all kinds of robots.

103:36I mean, it's more of an investment,

103:39but that would pay off way more in the future

103:42than just trying to cram expensive

103:45or maybe slightly less expensive humanoid technology

103:48into a human space.

103:50- Unfortunately, one company can't do that.

103:51We have to work together.

103:53It's like autonomous driving can be easily solved

103:55if you do V2I, if you change the infrastructure

103:59of cities and so on, but that requires a lot of people.

104:04A lot of them are politicians,

104:06and a lot of them are somewhat, if not a lot, corrupt,

104:09and all those kinds of things.

104:11And the talent thing you mentioned

104:13is really, really, really important.

104:16I've gotten a chance to meet a lot of folks

104:19at SpaceX and Tesla, other companies too,

104:22but they're specifically, the openness makes it easier

104:25to meet everybody.

104:26I think a lot of amazing things in this world happen

104:32when you get amazing people together.

104:34And if you can sell an idea,

104:36like us becoming a multi-planetary species,

104:39you can say, "Why the hell I would go to Mars?

104:43"Like why colonize Mars?"

104:45If you think from basic first principles,

104:50it doesn't make any sense.

104:51It doesn't make any sense to go to the moon.

104:55The only thing that makes sense

104:58to go to space is for satellites.

105:00But there's something about the vision of the future,

105:06the optimism laden that permeates this vision

105:10of us becoming multi-planetary.

105:12It's thinking not just for the next 10 years,

105:14it's thinking like human civilization

105:17reaching out into the stars.

105:19It makes people dream.

105:21It's really exciting.

105:23And that, they're gonna come up with some cool shit

105:25that might not have anything to do with,

105:28here's what I, 'cause Elon doesn't seem to care

105:32about social robotics, which is constantly surprising to me.

105:36I talk to him, he doesn't,

105:37humans are the things you avoid and don't hurt, right?

105:42Like that's, like the number one job of a robot

105:45is not to hurt a human, to avoid them.

105:47The collaborative aspect, the human-robot interaction,

105:52I think is not, at least not in his,

105:54not something he thinks about deeply.

105:59But my sense is if somebody like that takes on the problem

106:03of human-robotics, we're gonna get a social robot out of it.

106:07Like people like, not necessarily Elon,

106:10but people like Elon, if they take on seriously these,

106:14like I can just imagine with a humanoid robot,

106:22you can't help but create a social robot.

106:25So if you do different form factors,

106:26if you do industrial robotics,

§13Transcript · 1:46:31–1:55:26

106:31you're likely to actually not end up

106:33like walking head into a social robot,

106:38human-robot interaction problem.

106:40If you create for whatever the hell reason you want to,

106:42a humanoid robot, you're gonna have to reinvent,

106:46well, not reinvent, but introduce a lot of fascinating

106:50new ideas into the problem of human-robot interaction,

106:53which I'm excited about.

106:54So like if I was a business person,

106:57I would say this is way too risky.

107:00This doesn't make any sense.

107:02But when people are really convinced,

107:04and there's a lot of amazing people working on it,

107:06it's like, all right, let's see what happens here.

107:08This is really interesting.

107:09Just like with Atlas and Boston Dynamics.

107:13I mean, they, I apologize if I'm ignorant on this,

107:18but I think they really, more than anyone else,

107:22maybe with AIBO, like Sony,

107:24pushed forward humanoid robotics,

107:27like a leap with Atlas. - Oh yeah, with Atlas?

107:31Absolutely.

107:32- And like without them, like why the hell did they do it?

107:35- Why?

107:36Well, I think for them, it is a research platform.

107:38It's not, I don't think they ever, this is speculation,

107:42I don't think they ever intended Atlas

107:44to be like a commercially successful robot.

107:48I think they were just like, can we do this?

107:51Let's try.

107:52Yeah, I wonder if they, maybe the answer they landed on is,

107:56because they eventually went to Spot,

108:01the earlier versions of Spot.

108:03So, Quadruped's like four-legged robot,

108:07but maybe they reached for, let's try to make,

108:11like, I think they tried it,

108:15and they still are trying it for Atlas

108:18to be picking up boxes, to moving boxes, to being,

108:21it makes sense, okay, if they were exactly the same cost,

108:26it makes sense to have a humanoid robot in the warehouse.

108:32- Currently. - Currently.

108:33- I think it's short-sighted, but yes,

108:34currently, yes, it would sell.

108:37- But it's not, it's short-sighted,

108:40it's short-sighted, but it's not pragmatic

108:44to think any other way,

108:45to think that you're gonna be able to change warehouses.

108:48You're gonna have to, you're going--

108:50- If you're Amazon, you can totally change your warehouses.

108:52- Yes, yes, but even if you're Amazon,

108:56that's very costly to change warehouses.

109:01- It is, it's a big investment.

109:03- But isn't, shouldn't you do that investment in a way,

109:08so here's the thing, if you build a humanoid robot

109:10that works in the warehouse, that humanoid robot,

109:14see, I don't know why Tess is not talking about it this way,

109:17as far as I know, but that humanoid robot

109:20is gonna have all kinds of other applications

109:22outside their setting.

109:24To me, it's obvious.

109:27I think it's a really hard problem to solve,

109:29but whoever solves the humanoid robot problem

109:32are gonna have to solve the social robotics problem.

109:34- Oh, for sure, I mean, they're already with Spot

109:36needing to solve social robotics problems.

109:38- For Spot to be effective at scale.

109:42I'm not sure if Spot is currently effective at scale,

109:44it's getting better and better,

109:45but they're actually, the thing they did

109:48is an interesting decision,

109:50perhaps Tess will end up doing the same thing,

109:53which is Spot is supposed to be a platform for intelligence.

109:58So Spot doesn't have any high-level intelligence,

110:03like high-level perception skills.

110:07It's supposed to be controlled remotely.

110:10- And it's a platform that you can attach something to, yeah.

110:13- And somebody else is supposed to do the attaching.

110:15It's a platform that you can take an uneven ground

110:19and it's able to maintain balance,

110:21go into dangerous situations, it's a platform.

110:24On top of that, you can add a camera that does surveillance,

110:27that you can remotely monitor,

110:29you can record the camera, you can remote control it,

110:34but it's not gonna-- - Object manipulation.

110:36- Basic object manipulation,

110:37but not autonomous object manipulation.

110:40It's remotely controlled.

110:41But the intelligence on top of it,

110:43which is what would be required for automation,

110:46somebody else is supposed to do.

110:48Perhaps Tess will do the same thing ultimately,

110:51but it doesn't make sense

110:53because the goal of Optimus is automation.

110:56Without that, but then you never know.

111:03It's like, why go to Mars?

111:05Why?

111:06- I mean, that's true, and I reluctantly

111:10am very excited about space travel.

111:12- Why?

111:14Can you introspect, like why?

111:16- Why am I excited about it?

111:18I think what got me excited was I saw a panel

111:21with some people who study other planets,

111:26and it became really clear how little we know

111:30about ourselves and about how nature works

111:33and just how much there is to learn

111:36from exploring other parts of the universe.

111:39So like on a rational level,

111:43that's how I convince myself that that's why I'm excited.

111:46In reality, it's just fucking exciting.

111:49I mean, just like the idea

111:51that we can do this difficult thing

111:54and that humans come together to build things

111:57that can explore space.

111:59I mean, there's just something inherently thrilling

112:02about that, and I'm reluctant about it

112:05because I feel like there are so many other challenges

112:08and problems that I think are more important to solve,

112:12but I also think we should be doing all of it at once.

112:14And so to that extent, I'm like all for research

112:19on humanoid robots, development of humanoid robots.

112:23I think that there's a lot to explore and learn,

112:26and it doesn't necessarily take away

112:28from other areas of science.

112:31At least it shouldn't.

112:33I think unfortunately a lot of the attention

112:35goes towards that, and it does take resources

112:39and attention away from other areas of robotics

112:41that we should be focused on,

112:43but I don't think we shouldn't do it.

112:45- So you think it might be a little bit of a distraction.

112:48Oh, forget the Elon particular application,

112:51but if you care about social robotics,

112:55the humanoid form is a distraction.

112:59- It's a distraction, and it's one

113:00that I find particularly boring.

113:03It's just, it's interesting from a research perspective,

113:07but from a like what types of robots can we create

113:11to put in our world?

113:12Like why would we just create a humanoid robot?

113:14- So even just robotic manipulation,

113:16so arms is not useful either.

113:19- Oh, arms can be useful, but like why not have three arms?

113:22Like why does it have to look like a person?

113:25- Well, I actually personally just think

113:26that washing the dishes is harder

113:30than a robot that can be a companion.

113:33- Yeah. - Like being useful

113:35in the home is actually really tough.

113:38- But does your companion have to have like two arms

113:41and look like you?

113:42- No, I'm making the case for zero arms.

113:44- Oh, okay, zero arms.

113:46- Yeah. - Okay, freaky.

113:48- That didn't come out the way I meant it,

113:52'cause it almost sounds like I don't want a robot

113:54to defend itself.

113:56Like that's immediately you project,

113:58you know what I mean?

113:59Zero.

114:00No, I just think that the social component

114:05doesn't require arms or legs or so on, right?

114:08That's what we've talked about.

114:09And I think that's probably where a lot

114:11of the meaningful impact that's gonna be happening.

114:15- Yeah, I think just we could get so creative with the design

114:18like why not have a robot on roller skates or like whatever?

114:21Like why does it have to look like us?

114:24- Yeah.

114:27- Still, it is a compelling and interesting form

114:29from a research perspective, like you said.

114:31- Yeah.

114:32- You co-authored a paper as you were talking about

114:34that for WeRobot 2022,

114:38Lula Robot Consumer Protection

114:41in the Face of Automated Social Marketing.

114:43I think you were talking about some of the ideas in that.

114:46- Yes.

114:47Oh, you got it from Twitter.

114:47I was like, that's not published yet.

114:50- Yeah, this is how I do my research.

114:52- You just go through people's Twitter feeds.

114:54- Yeah, go, thank you.

114:56- It's not stalking if it's public.

114:58So there's a, you looked at me like you're offended.

115:04Like how did you know?

115:05- No, I was just like worried that like some early, I mean.

115:09- Yeah, there's a PDF.

115:11There's a PDF.

115:13- There is, like now?

115:15- Yeah.

115:16- Maybe like as of a few days ago.

115:18- Yeah.

115:19- Okay, well.

115:19- Yeah, yeah.

115:20- Okay.

115:21- You look violated.

115:24Like how did you get that PDF?

115:25- It's just a draft.

115:26It's online.

§14Transcript · 1:55:27–2:03:40

115:27Nobody read it yet until we've written the final paper.

115:30- Well, it's really good, so I enjoyed it.

115:32- Oh, thank you.

115:34- By the time this comes out, I'm sure it'll be out.

115:35Or no, when's Wee Robot?

115:37- So basically, Wee Robot, that's the workshop

115:39where you have an hour where people give you

115:42constructive feedback on the paper

115:43and then you write the good version.

115:45- Right, I take it back.

115:46There's no PDF.

115:47I don't know what I-- - It doesn't exist.

115:48- I imagine, but there is a table in there

115:50in a virtual imagined PDF that I like,

115:54that I wanted to mention, which is

115:56like this kind of strategy used

116:01across various marketing platforms.

116:03And it's basically looking at traditional media,

116:08person-to-person interaction, targeted ads,

116:11influencers, and social robots.

116:12This is the kind of idea that you've been speaking to.

116:14And it's just a nice breakdown of that,

116:17that social robots have personalized recommendations,

116:21social persuasion, automated scalable,

116:24data collection, and embodiment.

116:26So person-to-person interaction is really nice,

116:29but it doesn't have the automated

116:30and the data collection aspect.

116:33But the social robots have those two elements.

116:36- Yeah, we're talking about the potential

116:38for social robots to just combine

116:40all of these different marketing methods

116:41to be this really potent cocktail.

116:44And that table, which was Daniela's idea

116:46and a really fantastic one,

116:48we put it in at the last second, so.

116:50- Yeah, I really like that.

116:51- I'm glad you like it.

116:52- In a PDF that doesn't exist.

116:54- Yes.

116:55- That nobody can find if they look.

116:56- Yeah.

116:57- So when you say social robots, what does that mean?

116:59Does that include virtual ones or no?

117:01- I think a lot of this applies to virtual ones too.

117:04Although the embodiment thing,

117:06which I personally find very fascinating,

117:09is definitely a factor that research shows

117:11can enhance people's engagement with a device.

117:14- But can embodiment be a virtual thing also?

117:17Meaning like it has a body in the virtual world.

117:20- Maybe.

117:21- Makes you feel like,

117:22'cause what makes a body?

117:25A body is a thing that

117:27can disappear, has a permanence.

117:32I mean, there's certain characteristics

117:33that you kind of associate to a physical object.

117:37- So I think what I'm referring to,

117:41and I think this gets messy

117:44because now we have all these new virtual worlds

117:47and AR and stuff, and I think it gets messy,

117:51but there's research showing that something on a screen,

117:53on a traditional screen,

117:54and something that is moving in your physical space,

117:58that that has a very different effect

117:59on how your brain perceives it even.

118:02- So, I mean, I have a sense that we can do that

118:08in a virtual world.

118:09- Probably.

118:10Like when I've used VR, I jump around like an idiot

118:13because I think something's gonna hit me.

118:16- And even if a video game on a 2D screen

118:18is compelling enough,

118:19like the thing that's immersive about it

118:21is I kind of put myself into that world.

118:24Those, the objects you're interacting with,

118:28Call of Duty, things you're shooting,

118:30they're kind of,

118:32I mean, your imagination fills the gaps

118:35and it becomes real.

118:36Like it pulls your mind in when it's well done.

118:38So it really depends what's shown on the 2D screen.

118:41- Yeah.

118:43Yeah, I think there's a ton of different factors

118:45and there's different types of embodiment.

118:46Like you can have embodiment in a virtual world.

118:49You can have an agent that's simply text-based,

118:52which has no embodiment.

118:54So I think there's a whole spectrum of factors

118:57that can influence how much you engage with something.

119:00- Yeah, I wonder, I always wondered if you can have like

119:02an entity living in a computer.

119:06Okay, this is gonna be dark.

119:08I haven't always wondered about this.

119:10So this is gonna make it sound like

119:12I keep thinking about this kind of stuff.

119:14No, but like, this is almost like black mirror,

119:17but the entity that's convinced

119:21or is able to convince you that it's being tortured

119:25inside the computer and needs your help to get out.

119:29Something like this.

119:30That becomes, to me,

119:31to me suffering is one of the things

119:33that make you empathize with.

119:36Like we're not good at, as you've discussed in other,

119:39in the physical form, like holding a robot upside down,

119:43you have a really good examples about that

119:46and discussing that.

119:47I think suffering is a really good catalyst for empathy.

119:51And I just feel like we can project embodiment

119:57on a virtual thing if it's capable

119:58of certain things like suffering.

120:01- Yeah. - So I was wondering.

120:02- I think that's true.

120:03And I think that's what happened with the Lambda thing.

120:06Not that, I don't, none of the transcript

120:08was about suffering, but it was about

120:12having the capacity for suffering and human emotion

120:15that convinced the engineer that this thing was sentient.

120:19And it's basically the plot of Ex Machina.

120:22- True.

120:23Have you ever made a robot scream in pain?

120:26- Have I?

120:27No, but have you seen that?

120:28Did someone?

120:29Oh yeah, no, they actually made a Roomba scream

120:34whenever it hit a wall.

120:36- Yeah, I programmed that myself as well.

120:38- Yeah? - 'Cause I was inspired by that.

120:39Yeah, it's cool. - Do you still have it?

120:40- Oh, sorry, hit a wall.

120:43I didn't--

120:43- Whenever it bumped into something,

120:44it would scream in pain. - Yeah, yeah.

120:46No, I, so I had, the way I programmed the Roombas

120:50is when I kick it, whenever I,

120:52so contact between me and the robot is when it screams.

120:55- Really?

120:56Okay, and you were inspired by that?

120:59- Yeah, I guess I misremembered the video.

121:01I saw the video a long, long time ago,

121:03and, or maybe heard somebody mention it,

121:06and that just, it's the easiest thing to program.

121:08So I did that.

121:09I haven't run those Roombas for over a year now,

121:11but yeah, it was, my experience with it was that

121:15it's like they quickly become,

121:21like you remember them, you miss them,

121:27like they're real living beings.

121:30So the capacity to suffer is a really powerful thing.

121:34- Yeah. - Even then, that,

121:36I mean, it was kind of hilarious.

121:38It was just a random recording of screaming

121:40from the internet, but it's still, it's still, it's weird.

121:45There's a thing you have to get right

121:46based on the interaction, like the latency.

121:48Like it has, there is,

121:51there is a realistic aspect of how you should scream

121:56relative to when you get hurt.

121:58Like it should correspond correctly.

122:01- Like if you kick it really hard, it should scream louder?

122:05- No, it should scream at the appropriate time, not like--

122:07- Oh, I see, not like five minutes later.

122:09- One second later, right?

122:10Like there's an exact, like there's a timing

122:13when you get like, I don't know,

122:16when you run into, when you run your foot

122:18into like the side of a table or something,

122:20there's a timing there, the dynamics you have to get right

122:23for the actual screaming,

122:25'cause the Roomba in particular doesn't,

122:30so I was, the sensors don't,

122:35it doesn't know about pain.

122:37See? - What?

122:39(laughing)

122:40- I'm sorry to say, Roomba doesn't understand pain.

122:44So you have to correctly map the sensors,

122:48the timing to the production of the sound.

122:51But when you get that somewhat right,

122:53it starts, it's a weird, it's a really weird feeling.

122:56And you actually feel like a bad person.

122:58- Aw.

122:59- Yeah.

123:00So, but it's, it makes you think

123:04because that, with all the ways that we talked about,

123:07that could be used to manipulate you.

123:09- Oh, for sure.

123:10- In a good and bad way.

123:11So the good way is like you can form a connection

123:14with a thing, and a bad way that you can form a connection

123:17in order to sell you products that you don't want.

123:21- Yeah, or manipulate you politically,

123:23or many nefarious things.

123:26- You tweeted, "We're about to be living in the movie 'Her'

123:29except instead of," see, I researched your tweets,

123:33like they're like Shakespeare.

123:34"We're about to be living in the movie 'Her'

123:36except instead of about love, it's gonna be about,"

123:40what did I say, "the chatbot being subtly racist

§15Transcript · 2:03:43–2:12:25

123:43and the question whether it's ethical

123:46for companies to charge for software upgrades."

123:48- Yeah.

123:49So can we break that down?

123:52What do you mean by that?

123:54- Yeah.

123:55- Obviously, some of it is humor.

123:56- Yes, well, kind of.

123:58(laughs)

124:00I am, like, ah, it's so weird to be in this space

124:02where I'm so worried about this technology

124:06and also so excited about it at the same time.

124:09But the really, like, I haven't,

124:12I'd gotten a little bit jaded,

124:14and then with GPT-3 and then the Lambda transcript,

124:19I was, like, re-energized,

124:23but have also been thinking a lot about,

124:26you know, what are the ethical issues

124:31that are gonna come up?

124:32And I think some of the things

124:33that companies are really gonna have to figure out

124:35is obviously algorithmic bias

124:38is a huge and known problem at this point.

124:40Like, even, you know, the new image generation tools,

124:45like DALI, where they've clearly put in a lot of effort

124:49to make sure that if you search for people,

124:52it gives you a diverse set of people, et cetera.

124:54Like, even that one, people have already found numerous,

124:57like, ways that it just kind of regurgitates biases

125:02and things that it finds on the internet,

125:03like how if you search for success,

125:05it gives you a bunch of images of men.

125:07If you search for sadness,

125:08it gives you a bunch of images of women.

125:10So I think that this is, like, the really tricky one

125:14with these voice agents

125:15that companies are gonna have to figure out.

125:17And that's why it's subtly racist and not overtly,

125:20because I think they're gonna be able

125:21to solve the overt thing,

125:23and then with the subtle stuff,

125:24it's gonna be really difficult.

125:26And then I think the other thing is gonna be,

125:29people are gonna become so emotionally attached

125:33to artificial agents with this complexity of language,

125:38with a potential embodiment factor,

125:41that, I mean, there's already,

125:42there's a paper at WeRobot this year

125:44written by roboticists about how to deal

125:47with the fact that robots die

125:49and looking at it as an ethical issue,

125:52because it impacts people.

125:54And I think there's gonna be way more issues than just that.

125:59I think the tweet was software upgrades, right?

126:01Like, how much is it okay to charge for something like that

126:04if someone is deeply, emotionally invested

126:07in this relationship?

126:09- Oh, the ethics of that, that's interesting.

126:13But there's also the practical funding mechanisms,

126:17like you mentioned with AIBO, the dog.

126:19In theory, there's a subscription.

126:21- Yeah, the new AIBO.

126:23So the old AIBO from the '90s,

126:25people got really attached to,

126:27and in Japan they're still having funerals

126:29in Buddhist temples for the AIBOs that can't be repaired

126:32because people really viewed them as part of their families.

126:36- So we're talking about robot dogs.

126:37- Robot dogs, the AIBO, yeah.

126:38The original, famous robot dog that Sony made

126:42came out in the '90s, got discontinued,

126:45having funerals for them in Japan.

126:47Now they have a new one.

126:48The new one is great.

126:49I have one at home.

126:50It's like--

126:51- It's $3,000, how much is it?

126:53- I think it's 3,000 bucks.

126:54And then after a few years, you have to start paying,

126:58I think it's like 300 a year for a subscription service

127:01for cloud services.

127:02And the cloud services,

127:04I mean, it's a lot,

127:08the dog is more complex than the original,

127:11and it has a lot of cool features,

127:12and it can remember stuff and experiences,

127:14and it can learn.

127:15And a lot of that is outsourced to the cloud.

127:18And so you have to pay to keep that running,

127:20which makes sense.

127:21People should pay, and people who aren't using it

127:24shouldn't have to pay.

127:25But it does raise the interesting question,

127:28could you set that price to reflect a consumer's willingness

127:33to pay for the emotional connection?

127:36So if you know that people are really, really attached

127:41to these things, just like they would be to a real dog,

127:45could you just start charging more?

127:47Because there's more demand.

127:49- Yeah, and you have to be,

127:53but that's true for anything that people love, right?

127:58- It is, and it's also true for real dogs.

128:00Like there's all these new medical services nowadays

128:04where people will shell out thousands and thousands of

128:06dollars to keep their pets alive.

128:08And is that taking advantage of people,

128:11or is that just giving them what they want?

128:14That's the question.

128:16- Back to marriage, what about all the money

128:19that it costs to get married,

128:20and then all the money that it costs to get a divorce?

128:24That feels like a very, that's like a scam.

128:30I think the society is full of scams that are like--

128:32- Oh, it's such a scam.

128:34And then we've created,

128:35the whole wedding industrial complex has created

128:38all these quote unquote traditions that people buy into

128:42that aren't even traditions.

128:43They're just fabricated by marketing.

128:46It's awful.

128:48- Let me ask you about racist robots.

128:50- Sure.

128:51- Is it up to a company that creates that?

128:54So we talk about removing bias and so on.

128:57And that's a really popular field in AI currently.

128:59And a lot of people agree that it's an important field.

129:03But the question is for like social robotics,

129:06is should it be up to the company

129:08to remove the bias of society?

129:10- Well, who else can, oh, to remove the bias of society.

129:13- I guess because there's a lot of people

129:16that are subtly racist in modern society,

129:19like why shouldn't our robots also be subtly racist?

129:22I mean, that's like,

129:24why do we put so much responsibility on the robots?

129:28- Because, because the robot--

129:32- I'm imagining like a Hitler Roomba.

129:34I mean, that would be funny.

129:37But I guess I'm asking a serious question.

129:40- You're allowed to make that joke.

129:41- Yes, exactly, I'm allowed to make that joke, yes.

129:44(laughing)

129:47And I've been nonstop reading about World War II and Hitler.

129:50I think I'm glad we exist in a world

129:52where we can just make those jokes.

129:54That helps deal with it.

129:56Anyway, it is a serious question.

129:59It's sort of like,

130:00like it's such a difficult problem to solve.

130:06Now, of course, like bias and so on,

130:09like there's low hanging fruit,

130:11which I think was what a lot of people are focused on.

130:13But then it becomes like subtle stuff.

130:17Over time, it's very difficult to know.

130:19Now, you can also completely remove the personality.

130:23You can completely remove the personalization.

130:26- You can remove the language aspect,

130:27which is what I had been arguing,

130:30because I was like,

130:30the language is a disappointing aspect

130:32of social robots anyway.

130:34But now we're reintroducing that

130:36because it's now no longer disappointing.

130:39So I do think, well, let's just start with the premise,

130:44which I think is very true,

130:45which is that racism is not a neutral thing,

130:48but it is the thing that we don't want in our society.

130:51Like it does not conform to my values.

130:54So if we agree that racism is bad,

130:56I do think that it has to be the company,

131:01because the problem, I mean,

131:02it might not be possible.

131:06And companies might have to put out products

131:09that where they're taking risks

131:11and they might get slammed by consumers

131:14and they might have to adjust.

131:16I don't know how this is gonna work in the market.

131:19I have opinions about how it should work,

131:20but it is on the company.

131:22And the danger with robots

131:25is that they can entrench this stuff.

131:27It's not like your racist uncle

131:30who you can have a conversation with and-

131:34- And put things into context maybe with that.

131:38- Yeah, or who might change over time with more experience.

131:42A robot really just like regurgitates things,

131:46entrenches them, could influence other people.

131:50And I mean, I think that's terrible.

131:54- Well, I think there's a difficult challenge here

131:56is because even the premise you started with

131:58that essentially racism is bad.

132:01I think we live in a society today

132:04where the definition of racism

132:06is different between different people.

132:09Some people say that it's not enough not to be racist.

132:12Some people say you have to be anti-racist.

132:14So you have to have a robot that constantly calls out,

132:18like calls you out on your implicit racism.

132:23- I would love that.

132:25I would love that robot.

§16Transcript · 2:12:27–2:21:47

132:27- But like maybe it sees racism.

132:29Well, I don't know if you'd love it

132:31'cause maybe you'll see racism in things that aren't racist.

132:34And then you're arguing with a robot.

132:37- Your robot starts calling you racist.

132:39I'm not exactly sure that, I mean, it's a tricky thing.

132:43I guess I'm saying that the line is not obvious,

132:48especially in this heated discussion

132:51where we have a lot of identity politics

132:53of what is harmful to different groups and so on.

132:56- Yeah.

132:57- It feels like the broader question here

133:01is should a social robotics company be solving

133:06or being part of solving the issues of society?

133:09- Well, okay, I think it's the same question as

133:12should I as an individual be responsible

133:16for knowing everything in advance

133:19and saying all the right things?

133:21And the answer to that is yes, I am responsible,

133:26but I'm not gonna get it perfect.

133:30And then the question is how do we deal with that?

133:32And so as a person, how I aspire to deal with that is

133:37when I do inevitably make a mistake

133:41because I have blind spots and people get angry,

133:45I don't take that personally

133:47and I listen to what's behind the anger.

133:50And it can even happen that like,

133:52maybe I'll tweet something that's well-intentioned

133:55and one group of people starts yelling at me

133:59and then I change it the way that they said

134:01and then another group of people starts yelling at me,

134:03which has happened, this happened to me actually around,

134:08in my talks, I talk about robots

134:10that are used in autism therapy.

134:12And so whether to say a child with autism

134:15or an autistic child is super controversial

134:19and a lot of autistic people

134:20prefer to be referred to as autistic people

134:22and a lot of parents of autistic children

134:25prefer child with autism and then they disagree.

134:29So I've gotten yelled at from both sides

134:32and I think I'm still, I'm responsible

134:35even if I can't get it right.

134:37I don't know if that makes sense.

134:38Like it's a responsibility thing

134:40and I can be as well-intentioned as I want

134:44and I'm still gonna make mistakes

134:46and that is part of the existing power structures that exist

134:49and that's something that I accept.

134:51- And you accept being attacked from both sides

134:53and grow from it and learn from it.

134:55But the danger is that after being attacked,

134:59assuming you don't get canceled,

135:00AKA completely removed from your ability to tweet,

135:04you might become jaded

135:09and not want to talk about autism anymore.

135:11- I don't and I didn't.

135:13I mean, it's happened to me.

135:15What I did was I listened to both sides

135:17and I chose, I tried to get information

135:21and then I decided that I was going to use autistic children

135:29and now I'm moving forward with that.

135:30Like, I don't know.

135:31- For now, right.

135:32- For now, yeah, until I get updated information

135:34and I'm never gonna get anything perfect

135:36but I'm making choices and I'm moving forward

135:39because being a coward and like just retreating from that,

135:43I think--

135:45- But see, here's the problem.

135:46You're a very smart person and an individual,

135:49a researcher, a thinker, an intellectual.

135:51So that's the right thing for you to do.

135:53The hard thing is when as a company,

135:56imagine you had a PR team.

135:58- I said, Kate, this you should--

136:00- The PR teams we hate.

136:01- Yeah, I mean, just, well, if you hired PR people,

136:06like obviously they would see that and they'd be like,

136:10well, maybe don't bring up autism.

136:12Maybe don't bring up these topics.

136:14You're getting attacked, it's bad for your brand.

136:17They'll say the brand word.

136:18There'll be, if we look at different demographics

136:22that are inspired by your work,

136:23I think it's insensitive to them.

136:25Let's not mention this anymore.

136:26There's this kind of pressure that all of a sudden you,

136:31or you do suboptimal decisions.

136:34You take a kind of poll.

136:36Again, it's looking at the past versus the future,

136:41all those kinds of things.

136:42And it becomes difficult.

136:44In the same way that it's difficult

136:46for social media companies to figure out like

136:49who to censor, who to recommend.

136:53- I think this is ultimately a question about leadership.

136:55Honestly, like the way that I see leadership,

136:58because right now,

137:00the thing that bothers me about institutions

137:04and a lot of people who run current institutions

137:06is that their main focus is protecting the institution

137:10or protecting themselves personally.

137:12That is bad leadership

137:13because it means you cannot have integrity.

137:16You cannot lead with integrity.

137:18And it makes sense because like, obviously,

137:21if you're the type of leader who immediately blows up

137:23the institution you're leading,

137:25then that doesn't exist anymore.

137:26And maybe that's why we don't have any good leaders anymore

137:29because they had integrity and they didn't put,

137:33you know, the survival of the institution first.

137:36But I feel like you have to,

137:39just to be a good leader,

137:43you have to be responsible

137:47and understand that with great power

137:49comes great responsibility.

137:50You have to be humble and you have to listen

137:53and you have to learn.

137:53You can't get defensive and you cannot

137:55put your own protection before other things.

137:58- Yeah, take risks where you might lose your job,

138:00you might lose your wellbeing because of,

138:05because in the process of standing for the principles,

138:12for the things you think are right to do, yeah.

138:15Based on the things you,

138:18like based on learning from,

138:20like listening to people and learning from what they feel.

138:23And the same goes for the institution, yeah.

138:26Yeah, but I ultimately actually believe

138:27that those kinds of companies and countries succeed

138:32that have leaders like that.

138:34You should run for president.

138:35- No, thank you.

138:38- Yeah.

138:38- That's maybe the problem.

138:39Like the people who have good ideas about leadership,

138:42they're like, yeah.

138:43- No.

138:44- This is why I don't,

138:45this is why I'm not running a company.

138:46- It's been, I think, three years

138:48since the Jeffrey Epstein controversy at MIT,

138:52MIT Media Lab.

138:53Joey Ito, the head of the Media Lab resigned.

138:58And I think at that time you wrote

139:00an opinion article about it.

139:02So just looking back a few years have passed,

139:05what have you learned about human nature

139:10from the fact that somebody like Jeffrey Epstein

139:16found his way inside MIT?

139:22- It's a really good question.

139:23What have I learned about human nature?

139:25I think,

139:27well, there's,

139:31there's how did this problem come about?

139:36And then there's what was the reaction to this problem

139:40and to it becoming public?

139:43And in the reaction,

139:44the things I learned about human nature

139:49were that sometimes cowards are worse than assholes.

139:54(laughs)

140:01Wow, I'm really, ugh.

140:02- I think that's a really powerful statement.

140:05- I think because the assholes,

140:08at least you know what you're dealing with.

140:11They have integrity in a way.

140:13They're just living out their asshole values.

140:16And the cowards are the ones that you have to watch out for.

140:18And this comes back to people protecting themselves

140:22over doing the right thing.

140:25They'll throw others under the bus.

140:29- Is there some sense that not enough people

140:31took responsibility?

140:32- For sure.

140:35And I mean, I don't wanna sugar coat at all

140:40what Joey Ito did.

140:41I mean, I think it's gross

140:44that he took money from Jeffrey Epstein.

140:46I believe him that he didn't know about the bad, bad stuff.

140:48But I've been in those circles

140:50with those public intellectual dudes

140:53that he was hanging out with.

140:54And any woman in those circles

140:57saw 10 zillion red flags.

141:00The whole environment was so misogynist.

141:02And so personally, because Joey was a great boss

141:08and a great friend,

141:09I was really disappointed that he ignored that

141:13in favor of raising money.

141:18And I think that it was right for him to resign

141:23in the face of that.

141:24But one of the things that he did

141:29that many others didn't was he came forward about it

141:33and he took responsibility.

141:35And all of the people who didn't, I think,

141:40it's just interesting.

141:45The other thing I learned about human nature,

141:47okay, I'm gonna go on a tangent,

§17Transcript · 2:21:49–2:31:00

141:49but I'll come back, I promise.

141:50So I once saw this tweet from someone,

141:53or it was a Twitter thread,

141:54from someone who worked at a homeless shelter.

141:57And he said that when he started working there,

142:00he noticed that people would often come in

142:02and use the bathroom

142:03and they would just trash the entire bathroom,

142:05like rip things out of the walls,

142:07like toilet paper on the ground.

142:08And he asked someone who had been there longer,

142:10like, why do they do this?

142:12Why do the homeless people come in and trash the bathroom?

142:13And he was told it's because it's the only thing

142:16in their lives that they have control over.

142:19And I feel like sometimes when it comes to the response,

142:25just the mobbing response that happens

142:36in the wake of some harm that was caused,

142:40if you can't target the person who actually caused the harm,

142:45who was Epstein,

142:47you will go as many circles out as you can

142:50until you find the person that you have power over

142:52and you have control over,

142:53and then you will trash that.

142:55And it makes sense that people do this.

142:57It's, again, it's a human nature thing.

142:59Of course, you're gonna focus all your energy

143:02because you feel helpless and enraged,

143:04and it's unfair and you have no other power.

143:08You're gonna focus all of your energy

143:10on someone who's so far removed from the problem

143:12that that's not even an efficient solution.

143:17- And the problem is often the first person you find

143:20is the one that has integrity,

143:22sufficient integrity to take responsibility.

143:24- Yeah, and it's why my husband always says,

143:27he's a liberal, but he's always like,

143:29when liberals form a firing squad, they stand in a circle.

143:33Because you know that your friends

143:36are gonna listen to you, so you criticize them.

143:39You're not gonna be able to convince someone

143:40across the aisle.

143:42- See, in that situation, what I had hoped

143:44is the people in the farther, in that situation,

143:49any situation of that sort,

143:51the people that are farther out in the circles

143:54stand up and also take some responsibility

144:00for the broader picture of human nature

144:02versus specific situation,

144:05but also take some responsibility,

144:11but also defend the people involved as flawed,

144:16not in a like, no, no, no, nothing,

144:19like this, people fucked up.

144:21Like you said, there's a lot of red flags

144:24that people just ignored for the sake of money

144:27in this particular case.

144:28But also like be transparent and public about it

144:32and spread the responsibility

144:36across a large number of people

144:38such that you learn a lesson from it.

144:41- Institutionally.

144:42- Yeah, it was a systems problem.

144:45It wasn't a one individual problem.

144:47- And I feel like currently,

144:49because Joey took, resigned because of it,

144:55or essentially fired, pressured out because of it,

144:58MIT can pretend like, oh, we didn't know anything.

145:04It wasn't part--

145:05- Bad leadership, again,

145:07because when you are at the top of an institution

145:11with that much power and you were complicit in what happened,

145:15which they were, like, come on,

145:18there's no way that they didn't know

145:19that this was happening.

145:21So like to not stand up and take responsibility,

145:26I think it's bad leadership.

145:29- Do you understand why Epstein was able to,

145:34outside of MIT, he was able to make a lot of friends

145:38with a lot of powerful people.

145:41Does that make sense to you?

145:42Why was he able to get in these rooms,

145:45befriend these people,

145:47befriend people that I don't know personally,

145:50but I think a lot of them indirectly I know

145:55as being good people, smart people.

145:59Why would they let Jeffrey Epstein into their office,

146:02have a discussion with them?

146:04What do you understand about human nature from that?

146:07- Well, so I never met Epstein,

146:10or I mean, I've met some of the people

146:14who interacted with him,

146:15but I was never, like, I never saw him in action.

146:20I don't know how charismatic he was or what that was,

146:23but I do think that sometimes the simple answer

146:27is the more likely one,

146:29and from my understanding,

146:31what he would do is he was kind of a social grifter,

146:34like, you know those people who will,

146:37you must get this because you're famous.

146:40You must get people coming to you and being like,

146:43oh, I know your friend so-and-so

146:45in order to get cred with you.

146:48I think he just convinced some people

146:54who were trusted in a network that he was a great guy

146:59and that, you know, whatever, I think at that point,

147:02'cause at that point he had had like,

147:04what, a conviction prior, but it was a one-off thing.

147:08It wasn't clear that there was this other thing

147:11that was that--

147:12- And most people probably don't check.

147:14- Yeah, and most people don't check.

147:15Like, you're at an event, you meet this guy.

147:17I don't know, maybe people do check

147:18when they're that powerful and wealthy,

147:20or maybe they don't.

147:20I have no idea.

147:21No, they're just stupid. - I haven't seen that.

147:23I mean, and they're not, like,

147:25all right, does anyone check anything about me?

147:31Because I've walked into some of the richest,

147:33some of the most powerful people in the world,

147:35and nobody, like, asks questions like,

147:38who the fuck is this guy?

147:40Like-- - Yeah.

147:41- Like, nobody asks those questions.

147:43It's interesting.

147:44I would think, like, there would be more security

147:47or something.

147:47Like, there really isn't.

147:49I think a lot of it has to do, well, my hope is,

147:53in my case, has to do with, like,

147:54people can sense that this is a good person,

147:56but if that's the case, then they can surely,

148:00then a human being can use charisma to infiltrate.

148:05- Yeah. - Just being,

148:06just saying the right things-- - And once you have people

148:07vouching for you within that type of network,

148:11like, once you, yeah, once you have someone powerful

148:13vouching for you who someone else trusts,

148:16then, you know, you're in.

148:18- So how do you avoid something like that?

148:25If you're MIT, if you're Harvard,

148:27if you're any of these institutions?

148:29- Well, I mean, first of all, you have to do your homework

148:31before you take money from someone.

148:33Like, I think that's required,

148:38but I think, you know, I think Joey did do his homework.

148:40I think he did, and I think at the time that he took money,

148:44there was the one conviction and not, like, the later thing,

148:47and I think that the story at that time was that

148:50he didn't know she was underage and blah, blah, blah,

148:55or whatever, it was a mistake,

148:56and Joey always believed in redemption for people,

148:59and that people can change,

149:00and that they can genuinely regret,

149:02and, like, learn and move on,

149:04and he was a big believer in that,

149:05so I could totally see him being like,

149:08well, I'm not gonna exclude him because of this thing,

149:11and because other people are vouching for him.

149:14Just to be clear, we're now talking about the set of people

149:20who I think Joey belonged to who did not, like,

149:23go to the island and have sex with underage girls,

149:25because that's a whole other set of people who, like,

149:29were powerful and, like, were part of that network

149:32and who knew and participated,

149:34and so, like, I distinguish between people who got taken in

149:38who didn't know that that was happening

149:40and people who knew.

149:41- I wonder what the different circles look like.

149:43So, like, people that went to the island

149:46and didn't do anything, didn't see anything,

149:49didn't know about anything,

149:50versus the people that did something.

149:53- And then there's people who heard rumors, maybe.

149:56- And what do you do with rumors?

149:58Like, isn't there people that heard rumors

150:01about Bill Cosby for the longest time?

150:03For, like, for the longest, like, whenever that happened,

150:08like, all these people came out of the woodwork,

150:10like, everybody kind of knew.

150:11I mean, it's like, all right,

150:15so what are you supposed to do with rumors?

150:17Like, what, I think the other way to put it

150:20is red flags, as you were saying.

150:22- Yeah, and, like, I can tell you that those circles,

150:25like, there were red flags without me even hearing

150:28any rumors about anything ever.

150:30Like, I was already like, hmm,

150:31there are not a lot of women here, which is a bad sign.

150:36- Isn't there a lot of places where there's not a lot

150:39of women and that doesn't necessarily mean it's a bad sign?

150:42- There are if it's like a pipeline problem

150:44where it's like, I don't know,

150:49technology law clinic that only gets, like, male lawyers

150:51because there's not a lot of women, you know,

150:55applicants in the pool.

150:56- But there's some aspect of this situation

150:58that, like, there should be more women here.

151:00- Oh, yeah, yeah.

§18Transcript · 2:31:03–2:40:25

151:03- You've, actually, I'd love to ask you about this

151:10'cause you have strong opinions about Richard Stallman.

151:15Is that, do you still have those strong opinions?

151:20- Look, all I need to say is that he met my friend

151:23who's a law professor.

151:25- Yeah.

151:25- She shook his hand and he licked her arm

151:28from wrist to elbow, and it certainly wasn't appropriate

151:31at that time.

151:31- What about if you're, like, an incredibly weird person?

151:38- Okay, that's a good question because, obviously,

151:41there's a lot of neurodivergence at MIT and everywhere,

151:45and, obviously, like, we need to accept

151:48that people are different,

151:49that people don't understand social conventions

151:51the same way, but one of the things that I've learned

151:54about neurodivergence is that women are often

151:59expected or taught to mask their neurodivergence

152:05and kind of fit in, and men are accommodated and excused,

152:10and I don't think that being neurodivergent

152:15gives you a license to be an asshole.

152:17Like, you can be a weird person and you can still learn

152:22that it's not okay to lick someone's arm.

152:24- Yeah, it's a balance.

152:26Like, women should be allowed to be a little weirder

152:29and men should be less weird.

152:31'Cause I think there's a, 'cause you're one of the people,

152:34I think, tweeting that, what made me,

152:37'cause I wanted to talk to Richard Stallman on the podcast

152:40about, 'cause I didn't have a context,

152:43'cause I wanted to talk to him 'cause he's,

152:45you know, free software.

152:46- Richard Stallman.

152:47- He's very weird in interesting, good ways

152:51in the world of computer science.

152:52He's also weird in that, you know, when he gives a talk,

152:57he'll be like picking at his feet

153:00and eating the skin off his feet, right?

153:03He's known for these extremely kind of,

153:05how else do you put it?

153:08I don't know how to put it.

153:09But then there was something that happened to him

153:13in conversations on this thread related to Epstein.

153:16- Yeah.

153:17- Which I was torn about because I felt it's similar to Joy,

153:22you know, it's like, I felt he was maligned.

153:27Like people were looking for somebody to get angry at.

153:32So he was inappropriate, but the,

153:34I didn't like the cowardice more.

153:39Like I set aside his situation and we could discuss it,

153:44but the cowardice on MIT's part,

153:46and this is me saying it,

153:48about the way they treated that whole situation.

153:50- Oh, they're always cowards about how they treat anything.

153:52They just try to make the problem go away.

153:54- Yeah, so it was about, yeah, exactly.

153:57- That said, I think he should have left the mailing list.

154:01- He shouldn't have been part of the mailing list.

154:03- Well, that's probably true also.

154:05But I think what bothered me,

154:09what always bothers me in these mailing list situations

154:12or Twitter situations, like if you say something

154:17that's hurtful to people or makes people angry,

154:20and then people start yelling at you,

154:22maybe they shouldn't be yelling.

154:26Maybe they are yelling because again,

154:28you're the only point of power they have.

154:31Maybe it's okay that you're yelling, whatever it is,

154:35like it's your response to that that matters.

154:40And I think that I just have a lot of respect for people

154:43who can say, "Oh, people are angry.

154:49There's a reason they're angry.

154:51Let me find out what that reason is

154:52and learn more about it.

154:53It doesn't mean that I am wrong.

154:56It doesn't mean that I am bad.

154:58It doesn't mean that I'm ill-intentioned,

155:00but why are they angry?

155:02I wanna understand."

155:03And then once you understand,

155:06you can respond again with integrity and say,

155:09"Actually, I stand by what I said.

155:11Here's why."

155:12Or you can say, "Actually, I listened

155:14and here are some things I learned."

155:16That's the kind of response I wanna see from people.

155:19And people like Stallman do not respond that way.

155:22They just go into battle.

155:25- Right, like where it's obvious you didn't listen.

155:28- Yeah, no interest in listening.

155:30- Honestly, that's to me as bad as the people

155:32who just apologize just 'cause they are trying

155:35to make the problem go away.

155:36- Of course.

155:37- Right, so like if--

155:39- That's not--

155:40- It's like both are bad.

155:41- A good apology has to include understanding

155:44what you did wrong.

155:46- And in part, standing up for the things

155:48you think you did right.

155:49So like--

155:50- Yeah, if there are those things, yeah.

155:51- Finding and then, but you have to give,

155:54you have to acknowledge, you have to like give

155:57that hard hit to the ego that says I did something wrong.

156:00Yeah, definitely Richard Stallman is not somebody

156:03who is capable of that kind of thing

156:05or hasn't given evidence of that kind of thing.

156:09- But that was also, even just your tweet,

156:11I had to do a lot of thinking like,

156:13different people from different walks of life

156:17see red flags in different things.

156:19- Yeah.

156:20- And so things I find as a man,

156:25non-threatening and hilarious are not necessarily,

156:35doesn't mean that they're aren't like deeply hurtful

156:40to others.

156:41And I don't mean that in a social justice warrior way,

156:44but in a real way, like people really have

156:47different experiences.

156:49So I feel like really put things into context.

156:52They have to kind of listen to what people are saying,

156:56put aside the emotion of what they're,

156:58emotion with which you're saying it

157:00and try to keep the facts of their experience

157:04and learn from it.

157:05- And because it's not just about

157:07the individual experience either.

157:08It's not like, oh, my friend didn't have a sense of humor

157:11about being licked.

157:12It's that she's been metaphorically licked

157:1757 times that week because she's an attractive law professor

157:21and she doesn't get taken seriously.

157:22And so like men walk through the world

157:25and it's impossible for them to even understand

157:29what it's like to have a different experience of the world.

157:33And that's why it's so important to listen to people

157:35and believe people and believe that they're angry

157:38for a reason.

157:39Maybe you don't like their tone.

157:40Maybe you don't like that they're angry at you.

157:42Maybe you get defensive about that.

157:44Maybe you think that they should explain it to you,

157:47but believe that they're angry for a reason

157:50and try to understand it.

157:51- Yeah, there's a deep truth there

157:54and an opportunity for you to become a better person.

157:56Can I ask you a question?

158:01Haven't you been doing that for two hours?

158:03- Three hours now.

158:06Let me ask you about Ghislaine Maxwell.

158:11She's been saying that she's an innocent victim.

158:13Is she an innocent victim or is she evil

158:20and equally responsible like Jeffrey Epstein?

158:23Now I'm asking far away from any MIT things and more,

158:27just your sense of the whole situation.

158:29- I haven't been following it,

158:30so I don't know the facts of the situation

158:33and what is now known to be her role in that.

158:37If I were her, clearly I'm not,

158:39but if I were her, I wouldn't be going around

158:41saying I'm an innocent victim.

158:42I would say, maybe she's, I don't know what she's saying.

158:47Again, I don't know.

158:48- She was controlled by Jeffrey.

158:50- Is she saying this as part of a legal case

158:52or is she saying this as a PR thing?

158:55- Well, PR, but it's not just her thing.

159:00It's her whole family believes this.

159:03There's a whole effort that says like,

159:06how should I put it?

159:09I believe they believe it.

159:11So in that sense, it's not PR.

159:12I believe the family, basically the family is saying

159:17that she's a really good human being.

159:22- Well, I think everyone is a good human being.

159:23I know that's a controversial opinion,

159:25but I think everyone is a good human being.

159:31There's no evil people.

159:35There's people who do bad things

159:39and who behave in ways that harm others.

159:41And I think we should always hold people accountable

159:43for that, but holding someone accountable

159:45doesn't mean saying that they're evil.

159:48- Yeah, actually those people usually think

159:51they're doing good.

159:52- Yeah, I mean, aside from, I don't know,

159:55maybe sociopaths like are specifically trying

159:58to harm people, but I think most people

160:02are trying to do their best.

160:04And if they're not doing their best,

160:07it's because there's some impediment

160:09or something in their past.

160:10So I just, I genuinely don't believe

160:13in good and evil people, but I do believe

160:15in harmful and not harmful actions.

160:18And so I don't know, I don't care.

160:22Yeah, she's a good person, but if she contributed

160:25to harm, then she needs to be accountable for that.

§19Transcript · 2:40:27–2:49:30

160:27That's my position.

160:29I don't know what the facts of the matter are.

160:30It seems like she was pretty close to the situation,

160:32so it doesn't seem very believable that she was a victim,

160:35but I don't know.

160:36- I wish I have met Epstein, 'cause something tells me

160:39he would just be a regular person,

160:41charismatic person like anybody else.

160:44And that's a very dark reality that we don't know

160:47which among us, what each of us are hiding in the closet.

160:54That's a really tough thing to deal with,

160:58because then you can put your trust into some people

161:01and they can completely betray that trust

161:03and in the process destroy you.

161:05Which there's a lot of people that interacted with Epstein

161:10that now have to, I mean, if they're not destroyed by it,

161:15then their whole, the ground on which they stand ethically

161:22has crumbled, at least in part.

161:25And I'm sure you and I have interacted with people

161:31without knowing it who are bad people.

161:34- As I always tell my four-year-old,

161:36people who have done bad things.

161:38- People who have done bad things.

161:39- He's always talking about bad guys

161:41and I'm trying to move him towards,

161:43they're just people who make bad choices.

161:46- Yeah, that's really powerful, actually.

161:48That's really important to remember,

161:49'cause that means you have compassion

161:51towards all human beings.

161:53Do you have hope for the future of MIT,

161:56the future of Media Lab in this context?

161:58So David Newman is now at the helm.

162:01I'm gonna talk, I talked to her previously,

162:02I'll talk to her again.

162:04She's great.

162:05- Love her.

162:06Yeah, she's great.

162:07I don't know if she knew the whole situation

162:11when she started, because the situation went beyond

162:15just the Epstein scandal.

162:17A bunch of other stuff happened at the same time.

162:21Some of it's not public,

162:23but what I was personally going through at that time.

162:28So the Epstein thing happened, I think,

162:30was it August or September 2019?

162:34It was somewhere around late summer.

162:36In June 2019, so I'm a research scientist at MIT.

162:43You are too, right?

162:44So, and I always have had various supervisors

162:48over the years, and they've just basically

162:50let me do what I want, which has been great.

162:52But I had a supervisor at the time,

162:55and he called me into his office for a regular check-in.

163:00In June of 2019, I reported to MIT

163:03that my supervisor had grabbed me,

163:08pulled me into a hug, wrapped his arms around my waist,

163:12and started massaging my hip, and trying to kiss me,

163:16kiss my face, kiss me near the mouth,

163:19and said literally the words,

163:21"Don't worry, I'll take care of your career."

163:24And that experience was really interesting

163:31because I just, I was very indignant.

163:35I was like, "He can't do that to me.

163:38Doesn't he know who I am?"

163:40And I was like, "This is the Me Too era."

163:42And I naively thought that when I reported that,

163:45it would get taken care of.

163:46And then I had to go through

163:47the whole reporting process at MIT,

163:49and I learned a lot about how institutions

163:53really handle those things internally,

163:55particularly situations where

163:58I couldn't provide evidence that it happened.

164:00I had no reason to lie about it, but I had no evidence.

164:02And so I was going through that,

164:06and that was another experience for me

164:09where there's so many people in the institution

164:13who really believe in protecting the institution

164:16at all costs.

164:17And there's only a few people

164:19who care about doing the right thing.

164:21And one of them resigned.

164:24Now there's even less of them left.

164:26- So what'd you learn from that?

164:31I mean, where's the source,

164:32if you have hope for this institution

164:35that I think you love, at least in part?

164:38I love the idea of MIT.

164:41- I love the idea.

164:42I love the research body.

164:43I love a lot of the faculty.

164:44I love the students.

164:45I love the energy.

164:46I love it all.

164:48I think the administration suffers from the same problems

164:51as any institutional,

164:54any leadership of an institution that is large,

164:58which is that

164:59they've become risk-averse, like you mentioned.

165:06They care about PR.

165:08The only ways to get their attention

165:12or change their minds about anything

165:14are to threaten the reputation of the institute

165:16or to have a lot of money.

165:17That's the only way to have power at the institute.

165:21Yeah, I don't think they have a lot of integrity

165:26or believe in ideas

165:27or even have a lot of connection to the research body

165:30and the people who are really,

165:32'cause it's so weird.

165:33You have this amazing research body of people

165:36pushing the boundaries of things

165:37who aren't afraid to,

165:39there's the hacker culture.

165:40And then you have the administration

165:44and they're really like

165:45protect the institution at all costs.

165:50- Yeah, there's a disconnect, right?

165:52- Complete disconnect.

165:53- I wonder if that was always there,

165:54if it just kind of slowly grows over time,

165:57a disconnect between the administration and the faculty.

165:59- I think it grew over time is what I've heard.

166:03I mean, I've been there for 11 years now.

166:05I don't know if it's gotten worse during my time,

166:11but I've heard from people who've been there longer

166:13that it didn't,

166:15like MIT didn't used to have a general counsel's office.

166:18They didn't used to have all of this corporate stuff.

166:20And then they had to create it as they got bigger

166:23and in the era where such things are,

166:27I guess, deemed necessary.

166:28- See, I believe in the power of individuals

166:30to overthrow the thing.

166:33So it's just a really good president of MIT

166:36or certain people in the administration

166:38can reform the whole thing.

166:40'Cause the culture is still there

166:43of like, I think everybody remembers

166:47that MIT is about the students and the faculty.

166:50- Do they though?

166:51Because I don't know, I've had a lot of conversations

166:54that have been shocking with like senior administration.

166:57They think the students are children.

166:59They call them kids.

167:01It's like, these are the smartest people.

167:03They're way smarter than you.

167:05And you're so dismissive of that.

167:07- But those individuals, I'm saying like the capacity,

167:11like the aura of the place still values the students

167:16and the faculty.

167:18Like I'm being awfully poetic about it.

167:21But what I mean is the administration is the froth

167:25at the top of the, like the waves, the surface.

167:30Like they can be removed and new life can be brought in

167:35that would keep to the spirit of the place.

167:38- Who decides on who to bring in?

167:40Who's higher? - It's bottom up.

167:42Oh, I see.

167:42I see.

167:45But I do think ultimately,

167:47especially in the era of social media and so on,

167:50faculty and students have more and more power.

167:55Just more and more of a voice, I suppose.

167:57- I hope so.

167:58I really do.

168:00I don't see MIT going away anytime soon.

168:02And like, I also don't think it's a terrible place at all.

168:05- Yeah, it's an amazing place.

168:07But there's different trajectories it can take.

168:09- Yeah.

168:10- And like, and that has to do with a lot of things,

168:14including,

168:14does it, is it stays,

168:20even if we talk about robotics,

168:22it could be the capital of the world in robotics.

168:25But currently, if you wanna be doing the best AI work

168:29in the world, you're gonna go to Google or Facebook

168:33or Tesla or Apple or so on.

168:37You're not gonna be, you're not gonna be at MIT.

168:40And so that has to do,

168:42I think that's basically has to do with

168:46not allowing the brilliance of the researchers to flourish.

168:52- Yeah, people say it's about money,

168:55but I don't think it's about that at all.

168:56Like, sometimes you have more freedom

169:00and can work on more interesting things in companies.

169:02That's really where they lose people.

169:05- Yeah.

169:06- And sometimes the freedom in all ways,

169:09which is why it's heartbreaking to get like

169:12people like Richard Stallman,

169:14there's such an interesting line

169:15because like Richard Stallman's a gigantic weirdo

169:18that crossed lines he shouldn't have crossed, right?

169:22But we don't wanna draw too many lines.

169:25This is the tricky thing.

169:28- There are different types of lines in my opinion.

169:30- But it's your opinion.

§20Transcript · 2:49:32–2:58:20

169:32You have strong lines you hold to,

169:34but then if administration listens to every line,

169:37there's also power in drawing a line.

169:40And it becomes like a little drug.

169:47You have to find the right balance.

169:49Licking somebody's arm is never appropriate.

169:52I think the biggest aspect there is not owning it,

169:57learning from it, growing from it

169:59from the perspective of Stallman or people like that,

170:02back when it happened, like understanding,

170:05seeing the right, being empathetic,

170:07seeing the fact that this was like totally inappropriate.

170:10Not when that particular act,

170:14but everything that led up to it too.

170:16- No, I think there are different kinds of lines.

170:19I think there are...

170:20So Stallman crossed lines that essentially

170:25excluded a bunch of people and created an environment

170:28where we, there are brilliant minds

170:30that we never got the benefit of

170:32because he made things feel gross

170:36or even unsafe for people.

170:38There are lines that you can cross

170:40where you're challenging an institution to...

170:44Like, I don't think he was intentionally

170:48trying to cross a line, or maybe he didn't care.

170:53There are lines that you can cross intentionally

170:56to move something forward or to do the right thing.

170:59Like when MIT was like,

171:00you can't put an all-gender restroom in the media lab

171:03because something permits whatever,

171:07and Joey did it anyway.

171:08That's a line you can cross

171:10to make things actually better for people.

171:11And the line you're crossing is some arbitrary, stupid rule

171:15that people who don't wanna take the risk are like...

171:18- Yeah, for sure. - You know what I mean?

171:21- No, ultimately, I think the thing you said is like,

171:24cross lines in a way that doesn't...

171:28alienate others.

171:31So like, for example, me wearing,

171:33I started for a while wearing a suit often at MIT,

171:37which sounds counterintuitive, but that's actually...

171:40People always looked at me weird for that.

171:44MIT created this culture,

171:45specifically the people I was working with.

171:47Like, nobody wore suits.

171:48Maybe the business school does.

171:49- Yeah, we don't trust the suits.

171:50- People don't trust the suits.

171:51I was like, fuck you, I'm wearing a suit.

171:53- Nice. (laughs)

171:54- But that's not really hurting anybody, right?

171:57- Exactly.

171:58It's challenging people's perceptions.

172:01It's doing something that you wanna do.

172:03- Yeah.

172:04- But it's not hurting people.

172:06- And that particular thing was, yeah, it was hurting people.

172:10It's a good line, it's a good line to...

172:12Hurting, ultimately, the people that you want to flourish.

172:20- Yeah. - Yeah.

172:21- You tweeted a picture of pumpkin spice Greek yogurt.

172:27And asked, "Grounds for divorce?

172:29"Yes, no."

172:30So let me ask you,

172:32what's the key to a successful relationship?

172:35- Oh my God, a good couple's therapist?

172:37(both laugh)

172:40- What went wrong with the pumpkin spice Greek yogurt?

172:42What's exactly wrong?

172:43Is it the pumpkin?

172:45Is it the Greek yogurt?

172:46I didn't understand.

172:46I stared at that tweet for a while.

172:48- I grew up in Europe,

172:49so I don't understand the pumpkin spice in everything craze

172:53that they do every autumn here.

172:55Like, I understand that it might be good in some foods,

172:58but they just put it in everything.

173:01- And it doesn't belong in Greek yogurt.

173:03- I mean, I was just being humorous.

173:07I ate one of those yogurts

173:08and it actually tasted pretty good.

173:09- Yeah, exactly.

173:10(Bridget laughs)

173:11- I think part of the success of a good marriage

173:14is like giving each other a hard time humorously

173:18for things like that.

173:19- Is there a broader lesson?

173:22'Cause you guys seem to have a really great marriage

173:25from the external perspective.

173:26- I mean, every marriage looks good from the external.

173:29Every, I think, yeah.

173:31(both laugh)

173:32- That's not true, but yeah, I get it.

173:35- Okay, right.

173:36(both laugh)

173:37That's not true.

173:38No, but like, relationships are hard.

173:40Relationships with anyone are hard,

173:42and especially because people evolve and change,

173:45and you have to make sure there's space

173:47for both people to evolve and change together.

173:49And I think one of the things

173:51that I really liked about our marriage vows

173:54was I remember before we got married,

173:58Greg, at some point, got kind of nervous,

174:01and he was like, "It's such a big commitment

174:04"to commit to something for life."

174:06And I was like, "We're not committing to this for life."

174:09And he was like, "We're not?"

174:11And I'm like, "No, we're committing to being part of a team

174:15"and doing what's best for the team.

174:17"If what's best for the team is to break up,

174:19"we'll break up."

174:20Like, I don't believe in this,

174:22like we have to do this for our whole lives.

174:25And that really resonated with him too, so yeah.

174:30- Did you put in the vows?

174:32- Yeah, yeah, that was our vows,

174:33like that we're gonna be a team.

174:35- You're a team and do what's right for the team?

174:37- Yeah, yeah.

174:38- That's very like Michael Jordan view.

174:42Did you guys get married in the desert,

174:47like November rain style with Slash playing?

174:50- Sure, you don't have to answer that.

174:53I'm not good at these questions.

174:55Okay.

174:56- You brought up marriage like eight times.

174:57Are you trying to hint something on the podcast?

175:01- I don't, yeah, I have an announcement to make.

175:04No, I don't know.

175:06It just seems like a good metaphor for,

175:10it felt like a good metaphor for, in a bunch of cases,

175:16for the marriage industrial complex, I remember that.

175:20And, oh, people complaining.

175:23It just seemed like marriage is one of the things

175:27that always surprises me 'cause I wanna get married.

175:30- You do?

175:31- Yeah, I do.

175:31And then I listened to like friends of mine that complain,

175:35not all, I like guys, I really like guys

175:37that don't complain about their marriage.

175:39It's such a cheap, like if, it's such a cheap release valve,

175:44like that's bitching about anything, honestly,

175:46that's just like, it's too easy.

175:48But especially, like bitch about the sports team

175:52or the weather if you want, but like about somebody

175:55that you're dedicating your life to,

175:57like if you bitch about them,

175:59you're going to see them as a lesser being also.

176:03Like you don't think so,

176:04but you're going to like decrease the value you have.

176:07I personally believe over time,

176:10you're not going to appreciate the magic of that person.

176:13I think, anyway, but it's like that I just noticed this

176:18a lot that people are married and they will whine about,

176:22you know, like the wife, whatever,

176:25it's part of the sort of the culture

176:28to kind of comment in that way.

176:30I think women do the same thing about the husband.

176:33He doesn't, he never does this or he's a goof,

176:36he's incompetent at this or that, whatever.

176:38There's a kind of--

176:39- Yeah, there's this tropes like, oh,

176:42you know, husbands never do X and like wives are,

176:45I think those do a disservice to everyone

176:48it's just disrespectful to everyone involved.

176:50- Yeah, but it happens.

176:51So I was brought that up as an example of something

176:54that people actually love, but they complain about

176:57'cause for some reason that's more fun to do

177:00is complain about stuff.

177:02And so that's what with Clippy or whatever, right?

177:05So like you complain about, but you actually love it.

177:07It's just a good metaphor that, you know,

177:10what was I going to ask you?

177:13Oh, you,

177:15your hamster died.

177:19- When I was like eight.

177:22- You miss her?

177:23- Beige.

177:25- What's the closest relationship you've had with a pet?

177:30That the one?

177:31What pet or robot have you loved the most in your life?

177:41- I think my first pet was a goldfish named Bob

177:46and he died immediately and that was really sad.

177:48I think it was really attached to Bob and Nancy,

177:53my goldfish, we got new Bobs and then Bob kept dying

177:57and we got new Bobs, Nancy just kept living.

178:00- So it was very replaceable.

178:04- Yeah, I was young.

178:07It was easy to.

178:10- Do you think there will be a time when the robot,

178:13like in the movie "Her" be something

178:15we fall in love with romantically?

178:17- Oh yeah, oh for sure, yeah.

178:20- At scale, like we're a lot of people.

§21Transcript · 2:58:22–3:03:25

178:22- Romantically, I don't know if it's going to happen at scale.

178:27I think we talked about this a little bit last time

178:30on the podcast too, where I think we're just capable

178:33of so many different kinds of relationships.

178:35And actually part of why I think marriage is so tough

178:39as a relationship is because we put so many expectations

178:43on it, like your partner has to be your best friend

178:46and you have to be sexually attracted to them

178:48and they have to be a good co-parent and a good roommate

178:51and like it's all the relationships at once

178:54that have to work.

178:55But we're like normally with other people,

178:58we have like one type of relationship

179:00or we even have, we have a different relationship

179:02to our dog than we do to our neighbor,

179:04than we do to the person, someone, a coworker.

179:09I think that some people are gonna find romantic

179:12relationships with robots interesting.

179:14It might even be a widespread thing,

179:17but I don't think it's gonna replace

179:19like human romantic relationships.

179:21I think it's just gonna be a separate type of thing.

179:24- It's gonna be more narrow.

179:27- More narrow or even like just something new

179:31that we haven't really experienced before.

179:33Maybe like having a crush on an artificial agent

179:36is a different type of fascination.

179:38I don't know.

179:39- Do you think people would see that as cheating?

179:41- I think people would, well, I mean,

179:45the things that people feel threatened by

179:47in relationships are very manifold, so.

179:50- Yeah, that's just an interesting one.

179:53'Cause maybe they'll be good, a little jealousy

179:58for the relationship.

180:00Maybe they'll be like part of the couple's therapy

180:02you know, kind of thing or whatever.

180:05- I don't think jealousy, I mean, I think

180:07it's hard to avoid jealousy, but I think

180:10the objective is probably to avoid it.

180:12I mean, some people don't even get jealous

180:13when their partner sleeps with someone else.

180:15Like there's polyamory and.

180:16I think there's just such a diversity of different ways

180:23that we can structure relationships or view them

180:26that this is just gonna be another one that we add.

180:30- You dedicate your book to your dad.

180:32What did you learn about life from your dad?

180:35- Oh man, my dad is, he's a great listener

180:40and he is the best person I know

180:45at the type of cognitive empathy

180:50that's like perspective taking.

180:53So not like emotional, like crying empathy,

180:57but trying to see someone else's point of view

181:01and trying to put yourself in their shoes.

181:03And he really instilled that in me from an early age.

181:07And then he made me read a ton of science fiction,

181:09which probably led me down this path.

181:13- Taught you how to be curious about the world

181:15and how to be open-minded.

181:17- Yeah.

181:18- Last question, what role does love play

181:21in the human condition?

181:22Since we've been talking about love and robots.

181:28And you're fascinated by social robotics.

181:32It feels like all of that operates in the landscape

181:36of something that we can call love.

181:38- Love, yeah, I think there are a lot

181:42of different kinds of love.

181:43I feel like it's, we need,

181:45I'm like, don't the Eskimos have all these different words

181:49for snow?

181:49We need more words to describe different types

181:53and kinds of love that we experience.

181:54But I think love is so important.

181:56And I also think it's not zero sum.

181:59That's the really interesting thing about love

182:02is that I had one kid and I loved my first kid

182:07more than anything else in the world.

182:08And I was like, how can I have a second kid

182:10and then love that kid also?

182:12I'm never gonna love it as much as the first.

182:15But I love them both equally.

182:16It just like, my heart expanded.

182:19And so I think that people who are threatened

182:22by love towards artificial agents,

182:27they don't need to be threatened for that reason.

182:30- Artificial agents will just, if done right,

182:33will just expand your capacity for love.

182:37- I think so.

182:38- I agree.

182:40Beautifully put.

182:41Kate, this was awesome.

182:43I still didn't talk about half the things

182:44I wanted to talk about, but we're already

182:46like way over three hours.

182:47So thank you so much.

182:48I really appreciate you talking today.

182:50You're awesome.

182:51You're an amazing human being,

182:52a great roboticist, great writer now.

182:55It's an honor that you would talk with me.

182:57Thanks for doing it.

182:58- Right back at you.

182:59Thank you.

183:00- Thanks for listening to this conversation

183:02with Kate Darling.

183:03To support this podcast, please check out

183:05our sponsors in the description.

183:07And now, let me leave you with some words

183:09from Maya Angelou.

183:11Courage is the most important of all the virtues,

183:15because without courage, you can't practice

183:17any other virtue consistently.

183:20Thank you for listening and hope to see you.

183:22Next time.

183:23(upbeat music)

183:25(upbeat music)

— 读到这里,多懂一点。 —