← Lex Fridman

Stephen Wolfram: Complexity and the Fabric of Reality

Episode 2342021-10-27English

Guests: Stephen Wolfram

Listen to this episode00:00 / 3:45:26
Reading settings
Reading preferences
Text size
Download in-depth read
Read offline

In-depth read pending

Downloads are not available yet.

§01Transcript · 00:00–08:03

00:00The following is a conversation with Stephen Wolfram,

00:02his third time on the podcast.

00:04He's a computer scientist, mathematician,

00:07theoretical physicist, and the founder of Wolfram Research,

00:11a company behind Mathematica, Wolfram Alpha,

00:14Wolfram Language, and the new Wolfram Physics Project.

00:18This conversation is a wild, technical rollercoaster ride

00:22through topics of complexity, mathematics, physics,

00:26computing, and consciousness.

00:28I think this is what this podcast is becoming, a wild ride.

00:32Some episodes are about physics, some about robots,

00:36some are about war and power,

00:38some are about the human condition

00:40and our search for meaning,

00:41and some are just what the comedian Tim Dillon calls fun.

00:46This is the Lex Friedman Podcast.

00:49To support it, please check out the sponsors

00:51in the description.

00:52And now, here's my conversation with Stephen Wolfram.

00:57Almost 20 years ago, you published "A New Kind of Science,"

01:01where you presented a study of complexity

01:04and an approach for modeling of complex systems.

01:07So, let us return again to the core idea of complexity.

01:12What is complexity?

01:15- I don't know, I think that's not

01:16the most interesting question.

01:18It's like, you know, if you ask a biologist, what is life?

01:22- Yeah.

01:22- That's not the question they care the most about.

01:25What I was interested in is how does something

01:29that we would usually identify as complexity

01:32arise in nature?

01:33And I got interested in that question like 50 years ago,

01:35which is really embarrassingly a long time ago.

01:38And, you know, I was, you know,

01:40how does snowflakes get to have complicated forms?

01:43How do galaxies get to have complicated shapes?

01:45How does, you know, how do living systems get produced?

01:48Things like that.

01:49And the question is, what's the sort of underlying

01:52scientific basis for those kinds of things?

01:54And the thing that I was at first very surprised by,

01:57'cause I've been doing physics and particle physics

02:00and fancy mathematical physics and so on.

02:02And it's like, I know all this fancy stuff.

02:04I should be able to solve this sort of basic

02:06science question.

02:07And I couldn't, this was like early,

02:10maybe 1980-ish timeframe.

02:13And it's like, okay, what can one do to understand

02:17the sort of basic secret that nature seems to have?

02:19'Cause it seems like nature, you know,

02:20you look around in the natural world,

02:22it's full of incredibly complicated forms.

02:24You look at sort of most engineered kinds of things,

02:28for instance, they tend to be, you know,

02:29we got sort of circles and lines and things like this.

02:34The question is, what secret does nature have

02:36that lets it make all this complexity

02:38that we in doing engineering, for example,

02:41don't naturally seem to have?

02:43And so that was the kind of the thing

02:44that I got interested in.

02:45And then the question was, you know,

02:47could I understand that with things

02:49like mathematical physics?

02:50Well, it didn't work very well.

02:52So then I got to thinking about, okay,

02:54is there some other way to try to understand this?

02:56And then the question was,

02:57if you're going to look at some system in nature,

03:00how do you make a model for that system,

03:02for what that system does?

03:03So, you know, a model is some abstract representation

03:05of the system, some formal representation of the system.

03:08What is the raw material

03:10that you can make that model out of?

03:12And so what I realized was, well, actually,

03:15programs are really good source of raw material

03:19for making models of things.

03:20And, you know, in terms of my personal history,

03:23the, to me, that seemed really obvious.

03:26And the reason it seemed really obvious

03:27is because I just spent several years building

03:29this big piece of software that was sort of a predecessor

03:32to Mathematica and Morphine Language,

03:34thing called SMP, Symbolic Manipulation Program,

03:37which was something that had this idea

03:39of starting from just these computational primitives

03:43and building up everything one had to build up.

03:44And so kind of the notion of, well,

03:47let's just try and make models

03:48by starting from computational primitives

03:50and seeing what we can build up.

03:51That seemed like a totally obvious thing to do.

03:54In retrospect, it might not have been externally

03:57quite so obvious, but it was obvious to me at the time,

03:59given the path that I happened to have been on.

04:02So, you know, so that got me into this question

04:04of let's use programs to model what happens in nature.

04:08And the question then is, well, what kind of programs?

04:11And, you know, we're used to programs

04:13that you write for some particular purpose

04:15and it's a big, long piece of code

04:16and it does some specific thing.

04:18But what I got interested in was, okay,

04:20if you just go out into the sort of computational universe

04:23of possible programs, you say,

04:25take the simplest program you can imagine, what does it do?

04:28And so I started studying these things

04:30called cellular automata.

04:32Actually, I didn't know at first

04:33they were called cellular automata,

04:34but I found that out subsequently.

04:37But it's just a line of cells, you know,

04:38each one is black or white,

04:40and it's just some rule that says the color of the cell

04:43is determined by the color that it had on the previous step

04:45and its two neighbors on the previous step.

04:48And I had initially thought that, you know,

04:51sufficiently simple setup

04:53is not gonna do anything interesting.

04:55It's always gonna be simple, no complexity,

04:57simple rule, simple behavior.

04:59Okay, but then I actually ran the computer experiment,

05:02which is pretty easy to do.

05:04I mean, it probably took a few hours originally.

05:07And the results were not what I'd expected at all.

05:11Now, needless to say,

05:12in the way that science actually works,

05:14the results that I got had a lot of unexpected things

05:17which I thought were really interesting,

05:18but the really strongest result,

05:20which was already right there in the printouts I made,

05:23I didn't really understand for a couple more years.

05:25So it was not, you know,

05:27the compressed version of the story is

05:30you run the experiment

05:31and you immediately see what's going on,

05:33but I wasn't smart enough to do that, so to speak.

05:36But the big thing is,

05:38even with very simple rules of that type,

05:41sort of the minimal, tiniest program,

05:43sort of the one line program or something,

05:46it's possible to get very complicated behavior.

05:49My favorite example is this thing called rule 30,

05:52which is a particular cellular automaton rule.

05:54You just start it off from one black cell

05:56and it makes this really complicated pattern.

05:58And so that, for me, was sort of a critical discovery

06:03that then kind of said, playing back onto, you know,

06:07how does nature make complexity?

06:09I sort of realized that might be how it does it.

06:12That might be kind of the secret that it's using

06:14is that in this kind of computational universe

06:16of possible programs,

06:18it's actually pretty easy to get programs

06:20where even though the program is simple,

06:22the behavior when you run the program is not simple at all.

06:25And that was, so for me,

06:26that was the kind of the story of kind of how,

06:31that was sort of the indication that one had got an idea

06:34of what the sort of secret that nature uses

06:36to make complexity

06:38and how complexity can be made in other places.

06:41Now, if you say, what is complexity?

06:44You know, it's, complexity is,

06:47it's not easy to tell what's going on.

06:49That's the informal version of what is complexity.

06:53- But there is something going on.

06:55- But there's a rule. - But it's not easy

06:56to know what. - Right.

06:57- Well, no, the rules can generate just randomness, right?

07:01- Well, that's not obvious.

07:03In other words-- - That's not obvious,

07:04that's right. - It's not obvious at all.

07:06And it wasn't what I expected.

07:07It's not what people's intuition had been

07:10and has been for, you know, for a long time.

07:13That is, one might think you have a rule,

07:15you can tell there's a rule behind it.

07:18I mean, it's just like, you know,

07:19the early, you know, robots in science fiction movies,

07:23right, you can tell it's a robot

07:24'cause it does simple things, right?

07:27Turns out that isn't actually the right story,

07:30but it's not obvious that isn't the right story

07:32'cause people assume simple rules, simple behavior.

07:35And that, the sort of the key discovery

07:37about the computational universe is that isn't true.

07:40And that discovery goes very deep

07:42and relates to all kinds of things

07:45that I've spent years and years studying.

07:47But, you know, in the end,

07:49the sort of the what is complexity is,

07:52well, you can't easily tell what it's going to do.

07:55You could just run the rule and see what happens,

07:57but you can't just say, oh, you know, show me the rule.

08:01Great, now I know what's gonna happen.

08:03And, you know, the key phenomenon around that

§02Transcript · 08:05–16:19

08:05is this thing I call computational irreducibility.

08:08This fact that in something like rule 30,

08:12you might say, well, what's it gonna do

08:13after a million steps?

08:15Well, you can run it for a million steps

08:17and just do what it does to find out,

08:19but you can't compress that, you can't reduce that

08:22and say, I'm gonna be able to jump ahead and say,

08:25this is what it's gonna do after a million steps,

08:26but I don't have to go through anything

08:27like that computational effort.

08:29- By the way, has anybody succeeded at that?

08:31Do you had to challenge a competition

08:33for predicting the middle column of rule 30?

08:36- Indeed.

08:37- Anybody?

08:38- A number of people have sent things in

08:39and sort of people are picking away at it,

08:41but it's hard.

08:42I mean, I've been actually even proving

08:47that the center column of rule 30 doesn't repeat.

08:51That's something I think might be doable, okay?

08:54- Mathematically proving.

08:55- Yes, and so that's analogous to a similar kind of thing

08:59is like the digits of pi,

09:01which are also generated in this very deterministic way.

09:04And so a question is how random are the digits of pi?

09:06For example, does every, first of all,

09:09do the digits of pi ever repeat?

09:10Well, we know they don't.

09:11This was proved in the 1800s

09:13that pi is not a rational number.

09:15So that means only rational numbers

09:17have digit sequences that repeat.

09:19So we know the digits of pi don't repeat.

09:21So now the question is, does, you know,

09:23zero, one, two, three, or whatever,

09:25do all the digits base 10 or base two,

09:27or however you work it out,

09:28do they all occur with equal frequency?

09:30Nobody knows.

09:32That's far away from what can be understood mathematically

09:35at this point.

09:36And that's kind of, but I'm even looking for step one,

09:41which is prove that the center column doesn't repeat

09:45and then prove other things about it,

09:46like equidistribution of equal numbers of zeros and ones.

09:50And those are things which I, you know,

09:52I kind of set up this little prize thing

09:54because I thought those were not too out of range.

09:58Those are things which are within, you know,

10:02a modest amount of time,

10:04it's conceivable that those could be done.

10:05They're not far away from what current mathematics

10:09might allow.

10:10They'll require a bunch of cleverness

10:11and hopefully some interesting new ideas

10:14that, you know, will be useful other places.

10:16- But you started in 1980 with this idea

10:18before I think you realized, you know,

10:22this idea of programs.

10:24You thought that there might be some kind of

10:26thermodynamic like randomness,

10:28and then the complexity comes from a clever filter

10:32that you kind of, like, I don't know,

10:35spaghetti or something.

10:36You filter the randomness and outcomes complexity,

10:40which is an interesting intuition.

10:42How do we know that's not actually what's happening?

10:44So just because you were then able to develop,

10:49look, you don't need this like incredible randomness.

10:52You can just have very simple, predictable,

10:55initial conditions and predictable rules.

10:58And then from that emerged complexity.

11:00Still, there might be some systems

11:02where it's filtering randomness in the inputs.

11:07- Well, the point is, when you have quotes

11:10randomness in the input,

11:12that means there's all kinds of information in the input.

11:14And in a sense, what you get out

11:16will be maybe just something close to what you put in.

11:20Like people are very, in dynamical systems theory,

11:23sort of big area of mathematics that developed

11:25from the early 1900s and really got big in the 1980s.

11:29You know, an example of what people study there a lot,

11:32and it's popular version is chaos theory.

11:35And an example of what people study a lot

11:37is the shift map, which is basically taking 2X mod one,

11:42the fractional part of 2X,

11:44which is basically just taking digits in binary

11:47and shifting them to the left.

11:48So at every step, you get to see,

11:50if you say, how big is this number that I got out?

11:53Well, the most important digit in that number

11:55is whatever ended up at the left-hand end.

11:58But now if you start off from an arbitrary random number,

12:01which is quotes randomly chosen,

12:03so all its digits are random,

12:05then when you run that sort of chaos theory shift map,

12:09all that you get out is just whatever you put in.

12:12You just get to see what you,

12:14it's not obvious that you would excavate

12:16all of those digits.

12:17And if you're, for example, making a theory,

12:19I don't know, fluid mechanics, for example,

12:21if there was that phenomenon in fluid mechanics,

12:24then the equations of fluid mechanics can't be right.

12:27Because what that would be saying is,

12:29the equations of that it matters to the fluid,

12:32what happens in the fluid at the level of the,

12:34you know, millionth digit of the initial conditions,

12:38which is far below the point at which you're hitting

12:40kind of sizes of molecules and things like that.

12:42So it's kind of almost explaining,

12:45if that phenomenon is an important thing,

12:47it's kind of telling you that the, you know,

12:49fluid dynamics, which describes fluids as continuous media

12:52and so on, isn't really right.

12:54But so, you know, so this idea that, you know,

12:57there's a, it's a tricky thing,

12:59because as soon as you put randomness in,

13:01you have to know, you know, what,

13:03how much of what's coming out is what you put in,

13:06versus how much is actually something

13:07that's being generated.

13:08And what's really nice about these systems

13:10where you just have very simple initial conditions,

13:13and where you get random stuff out,

13:15or seemingly random stuff out,

13:17is you don't have that issue.

13:18You don't have to argue about,

13:20was there something complicated put in?

13:22Because it's plainly obvious there wasn't.

13:24Now, as a practical matter in doing experiments,

13:26the big thing is, if the thing you see

13:30is complex and reproducible,

13:32then it didn't come from just filtering some,

13:35quotes, "randomness from the outside world."

13:37It has to be something that is intrinsically made,

13:40because it wouldn't otherwise be, I mean, you know,

13:44it could be the case that you set things up,

13:45and it's always the same each time,

13:47and you say, well, it's kind of the same,

13:50but it's not random each time,

13:52because it's kind of the definition of it being random,

13:54is it was kind of picked at random each time, so to speak.

13:58- So is it possible to for sure know

14:01that our universe does not,

14:02at the fundamental level, have randomness?

14:06Is it possible to conclusively say,

14:08there's no randomness at the bottom?

14:11- Well, it's an interesting question.

14:13I mean, you know, science, natural science,

14:15is an inductive business, right?

14:17You observe a bunch of things, and you say,

14:20can we fit these together?

14:21What is our hypothesis for what's going on?

14:24The thing that I think I can say fairly definitively

14:27is at this point, we understand enough

14:29about fundamental physics that there is,

14:33if there was sort of an extra dice being thrown,

14:37it's something that doesn't need to be there.

14:39We can get what we see without that.

14:42Now, you know, could you add that in

14:45as an extra little featureoid, you know,

14:48without breaking the universe?

14:50Probably, but in fact, almost certainly yes.

14:54But is it necessary for understanding the universe?

14:56No, and I think actually from a more fundamental

14:59point of view, it's, I think I might be able to argue.

15:04So one of the things that I've been interested in,

15:06I've been pretty surprised that I've had anything

15:08sentient to say about, is the question of,

15:11why does the universe exist?

15:13I didn't think that was a question that I would,

15:15you know, I thought that was a far out there

15:17metaphysical kind of thing.

15:20Even the philosophers have stayed away

15:22from that question for the most part.

15:23It's so such a kind of, you know,

15:26difficult to address question.

15:28But I actually think to my great surprise

15:30that from our physics project and so on,

15:32that it is possible to actually address that question

15:36and explain why the universe exists.

15:38And I kind of have a suspicion, I've not thought it through.

15:41I kind of have a suspicion that that explanation

15:43will eventually show you that in no meaningful sense,

15:47can there be randomness underneath the universe?

15:50That is that if there is, it's something

15:52that is necessarily irrelevant

15:55to our perception of the universe.

15:57That is that it could be there, but it doesn't matter.

16:01Because in a sense, we've already, you know,

16:03whatever it would do, whatever extra thing it would add

16:06is not relevant to our perception of what's going on.

16:09- So why does the universe exist?

16:12How does the irrelevance of randomness

16:15connect to the big why question of the universe?

16:19- So, okay, so I mean, why does the universe exist?

§03Transcript · 16:22–24:06

16:22Well, let's see.

16:23- And is this the only universe we got?

16:25- It's the only one.

16:27About that, I'm pretty sure.

16:28- So you may be, which one,

16:30which of these topics is better to enter first?

16:33Why does the universe exist?

16:36And why you think it's the only one that exists?

16:39- Well, I think they're very closely related.

16:41- Okay. - Okay?

16:42So I mean, the first thing, let's see.

16:45I mean, this why does the universe exist question

16:47is built on top of all these things

16:50that we've been figuring out about fundamental physics.

16:53'Cause if you wanna know why the universe exists,

16:55you kind of have to know what the universe is made of.

16:57And I think the, well, let me describe a little bit

17:02about the why does the universe exist question.

17:05So the main issue is,

17:06let's say you have a model for the universe.

17:08And you say, I've got this program or something,

17:11and you run it and you make the universe.

17:13Now you say, well, how do you actually,

17:15why is that program actually running?

17:17And people say, you've got this program

17:19that makes the universe, what computer is it running on?

17:22Right?

17:22What does it mean?

17:23What actualizes something?

17:25You know, two plus two equals four,

17:27but that's different from saying there's two,

17:29a pile of two rocks, another pile of two rocks,

17:31and somebody moves them together and makes four,

17:33so to speak.

17:34And so what is it that kind of turns it

17:37from being just this formal thing

17:39to being something that is actualized?

17:42Okay, so there we have to start thinking about,

17:44well, what do we actually know

17:47about what's going on in the universe?

17:48Well, we are observers of this universe,

17:51but confusingly enough, we're part of this universe.

17:54So in a sense, if we say,

17:57what do we know about what's going on in the universe?

18:00Well, what we know is what sort of our consciousness records

18:04about what's going on in the universe.

18:06- And consciousness is part of the fabric of the universe,

18:09so we're in it.

18:10- Yes, we're in it.

18:11And maybe I should start off

18:13by saying something about the consciousness story,

18:16because that's--

18:18- Yes, maybe we should begin even before that,

18:22at the very base layer of the Wolfram Physics Project.

18:26Maybe you can give a broad overview, once again,

18:30really quick about this hypergraph model.

18:33- Yes. - And also,

18:34what is it, a year and a half ago,

18:36since you've brought this project to the world,

18:39what is the status update?

18:41What are all the beautiful ideas you have come across?

18:45What are the interesting things you can sort of mention?

18:48- I mean, it's a frigging Cambrian explosion.

18:51I mean, it's crazy.

18:53I mean, there are all these things,

18:54which I've kind of wondered about for years,

18:57and suddenly, there's actually a way to think about them.

19:00And I really did not see,

19:02I mean, the real strength of what's happened,

19:04I absolutely did not see coming.

19:06And the real strength of it is,

19:08we've got this model for physics,

19:09but it turns out it's a foundational kind of model

19:12that's a different kind of computation-like model,

19:15that I'm kind of calling the sort of

19:16multi-computational model.

19:19And that that kind of model is applicable,

19:22not only to physics,

19:23but also to lots of other kinds of things.

19:26And one reason that's extremely powerful

19:28is because physics has been very successful.

19:30So we know a lot, based on what we figured out in physics.

19:33And if we know that the same model governs physics,

19:37and governs, I don't know, economics,

19:38linguistics, immunology, whatever,

19:41we know that the same kind of model governs those things,

19:44we can start using things

19:45that we've successfully discovered in physics,

19:47and applying those intuitions in all these other areas.

19:50And that's pretty exciting, and very surprising to me.

19:54And in fact, it's kind of like,

19:56in the original story of, sort of,

19:58you go and you explain why is there complexity

20:01in the natural world,

20:02then you realize, well, there's all this complexity,

20:04there's all this computational irreducibility,

20:07you know, there's a lot we can't know

20:08about what's going to happen.

20:09It's kind of a very confusing thing for people who say,

20:12you know, science has nailed everything down,

20:14we're gonna, you know,

20:15based on science, we can know everything.

20:17Well, actually, there's this computational irreducibility

20:19thing right in the middle of that,

20:21thrown up by science, so to speak.

20:24And then the question is,

20:25well, given computational irreducibility,

20:27how can we actually figure out anything

20:28about what happens in the world?

20:30Why aren't we, why are we able to predict anything?

20:32Why are we able to sort of operate in the world?

20:34And the answer is that we sort of live

20:36in these slices of computational reusability

20:39that exist in this kind of ocean

20:41of computational irreducibility.

20:43And it turns out that it seems

20:45that it's a very fundamental feature

20:46of the kind of model that seems to operate in physics

20:50and perhaps in a lot of these other areas,

20:53that there are these particular slices

20:55of computational reducibility that are relevant to us.

20:59And those are the things that both allow us

21:02to operate in the world

21:03and not just have everything be completely unpredictable,

21:06but they're also things that potentially give us

21:09what amount to sort of physics-like laws

21:11in all these other areas.

21:13So that's been sort of an exciting thing,

21:15but I would say that in general for our project,

21:18it's been going spectacularly well.

21:20I mean, you know, it's very, honestly,

21:22it wasn't something I expected to happen in my lifetime.

21:26I mean, it's, you know, it's something where it's,

21:29and in fact, one of the things about it,

21:32some of the things that we've discovered

21:34are things where I was pretty sure

21:36that wasn't how things worked and turns out I'm wrong.

21:40And, you know, in a major area in meta-mathematics,

21:43I'd be realizing that something I've long believed,

21:46we can talk about it later,

21:47that just really isn't right.

21:50But I think that the thing that,

21:55so what's happened with the physics project,

21:56I mean, you know, it's a,

21:59it can explain a little bit about how the model works,

22:01but basically--

22:02- We can maybe ask you the following question.

22:05So it's easy through words

22:07to describe how cellular automata works.

22:09You've explained this.

22:11And it's the fundamental mechanism

22:15by which you, in your book,

22:17a new kind of science,

22:18explored the idea of complexity

22:20and how to do science in this world

22:22of reducible islands and irreducible,

22:26generally irreducibility.

22:28Okay, so how does the model of hypergraphs

22:32differ from cellular automata?

22:33And how does the idea of multi-computation differ?

22:36Like maybe that's a way to describe it.

22:39- Right, we're, yeah, right.

22:40This is a, you know, my life is,

22:43like all of our lives,

22:44something of a story of computational irreducibility.

22:47And, you know, it's been going for a few years now.

22:49So it's always a challenge

22:51to kind of find these appropriate pockets of reducibility.

22:54But let me see what I can do.

22:56So, I mean, first of all,

22:58let's talk about physics, first of all.

23:01And, you know, a key observation,

23:04the starting point of our physics project

23:06is things about what is space?

23:10What is the universe made of?

23:11And, you know, ever since Euclid,

23:13people just sort of say space is just this thing

23:16where you can put things at any position you want.

23:18And they're just points,

23:19and they're just geometrical things

23:21that you can just arbitrarily put

23:23at different coordinate positions.

23:25Sort of the first thing in our physics project

23:28is the idea that space is made of something.

23:30Just like water is made of molecules,

23:32space is made of kind of atoms of space.

23:35And the only thing we can say about these atoms of space

23:37is they have some identity.

23:39It's this atom as opposed to this atom.

23:43And, you know, you could give them,

23:44if you were a computer person,

23:45you'd give them UUIDs or something.

23:46(Luke laughs)

23:48- Yes.

23:49- And that's all there is to say about them, so to speak.

23:53And then all we know about these atoms of space

23:58is how they relate to each other.

24:00So we say these three atoms of space

24:03are associated with each other in some relation.

24:06So you can think about that as, you know,

§04Transcript · 24:08–32:19

24:08what atom of space is friends

24:10with what other atom of space?

24:12You can build this essentially friend network

24:14of the atoms of space.

24:15And the sort of starting point of our physics project

24:18is that's what our universe is.

24:20It's a giant friend network of the atoms of space.

24:23And so how can that possibly represent our universe?

24:27Well, it's like in something like water,

24:30you know, there are molecules bouncing around,

24:32but on a large scale, that produces fluid flow

24:36and we have fluid vortices

24:37and we have all of these phenomena

24:39that are sort of the emergent phenomena

24:41from that underlying kind of collection of molecules

24:45bouncing around.

24:46And by the way, it's important

24:47that that collection of molecules bouncing around

24:49have this phenomenon of computational irreducibility.

24:51That's actually what leads

24:53to the second law of thermodynamics among other things.

24:55And that leads to the sort of randomness

24:58of the underlying behavior,

24:59which is what gives you something,

25:01which on a large scale

25:03seems like it's a smooth, continuous type of thing.

25:07And so, okay, so first thing is space is made of something.

25:11It's made of all these atoms of space

25:13connected together in this network.

25:15And then everything that we experience

25:18is sort of features of that structure of space.

25:21So, you know, when we have an electron or something

25:23or a photon, it's some kind of tangle

25:26in the structure of space,

25:27much like kind of a vortex in a fluid

25:29would be just this thing that is, you know,

25:31it can actually, the vortex can move around,

25:34it can involve different molecules in the fluid,

25:37but the vortex still stays there.

25:38- And if you zoom out enough,

25:40the vortex looks like an atom itself,

25:42like a basic element.

25:43- Yes.

25:44- So there's the levels of abstraction.

25:46If you squint and kind of blur things out,

25:49it looks like at every level of abstraction,

25:52you can define what is a basic individual entity.

25:55- Yes, but, you know, in this model,

25:58there's a bottom level.

26:00- Yeah.

26:00- You know, there's an elementary length,

26:01maybe 10 to the minus 100 meters, let's say,

26:04which is really small, you know,

26:05a proton is 10 to the minus 15 meters.

26:08The smallest we've ever been able to sort of see

26:11with a particle accelerator

26:12is around 10 to the minus 21 meters.

26:14So, you know, if we don't know precisely

26:17what the correct scale is,

26:18but it's perhaps over the order of 10 to the minus 100 meters

26:21so it's pretty small.

26:22And, but that's the end, that's what things are made of.

26:27- What's your intuition

26:28where the 10 to the minus 100 comes from?

26:31What's your intuition about this scale?

26:33- Well, okay, so there's a calculation

26:35which I consider to be somewhat rickety, okay?

26:37Which has to do with comparing,

26:40so there are various fundamental constants.

26:42There's the speed of light,

26:44the speed of light, once you know the elementary time,

26:47the speed of light tells you the conversion

26:49from the elementary time to the elementary length.

26:52Then there's the question of how do you convert

26:54to the elementary energy?

26:55And how do you convert to, between other things?

26:58And the various constants we know,

27:00we know the speed of light,

27:01we know the gravitational constant,

27:03we know Planck's constant in quantum mechanics,

27:05those are the three important ones.

27:07And we actually know some other things,

27:09we know things like the size of the universe,

27:11the Hubble constant, things like that.

27:14And essentially this calculation of the elementary length

27:17comes from looking at the sort of combination of those,

27:21okay, so the most obvious thing,

27:23people have sort of assumed that quantum gravity

27:25happens at this thing, the Planck scale,

27:2710 to the minus 34 meters,

27:28which is the sort of the combination of Planck's constant

27:32and the gravitational constant, the speed of light,

27:34that gives you that kind of length.

27:36Turns out in our model, there is an additional parameter,

27:41which is essentially the number of simultaneous threads

27:44of execution of the universe,

27:46which is essentially the number of sort of

27:47independent quantum processes that are going on.

27:51And that number, let's see if I remember that number,

27:53that number is 10 to the 170, I think,

27:55and so it's a big number,

27:57but that number then connects,

28:01sort of modifies what you might think

28:04from all these Planck units

28:07to give you the things we're giving.

28:08And there's been sort of a mystery actually,

28:10and there's a more technical physics thing,

28:12that the Planck mass, the Planck energy,

28:16Planck energy is actually surprisingly big.

28:19The Planck length is tiny, 10 to the minus 34 meters,

28:21the Planck time, 10 to the minus 43 meters, I think,

28:24that seconds, I think,

28:26but the Planck energy is like the energy

28:30of a lightning strike, okay, which is pretty weird.

28:33In our models, the actual elementary energy

28:36is that divided by the number of sort of

28:38simultaneous quantum threads,

28:40and it ends up being really small too.

28:42And that sort of explains that mystery

28:44that's been around for a while

28:46about how Planck units work.

28:49But whether that precise estimate is right,

28:52we don't know yet.

28:53I mean, that's one of the things

28:54that's sort of been a thing we've been pretty interested in

28:57is how do you see through,

28:59how do you make a gravitational microscope

29:02that can kind of see through to the atoms of space?

29:05You know, how do you get, in fluid flow, for example,

29:08if you go to hypersonic flow or something,

29:10you know, you've got a Mark 20,

29:12you know, space plane or something,

29:13it really matters that there are individual molecules

29:16hitting the space plane, not a continuous fluid.

29:19The question is, what is the analogous kind of,

29:22what is the analog of hypersonic flow

29:24for things about the structure of space-time?

29:28And it looks like a rapidly rotating black hole, right,

29:33at the sort of critical rotation rate,

29:38it looks as if that's a case where essentially

29:40the structure of space-time is just about to fall apart.

29:44And you may be able to kind of see the evidence

29:48of sort of discrete elements, you know,

29:52you may be able to kind of see there

29:54the sort of gravitational microscope

29:55of actually seeing these discrete elements of space.

29:58And there may be some effect in, for example,

30:01gravitational waves produced by rapidly rotating black hole

30:05that in which one could actually see some phenomenon

30:08where one can say, yes,

30:09these don't come out the way one would expect

30:12based on having a continuous structure of space-time,

30:15that is it something where you can kind of see through

30:18to the discrete structure?

30:20We don't know that yet.

30:20- So can you maybe elaborate a little bit deeper

30:23how a microscope that can see to 10 to the minus 100,

30:28how rotating black holes and presumably

30:32the detailed accurate detection of gravitational waves

30:37from such black holes can reveal the discreteness of space?

30:42- Okay, first thing is what is a black hole?

30:44Actually, we need to go a little bit further

30:47in the story of what space-time is

30:48'cause I explained a little bit about what space is,

30:50but I didn't talk about what time is.

30:52And that's sort of important

30:53in understanding space-time, so to speak.

30:56- And your sense is both space and time

30:58in the story are discrete.

31:00- Absolutely, absolutely.

31:01But it's a complicated story.

31:03And needless to say.

31:05- Well, it's simple at the bottom.

31:07- It's very simple at the bottom.

31:09It's very, in the end, it's simple but deeply abstract.

31:13And something that is simple in conception,

31:18but kind of wrapping one's head around what's going on

31:21is pretty hard.

31:22But so first of all, we have this,

31:25so I've described these kind of atoms of space

31:27and their connections.

31:29You can think about these things as a hypergraph,

31:31a graph is just, you connect nodes to nodes,

31:34but a hypergraph, you can have sort of not just friends,

31:38individual friends to friends,

31:40but you can have these triplets of friends or whatever else.

31:43And so we're just saying,

31:45and that's just the relations between atoms of space

31:48are the hyper edges of the hypergraph.

31:50And so we got some big collection of these atoms of space,

31:54maybe 10 to the 400 or something in our universe.

31:57And that's the structure of space.

32:00That's an every feature of what we experience in the world

32:04is a feature of that hypergraph, that spatial hypergraph.

32:09So then the question is,

32:09well, what does that spatial hypergraph do?

32:13Well, the idea is that there are rules

32:15that update that spatial hypergraph.

32:18And in a cellular automaton,

32:19you've just got this line of cells

§05Transcript · 32:21–40:39

32:21and you just say at every step, at every time step,

32:24you've got fixed time steps, fixed array of cells.

32:27At every step, every cell gets updated

32:29according to a certain rule.

32:31And that's kind of the, that's the way it works.

32:34Now in this hypergraph,

32:35it's sort of vaguely the same kind of thing.

32:38We say, every time you see a little piece of hypergraph

32:41that looks like this, update it to one that looks like this.

32:45So it's just keep rewriting this hypergraph.

32:47Every time you see something that looks like that,

32:49anywhere in the universe, it gets rewritten.

32:52Now, one thing that's tricky about that,

32:53which we'll come to is this multi-computational idea,

32:56which has to do with, you're not saying

32:59in some kind of lockstep way,

33:01do this one, then this one, then this one.

33:03It's just whenever you see one you can do,

33:05you can go ahead and do it.

33:07And that leads one not to have a single thread of time

33:10in the universe.

33:11Because if you knew which one to do,

33:13you just say, okay, we do this one,

33:15then we do this one, then we do this one.

33:16But if you say, just do whichever one you feel like,

33:19you end up with these multiple threads of time,

33:21these kind of multiple histories of the universe,

33:23depending on which order you happen to do

33:24the things you could do in.

33:27- So it's fundamentally asynchronous and parallel.

33:29- Yes, yes.

33:31- Which is very uncomfortable for the human brain

33:33that seeks for things to be sequential and synchronous.

33:37- Right, well, I think that this is part

33:40of the story of consciousness,

33:42is I think the key aspect of consciousness

33:45that is important for parsing the universe

33:48is this point that we have a single thread of experience.

33:52We have a memory of what happened in the past,

33:54we can say something, predict something about the future,

33:57but there's a single thread of experience.

33:58And it's not obvious it should work that way.

34:00I mean, we've got 100 billion neurons in our brains

34:02and they're all firing at all kinds of different ways,

34:04but yet our experience is that there is the single thread

34:09of time that goes along.

34:12And I think that one of the things I've kind of realized

34:15with a lot more clarity in the last year

34:17is the fact that we conclude that the universe

34:21has the laws it has as a consequence of the fact

34:24that we have consciousness the way we have consciousness.

34:28And so the fact, so I mean, just to go on

34:31with kind of the basic setup,

34:33it's so we've got this spatial hypergraph,

34:35it's got all these atoms of space,

34:37they're getting these little clumps of atoms of space

34:40are getting turned into other clumps of atoms of space,

34:41and that's happening everywhere in the universe all the time.

34:44And so one thing that's a little bit weird

34:46is there's nothing permanent in the universe.

34:48The universe is getting rewritten everywhere all the time.

34:51And if it wasn't getting rewritten,

34:52space wouldn't be knitted together.

34:54That is space would just fall apart.

34:56There wouldn't be any way in which we could say

34:58this part of space is next to this part of space.

35:01You know, one of the things that I was,

35:03people were confused about back in antiquity,

35:06the ancient Greek philosophers and so on,

35:08is how does motion work?

35:10You know, how can it be the case that you can take a thing

35:13that we can walk around and it's still us

35:15when we walked a foot forward, so to speak.

35:18And in a sense with our models, that's again a question

35:22because it's a different set of atoms of space.

35:24When I move my hand,

35:27it's moving into a different set of atoms of space.

35:30It's having to be recreated.

35:31It's not the thing itself is not there.

35:34It's being continuously recreated all the time.

35:37Now it's a little bit like waves in an ocean,

35:39you know, vortices in a fluid,

35:40which again, the actual molecules that exist in those

35:44are not what define the identity of the thing.

35:47But it's a little bit, you know,

35:49this idea that there can be pure motion,

35:52that it is even possible for an object

35:55to just move around in the universe and not change.

35:58It's not self-evident that such a thing should be possible.

36:01And that is part of our perception of the universe

36:04is that we parse those aspects of the universe

36:07where things like pure motion are possible.

36:10Now, pure motion, even in general relativity,

36:12the theory of gravity,

36:14pure motion is a little bit of a complicated thing.

36:16I mean, if you imagine your average, you know,

36:19teacup or something approaching a black hole,

36:21it is deformed and distorted by the structure of space time.

36:25And to say, you know, is it really pure motion?

36:27Is it that same teacup that's the same shape?

36:29Well, it's a bit of a complicated story.

36:32And this is a more extreme version of that.

36:34So anyway, the thing that's happening is we've got space,

36:38we've got this notion of time.

36:41So time is this kind of this rewriting of the hypergraph.

36:45And one of the things that's important about that,

36:46time is this sort of computational irreducible process.

36:50There's something, you know, time is not something where,

36:53in kind of the mathematical view of time,

36:56tends to be time is just a coordinate.

36:57We can, you know, slide a slider, turn a knob,

37:01and we'll change the time that we've got in this equation.

37:04But in this picture of time, that's not how it works at all.

37:08Time is this inexorable, irreducible

37:11kind of set of computations that go on,

37:13that go from where we are now to the future.

37:16But so the thing, and one of the things that is, again,

37:20something one sort of has to break out of

37:22is your average trained physicist like me says,

37:25you know, space and time are the same kind of thing.

37:27They're related by, you know, the Poincaré group

37:30and Lorentz transformations and relativity

37:32and all these kinds of things.

37:34And, you know, space and time, you know,

37:37there are all these kind of sort of folk stories

37:38you can tell about why space and time

37:40are the same kind of thing.

37:42In this model, they're fundamentally

37:43not the same kind of thing.

37:44Space is this kind of sort of connections

37:47between these atoms of space.

37:49Time is this computational process.

37:51So the thing that the first sort of surprising thing

37:54is, well, it turns out you get relativity anyway.

37:57And the reason that happens,

37:58there are a few bits and pieces here,

38:00which one has to understand,

38:01but the fundamental point is,

38:04if you are an observer embedded in the system

38:08that are part of this whole story

38:10of things getting updated in this way and that,

38:13there's sort of a limit to what you can tell

38:15about what's going on.

38:17And really in the end, the only thing you can tell

38:19is what are the causal relationships between events.

38:23So an event in this sort of,

38:25an elementary event is a little piece of hypergraph

38:29got rewritten.

38:30And that means a few hyper edges of the hypergraph

38:32were consumed by the event

38:34and you produce some other hyper edges.

38:36And that's an elementary event.

38:38And so then the question is what we can tell

38:42is kind of what the network of causal relationships

38:45between elementary events is.

38:47That's the ultimate thing, the causal graph of the universe.

38:50And it turns out that,

38:52well, there's this property of causal invariance

38:55that is true of a bunch of these models.

38:57And I think is inevitably true for a variety of reasons

39:01that makes it be the case that it doesn't matter

39:05kind of if you are sort of saying,

39:07well, I've got this hypergraph

39:09and I can rewrite this piece here and this piece here

39:11and I do them all in different orders.

39:13When you construct the causal graph

39:15for each of those orders that you choose to do things in,

39:19you'll end up with the same causal graph.

39:21And so that's essentially why,

39:24well, that's in the end why relativity works.

39:27It's why our perception of space and time

39:29is as having this kind of connection

39:32that relativity says they should have.

39:35And that's kind of how that works.

39:37- I think I'm missing a little piece.

39:39If we can go there again,

39:41you said the fact that the observer is embedded

39:44in this hypergraph, what's missing?

39:47What is the observer not able to state

39:50about this universe of space and time?

39:52- So if you look from the outside,

39:54you can say, oh, I see this particular place was updated

39:59and then this one was updated

40:04and I'm seeing which order things were updated in.

40:07But the observer embedded in the universe

40:08doesn't know which order things were updated in

40:10because until they've been updated,

40:13they have no idea what else happened.

40:14So the only thing they know

40:16is the set of causal relationships.

40:18Let me give an extreme example.

40:20Let's imagine that the universe is a Turing machine.

40:23Turing machines have just this one update head,

40:26which does something

40:27and otherwise the Turing machine just does nothing.

40:30And the Turing machine works by having this head

40:32move around and do its updating,

40:35just where the head happens to be.

40:37The question is, could the universe be a Turing machine?

40:39Could the universe just have a single updating head

§06Transcript · 40:42–48:59

40:42that's just zipping around all over the place?

40:44You say, that's crazy because I'm talking to you,

40:47you seem to be updating, I'm updating, et cetera.

40:50But the thing is, there's no way to know that

40:52because if there was just this head moving around,

40:54it's like, okay, it updates me,

40:56but you're completely frozen at that point.

40:59Until the head has come over and updated you,

41:01you have no idea what happened to me.

41:03And so if you sort of unravel that argument,

41:05you realize the only thing we actually can tell

41:08is what the network of causal relationships

41:11between the things that happened were.

41:13We don't get to know from some sort of outside

41:16sort of God's eye view of the thing.

41:18We don't get to know what sort of

41:21from the outside what happened.

41:23We only get to know sort of what the set of relationships

41:27between the things that happened actually were.

41:29- Yeah, but if I somehow record like a trace

41:33of this, I guess would be called multi-computation,

41:37can't I then look back in the-

41:40- Where do you record the trace?

41:42- Some, you place throughout the universe,

41:45like throughout like a log that records

41:49in my own pocket in this hypergraph,

41:52can't I like realizing that I'm getting an outdated picture,

41:57can't I record-

41:59- See, the problem is,

42:00and this is where things start getting very entangled

42:04in terms of what one understands.

42:06The problem is that any such recording device

42:09is itself part of the universe.

42:11So you don't get to say, you never get to say,

42:14let's go outside the universe and go do this.

42:17And that's why, I mean, lots of the features of this model

42:21and the way things work end up being a result of that.

42:24- So, but what, I guess from on a human level,

42:27what is the cost you're paying?

42:30What are you missing from not getting

42:32an updated picture all the time?

42:34Okay, I understand what you're just saying.

42:36- Yeah, yeah, right.

42:36- But like what, like how does consciousness

42:38emerge from that?

42:40Like how, like what are the limitations of that observer?

42:44I understand you're getting a delayed picture.

42:46- Well, there's a, okay,

42:47so there's a bunch of limitations of the observer, I think.

42:51Maybe just explain something about quantum mechanics,

42:53'cause that maybe is an extreme version

42:55of some of these issues,

42:57which helps to kind of motivate

42:59why one should sort of think things through

43:00a little bit more carefully.

43:02So one feature of this, okay,

43:05so in standard physics, like high school physics,

43:09you learn the equations of motion for a ball.

43:12And it says, you throw the ball this angle, this velocity,

43:16things will move in this way,

43:18and there's a definite answer, right?

43:20The story, the key story of quantum mechanics

43:22is there aren't definite answers to where does the ball go?

43:25There's kind of this whole sort of bundle of possible paths.

43:29And all we say we know from quantum mechanics

43:32is certain probabilities for where the ball will end up.

43:35Okay, so that's kind of the core idea of quantum mechanics.

43:38So in our models, you, quantum mechanics

43:41is not some kind of plugin add-on type thing.

43:44You absolutely cannot get away from quantum mechanics,

43:46because as you think about updating this hypergraph,

43:49there isn't just one sequence of things,

43:51one definite sequence of things that can happen.

43:53There are all these different possible update sequences

43:56that can occur.

43:57You could do this piece of the hypergraph now,

43:59and then this one later, and et cetera, et cetera, et cetera.

44:02All those different paths of history

44:04correspond to these quantum paths in quantum mechanics,

44:08these different possible quantum histories.

44:10And one of the things that's kind of surprising about it

44:12is they branch, you know,

44:15there can be a certain state of the universe,

44:17and it could do this, or it could do that,

44:20but they can also merge.

44:21There can be two states of the universe,

44:23which their next state,

44:25the next state they produce is the same for both of them.

44:27And that process of branching and merging

44:30is kind of critical,

44:30and the idea that they can be merging is critical,

44:33and somewhat non-trivial for these hypergraphs,

44:35because there's a whole graph isomorphism story,

44:37and there's a whole very elaborate set of mathematics.

44:40- And that's where the causal invariance comes in?

44:42- Yes, among other things, right, yes.

44:44But so then what happens is that what one's seeing,

44:49okay, so we've got this thing,

44:51it's branching, it's merging, et cetera, et cetera, et cetera.

44:54Okay, so now the question is, how do we perceive that?

44:57Why don't we notice that the universe

45:01is branching and merging?

45:03Why is it the case that we just think

45:05a definite set of things happen?

45:07Well, the answer is we are embedded in that universe,

45:10and our brains are branching and merging too.

45:13And so what quantum mechanics becomes a story of

45:16is how does a branching brain perceive a branching universe?

45:20And the key thing is, as soon as you say,

45:23"I think definite things happen in the universe,"

45:26that means you are essentially conflating

45:28lots of different parts of history.

45:30You're saying, "Actually, as far as I'm concerned,

45:33"because I'm convinced that definite things happen

45:36"in the universe, all these parts of history

45:38"must be equivalent."

45:39Now, it's not obvious that that would be

45:40a consistent thing to do.

45:42It might be you say, "All these parts of history

45:43"are equivalent, but by golly, moments later,

45:47"that would be a completely inconsistent point of view.

45:49"Everything would have gone to hell in different ways."

45:52The fact that that doesn't happen is,

45:54well, that's a consequence of this causal invariance thing,

45:57but that's, and the fact that that does happen a little bit

46:00is what causes little quantum effects.

46:02And that, if that didn't happen at all,

46:05there wouldn't be anything that sort of

46:07is like quantum mechanics.

46:09It would be, quantum mechanics is kind of like in this,

46:13in this kind of this bundle of paths,

46:15it's a little bit like what happens

46:17in statistical mechanics and fluid mechanics, whatever,

46:19that most of the time, you just see this continuous fluid.

46:22You just see the world just progressing

46:24in this kind of way that's like this continuous fluid.

46:26But every so often, if you look at the exact right

46:28experiment, you can start seeing,

46:30well, actually, it's made of these molecules

46:32where they might go that way or they might go this way,

46:34and that's kind of quantum effects.

46:36And so, that's, so this kind of idea of

46:40where we're sort of embedded in the universe,

46:43this branching brain is perceiving this branching universe,

46:46and that ends up being sort of a story of quantum mechanics.

46:49That's part of the whole picture of what's going on.

46:52But I think, I mean, to come back to sort of

46:55where does conscious, what is the story of consciousness?

46:58So, in the universe, we've got, you know,

47:01whatever it is, 10 to the 400 atoms of space,

47:03they're all doing these complicated things.

47:05It's all a big, complicated, irreducible computation.

47:08The question is, what do we perceive from all of that?

47:11And the answer is that we are parsing the universe

47:16in a particular way.

47:18Let me again go back to the gas molecules analogy.

47:21You know, in the gas in this room,

47:24there are molecules bouncing around

47:25in all kinds of complicated patterns, but we don't care.

47:28All we notice is there's, you know,

47:31the gas laws are satisfied,

47:33maybe there's some fluid dynamics.

47:35These are kind of features of that assembly of molecules

47:38that we notice, and there are lots of details

47:40we don't notice.

47:41- When you say we, do you mean the tools of physics,

47:43or do you mean literally the human brain

47:45and its perception system?

47:47- Well, okay, so the human brain is where it starts,

47:50but we've built a bunch of instruments

47:51to do a bit better than the human brain,

47:53but they still have many of the same kinds of ideas.

47:55You know, they're cameras, and they're pressure sensors,

47:58and they're these kinds of things.

48:00They're not, you know, at this point,

48:02we don't know how to make fundamentally, qualitatively

48:05different sensory devices.

48:07- Right, so it's always just an extension

48:09of the conscious experience.

48:11- Or our sensory experience.

48:13- Sensory experience, but sensory experience

48:17is somehow intricately tied to consciousness.

48:20- Right, well, so one question is,

48:22when we are looking at all these molecules in the gas,

48:24and there might be 10th to 20th molecules

48:26in some little box or something,

48:28it's like, what do we notice about those molecules?

48:32So one thing that we can say is,

48:33we don't notice that much.

48:35We are, you know, we are computationally bounded observers.

48:39We can't go in and say, okay,

48:42I'm the 10th to 20th molecules,

48:44and I know that I can sort of decrypt their motions,

48:47and I can figure out this and that.

48:48It's like, I'm just going to say,

48:49what's the average density of molecules?

48:51And so one key feature of us

48:54is that we are computationally bounded,

48:56and that when you are looking at a universe,

48:59which is full of computation,

§07Transcript · 49:00–57:41

49:00and doing huge amounts of computation,

49:03but we are computationally bounded,

49:05there's only certain things about that universe

49:07that we're going to be sensitive to.

49:08We're not going to be figuring out

49:11what all the atoms of space are doing,

49:13because we're just computationally bounded observers,

49:15and we are only sampling these small set of features.

49:20So I think the two defining features of consciousness,

49:23and I would say that the sort of the preamble to this is,

49:28for years, as I've talked about sort of computation

49:31and fundamental features of physics and science,

49:34people ask me, so what about consciousness?

49:37And I, for years, I've said,

49:38I have nothing to say about consciousness.

49:40And I've kind of told this story,

49:43you talk about intelligence, you talk about life.

49:46These are both features where you say,

49:48what's the abstract definition of life?

49:50We don't really know the abstract definition.

49:51We know the one for life on Earth,

49:53it's got RNA, it's got cell membranes,

49:55it's got all this kind of stuff.

49:57Similarly for intelligence,

49:58we know the human definition of intelligence,

50:00but what is intelligence abstractly?

50:02We don't really know.

50:03And so what I've long believed is that

50:06sort of the abstract definition of intelligence

50:08is just computational sophistication.

50:11That is, that as soon as you can be

50:13computationally sophisticated,

50:14that's kind of the abstract version,

50:17the generalized version of intelligence.

50:19So then the question is, what about consciousness?

50:22And what I sort of realized is that consciousness

50:24is actually a step down from intelligence.

50:27That is, that you might think,

50:29oh, consciousness is the top of the pile,

50:34but actually I don't think it is.

50:35I think that there's this notion

50:37of kind of computational sophistication,

50:38which is the generalized intelligence,

50:41but consciousness has two limitations, I think.

50:44One of them is computational boundedness.

50:47That is, that we're only perceiving

50:49a sort of computationally bounded view of the universe.

50:52And the other is this idea of a single thread of time.

50:55That is, that we, and in fact, we know,

50:58neurophysiologically, our brains go to some trouble

51:01to give us this one thread of attention, so to speak.

51:04And it isn't the case that in all the neurons in our brains,

51:07that at least in our conscious,

51:10note the correspondence of language,

51:12in our conscious experience,

51:14we just have this single thread of attention,

51:16single thread of perception.

51:19And maybe there's something unconscious

51:21that's bubbling around that's the kind of

51:23almost the quantum version of what's happening

51:25in our brain, so to speak.

51:26We've got the classical flow

51:29of what we are mostly thinking about, so to speak.

51:32But there's this kind of bubbling around of other paths

51:34that is all those other neurons that didn't make it

51:37to be part of our sort of conscious stream of experience.

51:40- So in that sense, intelligence

51:42as computational sophistication is much broader

51:46than the computational constraints

51:51which consciousness operates under,

51:53and also the sequential thing.

51:56- Yes, right. - Like the notion of time.

51:59That's kind of interesting,

51:59but then the follow-up question is like,

52:02okay, starting to get a sense of what is intelligence,

52:05and how does that connect to our human brain?

52:07'Cause you're saying intelligence is almost like a fabric,

52:12like what, we like plug into it or something?

52:15Like our consciousness plugs into it?

52:18- Yeah, I mean, the intelligence, I think, the core,

52:22I mean, intelligence at some level is just a word,

52:24but we are asking what is the notion of intelligence

52:28as we generalize it beyond the bounds of humans,

52:30beyond the bounds of even the AIs

52:33that we humans have built and so on, what is intelligence?

52:38Is the weather, people say the weather

52:39has a mind of its own, what does that mean?

52:41Can the weather be intelligent?

52:43- Yeah, what does agency have to do with intelligence here?

52:47So is intelligence just like your conception of computation?

52:50Is just intelligence, is the capacity

52:54to perform computation in a sea of?

52:56- Yeah, I think so.

52:57I mean, I think that's right,

52:58and I think that this question of is it for a purpose,

53:03that quickly degenerates into a horrible philosophical mess

53:08because whenever you say,

53:10did the weather do that for a purpose?

53:12- Yeah. - Right?

53:13Well, yes, it did, it was trying to move a bunch of hot air

53:16from the equator to the poles or something,

53:18that's its purpose.

53:19But why, 'cause I seem to be equally as dumb today

53:23as I was yesterday, so there's some persistence,

53:26like a consistency over time

53:29that the intelligence I plugged into.

53:32So it seems like there's a hard constraint

53:35between the amount of computation

53:38I can perform in my consciousness.

53:40Like they seem to be really closely connected somehow.

53:43- Well, I think the point is that the thing

53:45that gives you kind of the ability

53:47to have kind of conscious intelligence,

53:52you can have kind of this, okay,

53:54so one thing is we don't know intelligences

53:58other than the ones that are very much like us, right?

54:01And the ones that are very much like us,

54:04I think have this feature of single thread of time,

54:06bounded, computationally bounded.

54:09Now, that, but you also need computational sophistication.

54:13Having a single thread of time

54:15and being computationally bounded,

54:16you could just be a clock going tick-tock, you know,

54:19that would satisfy those conditions.

54:21But the fact that we have this sort of irreducible,

54:26you know, computational ability,

54:29that's an important feature.

54:31That's the sort of the bedrock

54:33on which we can construct the things we construct.

54:35Now, the fact that we have this experience of the world

54:40that has a single thread of time

54:41and computational boundedness,

54:43the thing that I sort of realized is

54:46it's that that causes us to deduce

54:49from this irreducible mess of what's going on

54:52in the physical world,

54:53the laws of physics that we think exist.

54:56So in other words, if we say,

54:59why do we believe that there is, you know,

55:02continuous space, let's say,

55:04why do we believe that gravity works the way it does?

55:07Well, in principle,

55:09we could be kind of parsing details of the universe

55:12that were, you know, that,

55:15okay, the analogy is, again,

55:18with the statistical mechanics and molecules in a box,

55:22we could be sensitive to every little detail

55:25of the swirling around of those molecules.

55:27And we could say, what really matters is the,

55:30you know, the wiggle effect.

55:31- Yes. - That is, you know,

55:33that is something that we humans just never noticed

55:35because it's some weird thing that happens

55:37when there are 15 collisions of air molecules

55:40and this happens and that happens.

55:41- We just see the pure motion of a ball moving about.

55:45- Right. - Why do we see that?

55:47- Right, and the point is that what seems to be the case

55:50is that the things that,

55:52if we say, given this sort of hypergraph that's updating

55:55and all the details about all the sort of,

55:58sort of atoms of space and what they do,

56:00and we say, how do we slice that

56:02to what we can be sensitive to?

56:04What seems to be the case is that as soon as we assume,

56:07you know, computational boundedness,

56:09single thread of time, that leads us to general relativity.

56:13In other words, we can't avoid that.

56:14That's the way that we will parse the universe.

56:18Given those constraints, we parse the universe

56:20according to those particular,

56:23in such a way that we say the aggregate reducible,

56:27sort of pocket of computational reducibility

56:31that we slice out of this kind of whole

56:34computationally irreducible ocean of behavior

56:37is just this one that corresponds to general relativity.

56:39- Yeah, but we don't perceive general relativity.

56:42- Well, we do if we do fancy experiments.

56:45- So you're saying, so perceive really does mean the full.

56:48- We drop something.

56:49That's a great example of general relativity in action.

56:51The gravity force. - No, but like,

56:52what's the difference in that and Newtonian mechanics?

56:55I mean, what? - Oh, it doesn't,

56:56this is, when I say general relativity,

56:58that's just the-- - You mean gravity.

57:00- The Uber theory, so to speak.

57:01I mean, Newtonian gravity is just the approximation

57:05that we can make, you know,

57:06on the earth and things like that.

57:08So this is, you know, the phenomenon of gravity

57:11is one that is a consequence of, you know,

57:15we would perceive something very different from gravity.

57:17So the way to understand that is when we think about,

57:22okay, so we make up reference frames

57:26with which we parse what's happening in space and time.

57:29So in other words, one of the things that we do

57:32is we say as time progresses,

57:36everywhere in space, something happens at a particular time

57:41and then we go to the next time

§08Transcript · 57:42–1:05:43

57:42and we say this is what space is like at the next time,

57:44this is what space is like at the next time.

57:47That's, it's, the reason we are used to doing that

57:51is because, you know, when we look around,

57:53we might see, you know, 10, 100 meters away.

57:56The time it takes light to travel that distance

57:59is really short compared to the time it takes our brains

58:03to know what happened.

58:04So as far as our brains are concerned,

58:06we are parsing the universe in this,

58:09there is a moment in time, it's all of space.

58:11There's a moment in time, it's all of space.

58:13You know, if we were the size of planets or something,

58:16we would have a different perception

58:17'cause the speed of light

58:18would be much more important to us.

58:19We wouldn't have this perception

58:21that things happen progressively in time,

58:25everywhere in space.

58:26And so that's an important kind of constraint.

58:29And the reason that we kind of parse the universe

58:31in the way that causes us to say gravity works

58:34the way it does is because we're doing things

58:36like deciding that we can say the universe exists,

58:41space has a definite structure.

58:43There is a moment in time,

58:44space has this definite structure.

58:46We move to the next moment in time,

58:47space has another structure.

58:49That kind of setup is what lets us kind of deduce,

58:53kind of parse the universe in such a way that we say

58:57gravity works the way it does.

58:59- So that kind of reference frame,

59:01is that the illusion of that,

59:04is that you're saying that's somehow useful

59:06for consciousness?

59:08- That's what consciousness does.

59:10Because in a sense, what consciousness is doing is,

59:13it's insisting that the universe is kind of sequentialized.

59:19And it is not allowing the possibility that,

59:23oh, there are these multiple threads of time

59:25and they're all flowing differently.

59:27It's like saying, no, everything is happening

59:30in this one thread of experience that we have.

59:33- And that illusion of that one thread of experience

59:36cannot happen at the planetary scale.

59:38So are you saying typical human,

59:40are you saying we are at a human level is special

59:43here for consciousness?

59:45- Well, for our kind of consciousness,

59:47if we existed at a scale close to the elementary length,

59:51for example, then our perception of the universe

59:53will be absurdly different.

59:55- Okay, so, but this makes consciousness seem like

59:57a weird side effect to this particular scale.

60:00And so who cares?

60:01I mean, so consciousness is not that special.

60:04- I think, look, I think that a very interesting question is

60:08which I've certainly thought a little bit about,

60:10is what can you imagine?

60:11What is the sort of factoring of something,

60:15what are some other possible ways

60:17you could exist, so to speak?

60:19And if you were a photon, if you were sort of,

60:23some kind of thing that was some kind of intelligence

60:27represented in terms of photons.

60:30For example, the photons we receive

60:32in the cosmic microwave background,

60:34those photons, as far as they're concerned,

60:36the universe just started.

60:37They were emitted 100,000 years

60:40after the beginning of the universe.

60:41They've been traveling at the speed of light.

60:43Time stayed still for them, and then they just arrived

60:46and we just detected them.

60:48So for them, the universe just started.

60:50And that's a different perception of,

60:53that has implications for a very different

60:55perception of time.

60:56- They don't have that single thread

60:57that seems to be really important

61:00for being able to tell a heck of a good story.

61:02So we humans-- - Yes.

61:03- Tell a story. - We can tell a story.

61:05Right, we can tell a story.

61:06- What other kind of stories can you tell?

61:08So a photon is a really boring story.

61:10- Yeah, I mean, so that's a,

61:12I don't know if they're a boring story,

61:13but I think it's, you know,

61:15I've been wondering about this

61:16and I've been asking friends of mine

61:18who are science fiction writers and things,

61:20have you written stuff about this?

61:21And I've got one example,

61:22the great collection of books from my friend,

61:25Rudy Rooker, which were, which I have to say,

61:29they're books about, that are very informed

61:32by a bunch of science that I've done.

61:34And the thing that I really loved about them is,

61:36you know, in the first chapter of the book,

61:39the Earth is consumed by these things he called Nantes,

61:42which are nano, nanobot type things.

61:45- Nice.

61:46- And it's, so, you know, so the Earth is gone

61:48in the first, but then it comes back.

61:49But then-- - Spoiler alert.

61:52- Yeah, right, that was only a micro spoiler.

61:54It's only chapter one.

61:55- Okay, good.

61:56- It's, but the thing that is not a real spoiler alert

62:01because it's such a complicated concept,

62:03but in the end, the Earth is saved by this thing

62:07called the principle of computational equivalence,

62:09which is a kind of a core scientific idea of mine.

62:12And I was just like, like thrilled.

62:14I don't read fiction books very often.

62:17And I was just thrilled I get to the end of this.

62:18And it's like, oh my gosh, you know,

62:21everything is saved by this sort of

62:22deep scientific principle.

62:24- Can you maybe elaborate how the principle

62:26of computational equivalence can save a planet?

62:31- That would be a terrible spoiler for real.

62:35- That would be a spoiler, okay.

62:36- Yeah, yeah, but no, but let me say what

62:38the principle of computational equivalence is.

62:41So the question is, you have a system, you have some rule.

62:46You can think of its behavior

62:48as corresponding to a computation.

62:50The question is, how sophisticated is that computation?

62:53The statement of the principle of computational equivalence

62:55is as soon as it's not obviously simple,

62:59it will be as sophisticated as anything.

63:01And so that has the implication that, you know, rule 30,

63:05you know, our brains, other things in physics,

63:08they're all ultimately equivalent

63:10in the computations they can do.

63:12And that's what leads to this

63:13computational irreducibility idea,

63:15because the reason we don't get to jump ahead,

63:18you know, and out think rule 30,

63:20is because we're just computationally equivalent to rule 30.

63:23So we're kind of just both just running computations

63:26that are the same sort of raw,

63:28the same level of computation, so to speak.

63:31So that's kind of the idea there.

63:33And the question, I mean, it's like,

63:35you know, in the science fiction version would be,

63:40okay, somebody says, we just need more servers,

63:42get us more servers.

63:43The way to get even more servers is turn the whole planet

63:47into a bunch of micro servers.

63:49And that's where it starts.

63:52And so the question of, you know,

63:54computational equivalence,

63:55principle of computational equivalence is,

63:56well, actually, you don't need to build those custom servers.

64:00Actually, you can just use natural computation

64:05to compute things, so to speak.

64:08You can use nature to compute.

64:10You don't need to have done all that engineering.

64:12And it's kind of feels a little disappointing

64:15that you say, we're going to build all these servers.

64:17We're going to do all these things.

64:18We're going to make, you know,

64:20maybe we're going to have human consciousness

64:22uploaded into, you know, some elaborate digital environment.

64:26And then you look at that thing and you say,

64:27it's got electrons moving around, just like in a rock.

64:31And then you say, well, what's the difference?

64:33And the principle of computational equivalence says,

64:35there isn't at some level a fundamental, you know,

64:38you can't say mathematically,

64:41there's a fundamental difference between the rock

64:44that is the future of human consciousness

64:46and the rock that's just a rock.

64:48Now, what I've sort of realized

64:50with this kind of consciousness thing is

64:52there is an aspect of this that seems to be more special

64:57that isn't, and for example,

64:59something I haven't really teased apart properly

65:02is when it comes to something like the weather

65:04and the weather having a mind of its own or whatever,

65:06or your average, you know, pulsar magnetosphere

65:09acting like a sort of intelligent thing,

65:11how does that relate to, you know,

65:14how is that entity related to the kind of consciousness

65:19that we have and sort of what would the world look like,

65:22you know, to the weather?

65:24If we think about the weather as a mind,

65:26what will it perceive?

65:27What will its laws of physics be?

65:30I don't really know.

65:31- 'Cause it's very parallel.

65:33- It's very parallel among other things.

65:35And it's not obvious.

65:37I mean, this is a really kind of mind bending thing

65:40'cause we've got to try and imagine where, you know,

65:43we've got to try and imagine a parsing of the universe

§09Transcript · 1:05:46–1:14:05

65:46different from the one we have.

65:47And by the way, when we think about

65:49extraterrestrial intelligence and so on,

65:51I think that's kind of the key thing is, you know,

65:54we have always assumed, I've always assumed,

65:57okay, the extraterrestrials,

65:58at least they have the same physics.

66:00We all live in the same universe.

66:01They've got the same physics.

66:03But actually that's not really right

66:05because the extraterrestrials

66:07could have a completely different way of parsing

66:10that the universe.

66:11So it's as if, you know, there could be for all we know,

66:14right here in this room, you know,

66:15in the details of the motion of these gas molecules,

66:18there could be an amazing intelligence that we were like,

66:22but we have no way of,

66:24we're not parsing the universe in the same way.

66:26If only we could parse the universe in the right way,

66:29you know, immediately this amazing thing that's going on

66:32and this, you know, huge culture that's developed

66:35and all that kind of thing would be obvious to us.

66:37But it's not because we have our particular way

66:38of parsing the universe.

66:39- Would that thing also have an agency?

66:42I don't know the right word to use,

66:44but something like consciousness,

66:45but a different kind of consciousness?

66:48- I think it's a question of just what you mean by the word,

66:50because I think that the, you know,

66:51this notion of consciousness and the, okay,

66:54so some people think of consciousness

66:56as sort of a key aspect of it is that we feel that,

67:00the sort of a feeling of that we exist in some way,

67:04that we have this intrinsic feeling about ourselves.

67:08You know, I suspect that any of these things

67:11would also have an intrinsic feeling about themselves.

67:14I've been sort of trying to think recently

67:16about constructing an experiment

67:18about what if you were just a piece of a cellular automaton,

67:20let's say, you know,

67:22what would your feeling about yourself actually be?

67:25And, you know, can we put ourselves in the shoes,

67:28in the cells of the cellular automaton, so to speak?

67:31Can we get ourselves close enough to that,

67:34that we could have a sense of what the world would be like

67:38if you were operating in that way?

67:40And it's a little difficult because, you know,

67:42you have to not only think about what are you perceiving,

67:46but also what's actually going on in your brain,

67:48and our brains do what they actually do.

67:51And they don't, it's, you know,

67:52I think there might be some experiments that are possible

67:55with, you know, neural nets and so on,

67:58where you can have something where you can at least see

68:00in detail what's happening inside the system.

68:03And I've been sort of one of my projects to think about is,

68:06is there a way of kind of getting a sense

68:10kind of from inside the system

68:11about what its view of the world is and how it, you know,

68:16can we make a bridge?

68:18See, the main issue is this, where, you know,

68:21it's a sort of philosophically difficult thing,

68:23because it's like, we do what we do.

68:25We understand ourselves, at least to some extent.

68:29- We humans understand ourselves.

68:30- That's correct.

68:31And, but yet, okay, so what are we trying to do,

68:34for example, when we are trying to make a model of physics,

68:37what are we actually trying to do?

68:39Because, you know, you say, well,

68:40can we work out what the universe does?

68:42Well, of course we can, we just watch the universe.

68:44The universe does what it does.

68:46But what we're trying to do when we make a model of physics

68:48is we're trying to get to the point

68:50where we can tell a story to ourselves

68:52that we understand that is also a representation

68:55of what the universe does.

68:57So it's this kind of, you know,

68:58can we make a bridge between what we humans

69:00can understand in our minds and what the universe does?

69:04And in a sense, you know, a large part of my kind of life

69:09efforts have been devoted to making computational language,

69:12which kind of is a bridge between what is possible

69:15in the computational universe

69:16and what we humans can conceptualize and think about.

69:20In a sense, what, you know, when I built Wolfram Language

69:22and our whole sort of computational language story,

69:25it's all about how do you take sort of raw computation

69:29and this ocean of computational possibility

69:31and how do we sort of represent pieces of it

69:34in a way that we humans can understand

69:37and that map onto things that we care about doing.

69:39And in a sense, when you add physics,

69:42you're adding this other piece where we can,

69:44you know, mediated by a computer,

69:46can we get physics to the point where we humans

69:49can understand something about what's happening in it?

69:52And when we talk about an alien intelligence,

69:54it's kind of the same story.

69:56It's like, is there a way of mapping what's happening there

70:00onto something that we humans can understand?

70:02And, you know, physics in some sense is like our exhibit one

70:07of the story of alien intelligence.

70:10It's a, you know, it's an alien intelligence in some sense.

70:14And what we're doing in making a model of physics

70:17is mapping that onto something that we understand.

70:20And I think, you know, a lot of these other things

70:22that I've recently been kind of studying,

70:25whether it's molecular biology, other kinds of things,

70:28which we can talk about a bit,

70:29those are other cases where we're in a sense

70:33trying to again, make that bridge

70:35between what we humans understand

70:37and sort of the natural language

70:39of that sort of alien intelligence in some sense.

70:42- When you're talking about,

70:44just to backtrack a little bit,

70:46about cellular automata being able to,

70:50what's it like to be a cellular automata

70:53in the way that's equivalent

70:55to what is it like to be a conscious human being?

70:58How do you approach that?

71:02So is it looking at some subset of the cellular automata,

71:06asking questions of that subset,

71:08like how the world is perceived,

71:11how you as that subset,

71:15like for that local pocket of computation,

71:17what are you able to say about the broader cellular automata?

71:21And that somehow then can give you a sense

71:24of how to step outside of that cellular automata.

71:26- Right, but the tricky part is that that little subset,

71:31it's what it's doing is it has a view of itself.

71:35And the question is, how do you get inside it?

71:38It's like, when we with humans, right?

71:40It's like, we can't get inside each other's consciousness.

71:44That doesn't really even make sense.

71:48It's like, there is an experience

71:50that somebody is having,

71:51but you can perceive things from the outside,

71:54but sort of getting inside it,

71:56it doesn't quite make sense.

71:58And for me, these sort of philosophical issues

72:00and this one I have not untangled.

72:02So let's be, for me,

72:06the thing that has been really interesting

72:07in thinking through some of these things is,

72:09when it comes to questions about consciousness

72:12or whatever else, it's like, when I can run a program

72:15and actually see pictures and make things concrete,

72:19I have a much better chance to understand what's going on

72:21than when I'm just trying to reason about things

72:23in a very abstract way.

72:24- Yeah, but there may be a way to map the program

72:29to your conscious experience.

72:32So for example, when you play a video game,

72:34you do a first person shooter,

72:35you walk around inside this entity,

72:39it's a very different thing than watching this entity.

72:42So if you can somehow connect more and more,

72:45connect this full conscious experience

72:48to the subset of the cellular automata.

72:51- Yeah, it's something like that.

72:52But the difference in the first person shooter thing

72:54is there's still your brain and your memory

72:57is still remembering, you still have, it's hard to,

73:02I mean, again, what one's gonna get,

73:04one is not going to actually be able

73:06to be the cellular automaton.

73:08One's gonna be able to watch

73:09what the cellular automaton does.

73:11But this is the frustrating thing

73:12that I'm trying to understand,

73:13you know, how to think about being it, so to speak.

73:18- Okay, so like in virtual reality,

73:19there's a concept of immersion,

73:21like with anything, with video game, with books,

73:23there's a concept of immersion.

73:24It feels like over time,

73:26if the virtual reality experience is well done,

73:31and maybe in the future it'll be extremely well done,

73:33the immersion leads you to feel like,

73:37you mentioned memories,

73:39you forget that you even ever existed

73:41outside that experience.

73:43- Yeah. - It's so immersive.

73:45I mean, you could argue sort of mathematically

73:47that you can never truly become immersed,

73:49but maybe you can.

73:51I mean, why can't you merge with the cellular automaton?

73:54- Yeah, right.

73:55- I mean, aren't you just part of the same fabric?

73:57Why can't you just like--

73:59- Well, that's a good question.

74:00I mean, so let's imagine the following scenario.

74:02Let's imagine-- - Then can you return?

74:04(laughing)

74:05- What's that?

§10Transcript · 1:14:05–1:21:58

74:05- But then can you return back?

74:07- Well, yeah, right.

74:08I mean, it's like, let's imagine you've uploaded,

74:10you know, your brain is scanned,

74:11you've got every synapse, you know, mapped out.

74:14You upload everything about you,

74:16the brain simulator, you upload the brain simulator,

74:19and the brain simulator is basically, you know,

74:21some glorified cellular automaton.

74:24And then you say, well, now we've got an answer

74:26to what does it feel like to be a cellular automaton?

74:28It feels just like it felt to be ordinary you,

74:32because they're both computational systems,

74:34and they're both, you know, operating in the same way.

74:36So in a sense, but I think there's somehow more to it,

74:39because in that sense,

74:41when you're just making a brain simulator,

74:43it's just, you know, we're just saying

74:45there's another version of our consciousness.

74:47The question that we're asking is,

74:49if we tease away from our consciousness

74:52and get to something that is different,

74:54how do we make a bridge

74:55to understanding what's going on there?

74:57And, you know, there's a way of thinking about this.

74:59Okay, so this is coming on to sort of questions

75:02about the existence of the universe and so on.

75:04But one of the things is there's this notion

75:06that we have of ruleal space.

75:09So we have this idea of this physical space,

75:11which is, you know, something you can move around in

75:14that's associated with the actual,

75:16the extent of the spatial hypergraph.

75:18Then there's what we call branchial space,

75:21the space of quantum branches.

75:22So in this thing we call the multi-way graph

75:25of all of this sort of branching histories,

75:27there's this idea of a kind of space

75:30where instead of moving around in physical space,

75:32you're moving from history to history, so to speak,

75:35from one possible history to another possible history.

75:37And that's kind of a different kind of space

75:40that is the space in which quantum mechanics plays out.

75:43Quantum mechanics, like for example,

75:46or something like, I think we're slowly understanding

75:49things like destructive interference in quantum mechanics.

75:51That what's happening is branchial space

75:54is associated with phase in quantum mechanics.

75:56And what's happening is the two photons

75:58that are supposed to be interfering

75:59and destructively interfering

76:01are winding up at different ends of branchial space.

76:04And so us, as these poor observers that are trying to,

76:07that have branching brains,

76:09that are trying to conflate together

76:11these different threads of history,

76:13and say, we've really got a consistent story

76:15that we're telling here.

76:16We're really knitting together these threads of history.

76:18By the time the two photons

76:20wound up at opposite ends of branchial space,

76:22we just can't knit them together to tell a consistent story.

76:25So for us, that's sort of the analog

76:28of destructive interference.

76:30- Got it, and then there's rule-ial space too,

76:32which is the space of rules.

76:33- Yes, well, that's another level up.

76:36So there's the question,

76:38actually, I do want to mention one thing,

76:41'cause it's something I've realized in recent times,

76:43and I think it's really, really kind of cool,

76:45which is about time dilation in relativity.

76:47And it kind of helps to understand,

76:49it's something that kind of helps

76:51in understanding what's going on.

76:52So according to relativity,

76:55if you have a clock, it's ticking at a certain rate,

76:59you send it in a spacecraft

77:00that's going at some significant fraction

77:02of the speed of light,

77:03to you as an observer at rest,

77:06that clock that's in the spacecraft

77:08will seem to be ticking much more slowly.

77:11And so in other words, it's kind of like

77:13the twin who goes off to Alpha Centauri

77:16and goes very fast will age much less

77:19than the twin who's on Earth

77:20that is just hanging out where they're hanging out.

77:23Okay, why does that happen?

77:25Okay, so it has to do with what motion is.

77:28So in our models of physics, what is motion?

77:32Well, when you move from somewhere to somewhere,

77:34it's you having to sort of recreate yourself

77:38at a different place in space.

77:40When you exist at a particular place

77:42and you just evolve with time,

77:44you're again, you're updating yourself,

77:46you're following these rules to update what happens.

77:49Well, so the question is,

77:51when you have a certain amount of computation in you,

77:53so to speak, when there's a certain amount,

77:55you know, you're computing,

77:56the universe is computing at a certain rate,

77:58you can either use that computation

78:01to work out sitting still where you are,

78:03what's going to happen successively in time,

78:06or you can use that computation

78:08to recreate yourself as you move around the universe.

78:11And so time dilation ends up being,

78:13it's really cool actually that this is explainable

78:15in a way that isn't just,

78:17imagine the mathematics of relativity.

78:19But that time dilation is a story of the fact that

78:23as you kind of are recreating yourself as you move,

78:26you are using up some of your computation.

78:29And so you don't have as much computation left over

78:32to actually work out what happens progressively with time.

78:35So that means that time is running more slowly for you

78:38because it is, you're using up your computation,

78:41your clock can't tick as quickly

78:44because every tick of the clock

78:46is using up some computation,

78:47but you already use that computation up

78:49on moving at half the speed of light or something.

78:52And so that's why time dilation happens.

78:55And so you can start,

78:57so it's kind of interesting

78:58that one can sort of get an intuition

79:00about something like that,

79:01because it has seemed like just a mathematical fact

79:04about the mathematics of special relativity and so on.

79:07- Well, for me, it's a little bit confusing

79:09what the U in that picture is,

79:11'cause you're using up computation.

79:15- Okay, so we're simply saying the entity

79:18is updating itself according to

79:21the way that the universe updates itself.

79:24And the question is, those updates,

79:27let's imagine the U is a clock, okay?

79:30And the clock is, there's all these little updates,

79:32the hypergraph and a sequence of updates

79:35cause the pendulum to swing back the other way

79:37and then swing back and forth, okay?

79:41And all of those updates are contributing

79:45to the motion of the pendulum going back and forth

79:47or the little oscillator moving, whatever it is, okay?

79:51But then the alternative is that sort of situation one,

79:54where the thing is at rest,

79:56situation two, where it's kind of moving,

79:58what's happening is it is having to recreate itself

80:02at every moment.

80:04The thing is going to have to do the computations

80:07to be able to sort of recreate itself

80:10at a different position in space.

80:12And that's kind of the intuition behind,

80:14so it's either going to spend its computation

80:16recreating itself at a different position in space,

80:19or it's gonna spend its computation

80:21sort of doing the updating of the ticking of the clock,

80:27so to speak.

80:28- So the more updating it's doing,

80:30the less the ticking of the clock update is doing.

80:33- That's right.

80:34The more it's having to update because of motion,

80:36the less it can update the clock.

80:38So that's, I mean, obviously there's a sort

80:42of mathematical version of it that relates

80:43to how it actually works in relativity,

80:45but that's kind of, to me, that was sort of exciting to me

80:48that it's possible to have a really mechanically

80:51explainable story there that isn't,

80:54and similarly in quantum mechanics,

80:56this notion of branching brains,

80:57perceiving branching universes,

80:59to me, that's getting towards a sort

81:00of mechanically explainable version

81:02of what happens in quantum mechanics,

81:04even though it's a little bit mind bending

81:06to see these things about under what circumstances

81:09can you successfully knit together

81:12those different threads of history,

81:14and when do things sort of escape,

81:15and those kinds of things.

81:17But the thing about this physical space,

81:21in physical space, the main sort of big theory

81:25is general relativity, the theory of gravity,

81:27and that tells you how things move in physical space.

81:30In branchial space, the big theory

81:32is the Feynman path integral, which it turns out,

81:35tells you essentially how things move

81:37in the space of quantum phases.

81:40So it's kind of like motion in branchial space.

81:42And it's kind of a fun thing to start thinking about

81:45what, oh, you know, all these things

81:48that we know in physical space,

81:49like event horizons and black holes and so on,

81:52what are the analogous things in branchial space?

81:54For example, the speed of light,

81:55what's the analog of the speed of light in branchial space?

81:58It's the maximum speed of quantum entanglement.

§11Transcript · 1:22:01–1:30:12

82:01So the speed of light is a flashbulb goes off here,

82:05what's the maximum rate at which the effect

82:08of that flashbulb is detectable moving away in space?

82:12So similarly, in branchial space, something happens,

82:15and the question is, how far in this branchial space,

82:18in the space of quantum states,

82:20how far away can that get within a certain period of time?

82:23And so there's this notion of a maximum entanglement speed,

82:27and that might be observable.

82:28That's the thing we've been sort of poking at,

82:31is might there be a way to observe it

82:32even in some atomic physics kind of situation?

82:35'Cause one of the things that's weird in quantum mechanics

82:39is when we study quantum mechanics,

82:42we mostly study it in terms of small numbers of particles.

82:45You know, this electron does this,

82:46this thing on an ion trap does that, and so on.

82:49But when we deal with large numbers of particles,

82:51kind of all bets are off.

82:52It's kind of too complicated to deal with quantum mechanics.

82:55And so what ends up happening is,

82:57so this question about maximum entanglement speed

83:00and things like that may actually play in one of these,

83:03in the sort of story of many-body quantum mechanics,

83:06and even have some suspicions about things

83:08that might happen even in,

83:10one of the things I realized I'd never understood,

83:13and it's kind of embarrassing,

83:14but I think I now understand a little better,

83:17is when you have chemistry and you have quantum mechanics,

83:20it's like, well, there's two carbon atoms.

83:22There's this molecule, and we do a reaction,

83:24and we draw a diagram, and we say,

83:25this carbon atom ends up in this place.

83:28And it's like, but wait a minute.

83:29In quantum mechanics, nothing ends up in a definite place.

83:31There's always just some wave function for this to happen.

83:34How can it be the case that we can draw these reasonable,

83:37it just ended up in this place?

83:39And you have to kind of say,

83:40well, the environment of the molecule

83:42effectively made a bunch of measurements on the molecule

83:44to keep it kind of classical.

83:46And that's a story that has to do with this whole thing

83:49about measurements have to do with this idea of,

83:54can we conclude that something definite happened?

83:57Because in quantum mechanics,

83:58the intrinsic quantum mechanics,

84:00the mathematics of quantum mechanics is all about,

84:02they're just these amplitudes

84:03for different things to happen.

84:05Then there's this thing of, and then we make a measurement,

84:08and we conclude that something definite happened.

84:10And that has to do with this thing, I think,

84:12about sort of moving, about knitting together

84:15these different threads of history and saying,

84:18this is now something where we can definitively say

84:20something definite happened.

84:21In the traditional theory of quantum mechanics,

84:23it's just like,

84:25after you've done all this amplitude computation,

84:27then this big hammer comes down and you do a measurement,

84:30and it's all over.

84:31And that's been very confusing,

84:33for example, in quantum computing,

84:34it's been a very confusing thing because when you say,

84:38in quantum computing, the basic idea is you're gonna use

84:40all these separate threads of computation, so to speak,

84:43to do all the different parts of,

84:45try these different factors for an integer

84:46or something like this.

84:48And it looks like you can do a lot

84:50because you've got all these different threads going on.

84:52But then you have to say, well, at the end of it,

84:55you've got all these threads,

84:56and every thread came up with a definite answer,

84:58but we got to conflate those together

85:00to figure out a definite thing that we humans

85:03can take away from it, a definite,

85:04so the computer actually produced this output.

85:07- So having this branchial space

85:10and this hypergraph model of physics,

85:13do you think it's possible to then make predictions

85:16that are definite about many body

85:19quantum mechanical systems?

85:21Is that the hope?

85:22- I think it's likely, yes.

85:23But I don't, you know, this is,

85:25every one of these things,

85:26when you go from the underlying theory,

85:28which is complicated enough, and it's,

85:30I mean, the theory at some level is beautifully simple,

85:33but as soon as you start actually trying to,

85:35it's this whole question about how do you bridge it

85:37to things that we humans can talk about,

85:40it gets really complicated.

85:41And this thing about actually getting it

85:44to a definite prediction about, you know,

85:48definite thing you can say about chemistry

85:50or something like this, you know,

85:51that's just a lot of work.

85:52So I'll give you an example.

85:54There's a thing called the quantum Zeno effect.

85:56So the idea is, you know, quantum stuff happens,

86:00but then if you make a measurement,

86:01you're kind of freezing time in quantum mechanics.

86:04And so it looks like there's a possibility

86:07that with sort of the relationship

86:09between the quantum Zeno effect

86:11and the way that many body quantum mechanics works

86:13and so on, maybe just conceivably,

86:16it may be possible to actually figure out a way

86:18to measure the maximum entanglement speed.

86:21And the reason we can potentially do that

86:24is because the systems we deal with

86:26in terms of atoms and things, they're pretty big.

86:28You know, a mole of atoms is, you know,

86:30it's a lot of atoms and, you know,

86:32but it isn't a very, you know,

86:33it's something where to get, you know,

86:36when we're dealing with how can you see 10

86:37to the minus 100, so to speak?

86:39Well, by the time you've got, you know,

86:4110 to the 30th atoms, you're not, you know,

86:44you're within a little bit closer striking distance of that.

86:47It's not like, oh, we've just got, you know,

86:50two atoms and we're trying to see down

86:52to 10 to the minus 100 meters or whatever.

86:55So I don't know how it will work,

86:57but this is a potential direction.

87:00And if you can tell, by the way,

87:02if we could measure the maximum entanglement speed,

87:04we would know the elementary length.

87:06These are all related.

87:07So if we got that one number, we just need one number.

87:11If we can get that one number, we can, you know,

87:13the theory has no parameters anymore.

87:16And, you know, there are other places.

87:18Well, there's another hope for doing that is in cosmology.

87:22In this model, one of the features is

87:24the universe is not fixed dimensional.

87:26I mean, we think we live in three-dimensional space,

87:28but this hypergraph doesn't have any particular dimension.

87:31It can emerge as something which on an approximation,

87:35it's as if, you know, you say,

87:36what's the volume of a sphere in the hypergraph

87:38where a sphere is defined as how many nodes do you get to

87:42when you go a distance R away from a given point?

87:45And you can say, well, if I get to about R cubed nodes,

87:49when I go a distance R away in the hypergraph,

87:51then I'm living roughly in three-dimensional space.

87:54But you might also get to R to the point, you know, 2.92,

87:59you know, for some value of R in, you know,

88:02as R increases, that might be the sort of fit

88:05to what happens.

88:06And so one of the things we suspect is that

88:08the very early universe was essentially

88:10infinite dimensional, and that as the universe expanded,

88:14it became lower dimensional.

88:16And so one of the things that is another little sort of point

88:19where we think there might be a way

88:21to actually measure some things is dimension fluctuations

88:24in the early universe.

88:25That is, is there a leftover dimension fluctuation of,

88:29at the time of the cosmic microwave background,

88:31100,000 years or something after the beginning

88:33of the universe, is it still the case that there were pieces

88:37of the universe that didn't have dimension three,

88:39that had dimension 3.01 or something?

88:42And can we tell that?

88:43- Is that possible to observe the fluctuations

88:47in dimensions?

88:49I don't even know what that entails.

88:51- Okay, so the question, which should be an elementary

88:54exercise in electrodynamics, except it isn't,

88:57is understanding what happens to a photon

89:00when it propagates through 3.01 dimensional space.

89:03So for example, the inverse square law is a consequence

89:06of the surface area of a sphere is proportional

89:11to R squared.

89:12But if you're not in three dimensional space,

89:15the surface area of a sphere is not proportional

89:18to R squared, it's R to the whatever, 2.01 or something.

89:22And so that means that I think when you try and do optics,

89:28a common principle in optics is Huygens principle,

89:31which basically says that every piece of a wave front

89:34of light is a source of new spherical waves.

89:39And those spherical waves, if they're different dimensional

89:41spherical waves, will have other characteristics.

89:45And so there will be bizarre optical phenomena,

89:48which we haven't figured out yet.

89:50- So you're looking for some weird photon trajectories

89:55that designate that it's 3.01 dimensional space?

89:59- Yeah, yeah, that would be an example of, I mean,

90:02you know, there are only a certain number of things

90:04we can measure about photons.

90:06You know, we can measure their polarization,

90:07we can measure their frequency,

90:09we can measure their direction, those kinds of things.

90:12And you know, how that all works out,

§12Transcript · 1:30:15–1:38:19

90:15and you know, in the current models of physics,

90:19you know, it's been hard to explain how the universe

90:21manages to be as uniform as it is.

90:23And that's led to this inflation idea that,

90:27to the great annoyance of my then collaborator,

90:29we figured out in like 1979, we had this realization

90:33that you could get something like this,

90:35but it seemed implausible that that's the way

90:37the universe worked, so we put in a footnote.

90:39And that was, so that's a, but in any case,

90:42I've never really completely believed it,

90:44but that's an idea for how to sort of puff out the universe

90:48faster than the speed of light,

90:50early moments of the universe,

90:51that that's the sort of the inflation idea.

90:53And that you can somehow explain how the universe manages

90:57to be as uniform as it is.

90:59In our model, this turns out to be much more natural,

91:03because the universe just starts very connected.

91:05The hypergraph is not such that the ball that you grow

91:09starting from a single point has volume R cubed,

91:11it might have volume R to the 500 or R to the infinity.

91:16And so that means that you sort of naturally get

91:19this much higher degree of connectivity and uniformity

91:21in the universe.

91:22And then the question is,

91:24this is sort of the mathematical physics challenge,

91:27is in the standard theory of the universe,

91:29there's the Friedman-Robertson-Walker universe,

91:31which is the kind of standard model where the universe

91:33is isotropic and homogeneous,

91:35and you can then work out the equations of general relativity

91:38and you can figure out how the universe expands.

91:41We would like to do the same kind of thing,

91:42including dimension change.

91:44This is just difficult mathematical physics.

91:47I mean, the reason it's difficult

91:48is the sort of fundamental reason it's difficult.

91:50When people invented calculus 300 years ago,

91:53calculus was a story of understanding change

91:57and change as a function of a variable.

92:00And so people study univariate calculus,

92:02they study multivariate calculus,

92:03it's one variable, it's two variables, three variables,

92:06but whoever studied 2.5 variable calculus,

92:10turns out nobody.

92:12Turns out that, but what we need to have

92:15to understand these fractional dimensional spaces,

92:18which don't work like,

92:19well, they're spaces where the effective dimension

92:24is not an integer.

92:25- So you can't apply the tools of calculus

92:28and naturally and easily to fractional dimensions.

92:31- No.

92:32- So somebody has to figure out how to do that.

92:34- Yeah, yeah, we're trying to figure this out.

92:35I mean, it's very interesting.

92:37I mean, it's very connected to very frontier issues

92:40in mathematics.

92:41It's very beautiful, but-

92:42- So is it possible, is it possible,

92:44we're dealing with a scale that's so, so much smaller

92:48than our human scale.

92:50Is it possible to make predictions versus explanations?

92:53Do you have a hope that with this hypergraph model,

92:57you'd be able to make predictions?

92:59- Yeah.

92:59- That then could be validated with a physics experiment,

93:04predictions that couldn't have been done

93:06or weren't done otherwise?

93:07- Yeah, yeah, yeah.

93:08I mean, you know, I think-

93:09- In which domain do you think that prediction will-

93:11- Okay, so there are gonna be cosmology ones

93:12to do with dimension fluctuations in the universe.

93:14That's a very bizarre effect.

93:16Nobody, you know, dimension fluctuation is just something,

93:18nobody ever looked for that.

93:19If anybody sees dimension fluctuation, that's a huge flag,

93:23that's something like our model is going on.

93:26If, and how one detects that, you know,

93:28that's a problem of kind of, you know,

93:30that's a problem of traditional physics in a sense

93:32of what's the best way to actually figure that out.

93:35And for example, that's one,

93:37there are all kinds of things one can imagine.

93:40I mean, there are things that in black hole mergers,

93:44it's possible that there will be effects

93:47of maximum entanglement speed in large black hole mergers.

93:50That's another possible thing.

93:53- And all of that is detected through like what?

93:55Do you have a hope for LIGO type of situation?

93:57Like that's gravitational waves?

93:59- Yeah, or alternatively, I mean, I think it's, you know,

94:03look, figuring out experiments

94:05is like figuring out technology inventions.

94:08That is, you know, you've got a set of raw materials,

94:11you've got an underlying model,

94:12and now you've got to be very clever

94:14to figure out, you know, what is that thing I can measure

94:16that just somehow, you know,

94:18leverages into the right place.

94:21And we've spent less effort on that than I would have liked,

94:24because one of the reasons is that I think that the,

94:28you know, the physicists who've been working on our models,

94:32and we've now, lots of physicists actually,

94:34it's very, very nice.

94:35It's kind of, you know, it's one of these cases

94:37where I'm almost, I'm really kind of pleasantly surprised

94:41that the sort of absorption of the things we've done

94:43has been quite rapid and quite sort of,

94:47you know, very positive.

94:48- So it's a Cambrian explosion of physicists too,

94:51not just ideas.

94:52- Yes, I mean, you know, a lot of what's happened

94:55that's really interesting, and again,

94:56not what I expected is, there are a lot of areas

94:59of sort of very elaborate,

95:02sophisticated mathematical physics,

95:04whether that's causal set theory,

95:05whether it's higher category theory,

95:07whether it's categorical quantum mechanics,

95:09all sorts of elaborate names for these things,

95:12spin networks, perhaps, you know,

95:15causal dynamical triangulations,

95:17all kinds of names of these fields.

95:19And these fields have a bunch

95:21of good mathematical physicists in them

95:23who've been working for decades in these particular areas.

95:26And the question is,

95:27but they've been building these mathematical structures,

95:30and the mathematical structures are interesting,

95:32but they don't typically sit on anything.

95:35They're just mathematical structures.

95:37And I think what's happened is our models provide

95:39kind of a machine code that lives underneath those models.

95:43So a typical example, this is due to Jonathan Gorod,

95:47who's one of the key people

95:49who's been working on our project.

95:51This is in, okay, so I'll give you an example,

95:54just to give a sense of how these things connect.

95:56This is in causal set theory.

95:58So the idea of causal set theory is there are,

96:02in space-time, we imagine that there's space and time,

96:05it's a three plus one dimensional, you know, setup.

96:08We imagine that there are just events that happen

96:12at different times and places in space and time.

96:15And the idea of causal set theory is the only thing

96:17you say about the universe is there are a bunch of events

96:20that happen sort of randomly

96:22at different places in space and time.

96:24And then the whole sort of theory of physics

96:26has to be to do with this graph of causal relationships

96:30between these randomly thrown down events.

96:34So they've always been confused by the fact that

96:37to get even Lorentz invariance,

96:38even relativistic invariance,

96:40you need a very special way to throw down those events.

96:43And they've had no natural way

96:44to understand how that would happen.

96:46So what Jonathan figured out is that,

96:48in fact, from our models,

96:50they, instead of just generating events at random,

96:55our models necessarily generate events in some pattern

96:58in space-time effectively,

97:01that then leads to Lorentz invariance

97:02and relativistic invariance and all those kinds of things.

97:05So it's a place where all the mathematics

97:07that's been done on,

97:08well, we just have a random collection of events.

97:10Now, what consequences does that have

97:12in terms of causal set theory and so on?

97:15That can all be kind of wheeled in

97:17now that we have some different underlying foundational idea

97:20for what the particular distribution of events is

97:23as opposed to just where we throw down random events.

97:26And so that's a typical sort of example

97:28of what we're seeing in all these different areas

97:31of kind of how you can take really interesting things

97:34that have been done in mathematical physics

97:36and connect them.

97:37And it's really kind of beautiful

97:39because the sort of the abstract models we have

97:43just seem to plug into all these different,

97:45very interesting, very elegant, abstract ideas,

97:48but we're now giving sort of a reason

97:51for that to be the way,

97:53for a reason for one to care.

97:54I mean, it's like saying,

97:56you can think about computation abstractly.

98:00You can think about, I don't know,

98:01combinators or something as abstract computational things.

98:04And you can sort of do all kinds of study of them,

98:07but it's like, why do we care?

98:09Well, okay, Turing machines are a good start

98:11'cause you can kind of see

98:11they're sort of mechanically doing things.

98:13But when we actually start thinking about computers

98:16computing things, we have a really good reason to care.

98:19And this is sort of what we're providing, I think,

§13Transcript · 1:38:21–1:46:12

98:21is a reason to care about a lot of these areas

98:24of mathematical physics.

98:25So that's been very nice.

98:27- So I'm not sure we've ever got to the question

98:31of why does the universe exist at all.

98:33Let's talk about that.

98:35So it's not the simplest question in the world.

98:38So it takes a few steps to get to it.

98:41- And it's nevertheless even surprising

98:43that you can even begin to answer this question,

98:46as you were saying.

98:47- I'm very surprised.

98:49So the next thing to perhaps understand

98:52is this idea of ruleal space.

98:55So we've got kind of physical space,

98:57we've got branchial space,

98:58the space of possible quantum histories.

99:01And now we've got another level of kind of abstraction,

99:04which is ruleal space.

99:05And here's where that comes from.

99:08So you say, okay, you say,

99:10we've got this model for the universe,

99:12we've got a particular rule,

99:15and we run this rule and we get the universe.

99:17Okay, so that's interesting.

99:19Why that rule?

99:20Why not another rule?

99:22And so that confused me for a long time.

99:24And I realized, well, actually,

99:26what if the thing could be using all possible rules?

99:30What if at every step,

99:31in addition to saying apply a particular rule

99:34at all places in this hypergraph,

99:36one could say, just take all possible rules

99:39and apply all possible rules

99:40at all possible places in this hypergraph.

99:43Okay, and then you make this ruleal multi-way graph,

99:46which both is all possible histories

99:48for a particular rule and all possible rules.

99:51So the next thing you'd say is,

99:52how can you get anything reasonable out of it?

99:54How can anything real come out of

99:57the set of all possible rules applied

99:59in all possible ways?

100:00Okay, this is a subtle thing,

100:02so which I haven't fully untangled.

100:05There is this object,

100:07which is the result of running all possible rules

100:10in all possible ways.

100:11And you might say, if you're running all possible rules,

100:13why can't everything possible happen?

100:15Well, the answer is because when you,

100:19there's sort of this entanglement that occurs.

100:21So let's say that you have

100:24a lot of different possible initial conditions,

100:26a lot of different possible states.

100:28Then you're applying these different rules.

100:30Well, some of those rules can end up with the same state.

100:34So it isn't the case that you can just get

100:36from anywhere to anywhere.

100:37There's this whole entangled structure

100:39of what can lead to what,

100:41and there's a definite structure that's produced.

100:43I think I'm gonna call that definite structure

100:45the Rulliad,

100:46the limit of kind of all possible rules

100:50being applied in all possible ways.

100:52- And you're saying that structure is finite,

100:54so that somehow connects to maybe a similar kind of thing

100:57as like causal invariance.

100:59- Well, it happens that the Rulliad

101:00necessarily has causal invariance.

101:02That's a feature of,

101:03that's just a mathematical consequence

101:05of essentially using all possible rules

101:08plus universal computation gives you the fact

101:11that for many diverging paths,

101:13you can always, the paths will always converge.

101:15- But does that say that the Rulli,

101:16does that necessarily infer that the Rulliad is a finite?

101:21- In the end, it's not necessarily finite.

101:23I mean, it's a,

101:26just like the history of the universe may not be finite.

101:28The history of the universe, time may keep going forever.

101:31You can keep running the computations of the Rulliad

101:34and you'll keep spewing out more and more and more structure.

101:37It's like time doesn't have to end.

101:39It's that, but the issue is there are three limits

101:44that happen in this Rulliad object.

101:46One is how long you run the computation for.

101:49Another is how many different rules you're applying.

101:52And another is how many different states you start from.

101:55And the mixture of those three limits,

101:57I mean, this is just mathematically a horrendous object.

102:01And what's interesting about this object is

102:04the one thing that does seem to be the case

102:05about this object is it connects with ideas

102:07in higher category theory.

102:09And in particular, it connects to some of the 20th century's

102:12most abstract mathematics done by this chap Grothendieck.

102:17Grothendieck had a thing called the infinity groupoid,

102:19which is closely related to this Rulliad object.

102:23Although the details of the relationship,

102:25I don't fully understand yet.

102:29But I think that what's interesting is this thing

102:32that is sort of this very limiting object.

102:33So, okay, so a way to think about this,

102:36that again, will take us into another direction,

102:40which is the equivalence between physics and mathematics.

102:43The way that, well, let's see, maybe this is,

102:48just to give a sense of this kind of groupoid

102:51and things like that.

102:52You can think about, in mathematics,

102:53you can think you have certain axioms,

102:55they're kind of like atoms, and you,

102:58well, actually, let's say,

103:00let's talk about mathematics for a second.

103:02So what is mathematics?

103:03What is it made of, so to speak?

103:06Mathematics, there's a bunch of statements,

103:08like for addition, X plus Y is equal to Y plus X.

103:12That's a statement of mathematics.

103:14Another statement would be, you know,

103:15X squared minus one is equal to X plus one X minus one.

103:18There are infinite number of these possible statements

103:21of mathematics.

103:22- So it's not, I mean, it's not just, I guess, a statement,

103:24but with X plus Y, it's a rule that you can,

103:28it's a, I mean, you think of it as a rule.

103:29- It's a, it is a rule.

103:32It's also just a thing that is true in mathematics.

103:35- Right, it's a statement of truth, okay.

103:37- Right, and what you can imagine is,

103:39you imagine just laying out this giant kind of ocean

103:44of all statements, well, actually, you first start,

103:47okay, this is where,

103:48this, we're segueing into a different thing.

103:50Let me not go in this direction for a second.

103:52- Let's not go to meta-mathematics just yet.

103:54- Yeah, we'll maybe get to meta-mathematics,

103:56but it's, so let me not,

103:59let me explain the groupoid and things later.

104:01- Yes.

104:02- But, so let's come back to the universe,

104:05always a good place to be in, so to speak.

104:07- Yeah, so what does the universe have to do

104:09with the Rulliad, the Rullio space,

104:11and how that's possibly connected

104:15to why the thing exists at all,

104:17and why there's just one of them?

104:18- Yes, okay, so here's the point.

104:20So the thing that had confused me for a long time was,

104:24let's say we get the rule for the universe.

104:26We hold it in our hand.

104:27We say, "This is our universe."

104:29Then the immediate question is,

104:30"Well, why isn't it another one?"

104:32And that's kind of the,

104:34the sort of the lesson of Copernicus is,

104:37we're not very special.

104:38So how come we got universe number 312

104:42and not universe quadrillion, quadrillion, quadrillion?

104:46And I think the resolution of that is the realization

104:48that the universe is running all possible rules.

104:53So then you say, "Well, how on earth do we perceive

104:58"the universe to be running according to a particular rule?

105:00"How do we perceive definite things

105:02"happening in the universe?"

105:03Well, it's the same story.

105:05It's the observer.

105:07There is a reference frame that we are picking

105:09in this Rullio space,

105:11and that that is what determines

105:13our perception of the universe.

105:15With our particular sensory information and so on,

105:18we are parsing the universe in this particular way.

105:21So here's the way to think about it.

105:23In physical space,

105:24we live in a particular place in the universe.

105:27And we could live on Alpha Centauri,

105:29but we don't, we live here.

105:30And similarly, in Rullio space,

105:34we could live in many different places in Rullio space,

105:37but we happen to live here.

105:39And what does it mean to live here?

105:40It means we have certain sensory input.

105:43We have certain ways to parse the universe.

105:45Those are our interpretation of the universe.

105:48What would it mean to travel in Rullio space?

105:51What it basically means is that we are successively

105:53interpreting the universe in different ways.

105:56So in other words,

105:57to be at a different point in Rullio space

105:59is to have a different, in a sense,

106:01a different interpretation of what's going on

106:03in the universe.

106:04And we can imagine even things like an analog

106:07of the speed of light as the maximum speed

106:09of translation in Rullio space and so on.

106:12- So wait, what's the interpretation?

§14Transcript · 1:46:15–1:54:20

106:15So Rullio space, and we, I'm confused by the we

106:19and the interpretation and the universe.

106:22I thought moving about in Rullio space

106:25changes the way the universe is.

106:29- The way we would perceive it.

106:32The way that--

106:33- So it ultimately has to do with the perception.

106:35So it doesn't, Rullio space is not somehow changing,

106:41like branching into another universe or something like that.

106:45- No, I mean, the point is, the whole point of this

106:48is the Rulliard is sort of the encapsulated version

106:53of everything that is the universe

106:55running according to all possible rules.

106:56- We think of our universe,

106:59the observable universe as its thing.

107:03So we're a little bit loose with the word universe then

107:05because wouldn't the Rulliard potentially encapsulate

107:10a very large number, like combinatorially large,

107:14maybe infinite set of what we human physicists

107:18think of as universes?

107:20- That's an interesting parsing of the word universe, right?

107:23Because what we're saying is,

107:25just as we're at a particular place in physical space,

107:27we're at a particular place in Rullio space,

107:30at that particular place in Rullio space,

107:32our experience of the universe is this.

107:34Just as if we lived at the center of the galaxy,

107:36our universe, our experience of the universe

107:38will be different from the one it is

107:40given where we actually live.

107:42And so what we're saying is,

107:44what you might say,

107:47I mean, in a sense,

107:48this Rulliard is sort of a super universe, so to speak,

107:51but it's all entangled together.

107:53It's not like you can separate out.

107:55You can say, let me,

107:57it's like when we take a reference, okay.

107:59It's like our experience of the universe

108:01is based on where we are in the universe.

108:03We could imagine moving to somewhere else in the universe,

108:05but it's still the same universe.

108:07- So there's not like universes

108:09existing in parallel.

108:12- No, no, because,

108:14because, and the whole point is that

108:16if we were able to change our interpretation

108:19of what's going on,

108:20we could perceive a different reference frame

108:24in this Rulliard.

108:25- Yeah, but that's not,

108:26that's not, that's just, yeah,

108:28that's the same Rulliard,

108:30that's the same universe.

108:32You're just moving about.

108:34These are just coordinates in the universe.

108:35- So the way that's,

108:36the reason that's interesting is,

108:38imagine the extraterrestrial intelligence,

108:40so the alien intelligence, we should say.

108:43The alien intelligence might live on Alpha Centauri,

108:47but it might also live at a different place in Rullio space.

108:50- It can live right here on earth.

108:51It just has a different reference frame

108:53that includes a very different perception of the universe.

108:57And then because that Rullio space is very large,

109:02I mean,

109:02- Do we get to communicate with them?

109:05Right, that's.

109:06- Yeah, but it's also,

109:07well, one thing is how different

109:11the perception of the universe could be.

109:14- I think it could be bizarrely,

109:17unimaginably, completely different.

109:19And I mean, one thing to realize is,

109:21even in kind of things I don't understand well,

109:25you know, I know about the kind of Western tradition

109:28of understanding, you know, science

109:30and all that kind of thing.

109:31And, you know, you talk to people who say,

109:33well, I, you know, I'm really into some, you know,

109:37Eastern tradition of this, that, and the other.

109:39And it's really obvious to me how things work.

109:42I don't understand it at all, but, you know,

109:45it is not obvious, I think, with this kind of realization

109:48that there's these very different ways

109:50to interpret what's going on in the universe.

109:52That kind of gives me at least,

109:54it doesn't help me to understand

109:55that different interpretation,

109:57but it gives me at least more respect for the possibility

110:00that there will be other interpretations.

110:01- Yeah, it humbles you to the possibility that like,

110:04what is it, reincarnation,

110:06or all these like eternal recurrence,

110:09when you share like just these ideas, yeah.

110:12- Well, you know, the thing that I've realized

110:14about a bunch of those things is that, you know,

110:15I've been sort of doing my little survey

110:17of the history of philosophy, just trying to understand,

110:20you know, what can I actually say now

110:22about some of these things?

110:23And you realize that some of these concepts,

110:25like the immortal soul concept, which, you know,

110:28I remember when I was a kid and, you know,

110:31it was kind of a lots of religion bashing type stuff

110:34of people saying, you know, well, we know about physics,

110:37tell us how much does a soul weigh?

110:39And people are like, well, how can it be a thing

110:42if it doesn't weigh anything?

110:44Well, now we understand, you know,

110:46there is this notion of what's in brains

110:48that isn't the matter of brains

110:50and it's something computational.

110:52And there is a sense, and in fact, it is correct,

110:54that it is in some sense immortal

110:56because this pattern of computation is something abstract

110:59that is not specific to the particular material of a brain.

111:03Now, we don't know how to extract it, you know,

111:05in our traditional scientific approach,

111:08but it's still something where it isn't a crazy thing

111:11to say there is something, it doesn't weigh anything.

111:14That's a kind of a silly question.

111:16How much does it weigh?

111:18Well, actually, maybe it isn't such a silly question

111:20in our model of physics

111:21because the actual computational activity

111:24has a consequence for gravity and things,

111:26but that's a very subtle--

111:27- You can start talking about mass and energy and so on.

111:30There could be a, what would you call it, a solitron.

111:34- Yes, yes, yes.

111:36- A particle that somehow contains soleness.

111:39- Yeah, right.

111:40Well, that's what, by the way, that's what Leibniz said.

111:43And, you know, one thing, I've never understood this.

111:45You know, Leibniz had this idea of monads and monodology

111:48and he had this idea that what exists in the universe

111:51is this big collection of monads

111:53and that the only thing that one knows about the monads

111:56is sort of how they relate to each other,

111:58which sounds awfully like hypergraphs, right?

112:00But Leibniz had really lost me at the following thing.

112:04He said, "Each of these monads has a soul

112:06"and each of them has a consciousness."

112:09And it's like, okay, I'm out of here.

112:10I don't understand this at all.

112:12I don't know what's going on.

112:13But I realized recently that in his day,

112:16the concept that a thing could do something,

112:19could spontaneously do something,

112:21that was his only way of describing that.

112:23And so what I would now say is,

112:25well, there's this abstract rule that runs

112:28to Leibniz that would have been, you know,

112:30in 1690 or whatever, that would have been kind of,

112:33well, it has a soul, it has a consciousness.

112:36And so, you know, in a sense, it's like one of these,

112:39there's no new idea under the sun, so to speak.

112:41That's a sort of a version of the same kinds of ideas,

112:44but couched in terms that are sort of bizarrely different

112:48from the ones that we would use today.

112:50- Would you be able to maybe play devil's advocate

112:52on your conception of consciousness,

112:55that like the two characteristics of it,

112:58that it's constrained and there's a single thread of time,

113:01is it possible that Leibniz was onto something

113:04that the basic atom, the screwed atom of space

113:09has a consciousness?

113:10So these are just words, right?

113:14But like, is there some sense where consciousness

113:18is much more fundamental than you're making it seem?

113:21- I don't know.

113:22I mean, you know, I think--

113:24- Can you construct a world

113:25in which it is much more fundamental?

113:27- I think that, okay, so the question would be,

113:31is there a way to think about kind of,

113:33if we sort of parse the universe down

113:36at the level of atoms of space or something,

113:38could we say, well, so that's really a question

113:41of a different point of view,

113:42a different place in real space.

113:43We're asking, you're asking the question,

113:45could there be a civilization that exists?

113:48Could there be sort of conscious entities

113:52that exist at the level of atoms of space?

113:54And what would that be like?

113:56And I think that comes back to this question of,

113:58can we, you know, what's it like

113:59to be a cellular automaton type thing?

114:01I mean, it's, you know, I'm not yet there.

114:04I don't know.

114:06I mean, I think that this is a,

114:08and I don't even know yet quite how to think about this

114:12in the sense that I was considering, you know,

114:15I never write fiction, but I haven't written it

114:17since I was like 10 years old.

114:18And my fiction, I made one attempt,

114:20which I sent to some science fiction writer friends of mine,

§15Transcript · 1:54:23–2:02:27

114:23and they told me it was terrible.

114:24So, but--

114:25- This is a long time ago?

114:26- No, it was recently.

114:28- Recently, and they said it was terrible.

114:29That'd be interesting to see you write a short story

114:32based on what sounds like it's already inspiring

114:34short stories by, or stories--

114:37- Yeah, right. - By science fiction writers.

114:38- But I think the interesting thing for me is,

114:42you know, in the what does it,

114:43what is it like to be a whatever?

114:45- Yeah. - How do you describe that?

114:46I mean, it's like, that's not a thing

114:48that you describe in mathematics,

114:49that what is it like to be such and such?

114:51- Well, see, to me, when you say,

114:53what is it like to be something,

114:56presumes that you're talking about a singular entity.

115:01So-- - Yeah.

115:02- Like, there's some kind of feeling of the entity,

115:07the stuff that's inside of it,

115:10and the stuff that's outside of it.

115:12And then that's when consciousness starts making sense.

115:17But then, it seems like that could be generalizable.

115:21If you take some subset of a cellular automata,

115:25you could start talking about what does that subset--

115:29- Maybe. - Feel.

115:30But then you can, I think you could just take

115:32arbitrary numbers of subsets.

115:35Like, to me, like, you and I,

115:38individually are consciousnesses,

115:41but you could also say the two of us together

115:44is a singular consciousness.

115:45- Maybe, maybe.

115:47I'm not so sure about that.

115:48I think that the single thread of time thing

115:50may be pretty important.

115:51And that as soon as you start saying,

115:53there are two different threads of time,

115:55there are two different experiences,

115:57and then we have to say, how do they relate?

115:59How are they sort of entangled with each other?

116:01I mean, that may be a different story

116:03of a thing that isn't much like, you know,

116:06what are the ants?

116:07You know, what's it like to be an ant?

116:08You know, where there's a sort of more collective view

116:11of the world, so to speak.

116:13I don't know.

116:13I think that, I mean, this is, you know,

116:19I don't really have a good, I mean,

116:21you know, my best thought is, you know,

116:23can we turn it into a human story?

116:25It's like the question of, you know,

116:27when we try and understand physics,

116:28can we turn that into something

116:30which is sort of a human understandable narrative?

116:32And now what's it like to be a such and such?

116:35You know, maybe the only medium in which we can describe

116:37that is something like fiction,

116:39where it's kind of like you're telling, you know,

116:42the life story in that setting.

116:45But this is beyond what I've yet understood how to do.

116:49- Yeah, but it does seem so, like with human consciousness,

116:53you know, we're made up of cells,

116:55and like there's a bunch of systems that are networked

116:59that work together that at the human level

117:04feel like a singular consciousness when you take.

117:06- Yes.

117:07- And so maybe like an ant colony is just too low level.

117:11Sorry, an ant is too low level.

117:13Maybe you have to look at the ant colony.

117:16- Yeah, I agree.

117:16- There's some level at which it's a conscious being.

117:20And then if you go to the planetary scale,

117:22then maybe that's going too far.

117:23So there's a nice sweet spot for consciousness.

117:26- No, I agree.

117:28I think the difficulty is that, you know, okay,

117:32so in sort of people who talk about consciousness,

117:35one of the terrible things I've realized,

117:37'cause I've now interacted with some of this community,

117:40so to speak, some interesting people

117:42who do that kind of thinking,

117:44but one of the things I was saying

117:46to one of the leading people in that area,

117:48I was saying that it must be kind of frustrating

117:53because it's kind of like a poetry story.

117:55That is, many people are writing poems,

117:57but few people are reading them.

117:58- Yes.

117:59- So there are always these different,

118:01everybody has their own theory of consciousness,

118:03and they are very non-interdiscussable.

118:08And by the way, I mean, my own approach

118:11to sort of the question of consciousness,

118:13as far as I'm concerned,

118:14I'm an applied consciousness operative, so to speak,

118:17because I don't really, in a sense,

118:19the thing I'm trying to get out of it

118:21is how does it help me to understand

118:23what's a possible theory of physics?

118:25And how does it help me to say,

118:27how do I go from this incoherent collection

118:30of things happening in the universe

118:32to our definite perception and definite laws and so on,

118:35and sort of an applied version of consciousness?

118:38And I think the reason it sort of segues

118:40to a different kind of topic,

118:41but the reason that one of the things

118:44I'm particularly interested in

118:45is kind of what's the analog of consciousness

118:48in systems very different from brains?

118:50And so why does that matter?

118:52Well, this whole description of this kind of,

118:55well, actually, you know what?

118:57We haven't talked about why the universe exists,

118:59so let's get to why the universe exists,

119:01and then we can talk about, perhaps a little bit about

119:05what these models of physics kind of show you

119:09about other kinds of things

119:10like molecular computing and so on.

119:12- Yes, that's good. - Okay,

119:13why does the universe exist?

119:14Okay, so we finally sort of more or less set the stage.

119:17We've got this idea of this Rouliad,

119:19of this object that is made

119:21from following all possible rules,

119:22the fact that it's sort of not just this incoherent mess,

119:26it's got all this entangled structure in it, and so on.

119:29Okay, so what is this Rouliad?

119:32Well, it is the working out of all possible formal systems.

119:37So the sort of the question of why does the universe exist,

119:41its core question, which we kind of started with,

119:43is you've got two plus two equals four,

119:45you've got some other abstract result,

119:48but that's not actualized, it's just an abstract thing.

119:52And when we say we've got a model for the universe,

119:54okay, it's this rule, you run it,

119:56and it'll make the universe, but it's like,

119:58but where's it actually running?

120:01What is it actually doing, right?

120:04What, is it actual,

120:06or is it merely a formal description of something?

120:09Okay, so the thing to realize with this,

120:13the thing about the Rouliad is it's an inevitable,

120:16it is the entangled running of all possible rules.

120:21So you don't get to say, it's not like you're saying,

120:24which Rouliad are you picking?

120:26Because it's all possible formal rules.

120:28It's not like it's just, you know,

120:31well, actually it's only footnote,

120:33the only footnote, it's an important footnote,

120:35is it's all possible computational rules,

120:38not hyper computational rules.

120:41That is, it's running all the rules

120:44that would be accessible to a Turing machine,

120:48but it is not running all the rules

120:50that will be accessible to a thing

120:52that can solve problems in finite time

120:54that would take a Turing machine infinite time to solve.

120:57So you can, even Alan Turing knew this,

120:59that you could make oracles for Turing machines,

121:01where you say a Turing machine can't solve

121:03a halting problem for Turing machines.

121:05It can't know what will happen in any Turing machine

121:07after an infinite time, in any finite time,

121:10but you could invent a box, just make a black box.

121:13You say, I'm gonna sell you an oracle

121:15that will just tell you, you know, press this button,

121:18it'll tell you what the Turing machine

121:19will do after an infinite time.

121:20You can imagine such a box.

121:22You can't necessarily build one in the physical universe,

121:24but you can imagine such a box.

121:26And so we could say, well, in addition to,

121:29so in this Rouliad, we're imagining

121:32that there is a computational, that at the end,

121:35it's running rules that are computational.

121:37It doesn't have a bunch of oracle black boxes in it.

121:42You say, well, why not?

121:44Well, it turns out if there are oracle black boxes,

121:47the Rouliad that is, you can make a sort of super Rouliad

121:50that contains those oracle black boxes,

121:53but it has a cosmological event horizon

121:55relative to the first one, they can't communicate.

121:58In other words, you can end up with,

122:00what you end up happening, what ends up happening

122:03is it's like in the physical universe,

122:06we in this causal graph that represents

122:07the causal relationships of different things,

122:10you can have an event horizon,

122:11where the causal graph is disconnected,

122:14where the effect here, an event happening here

122:17does not affect an event happening here

122:19because there's a disconnection in the causal graph.

122:22And that's what happens in an event horizon.

122:24And so what will happen between this kind of

122:27the ordinary Rouliad and the hyper Rouliad

§16Transcript · 2:02:30–2:12:14

122:30is there is an event horizon and we in our Rouliad

122:35will just never know that there is,

122:39that they're just separate things, they're not connected.

122:43- Maybe I'm not understanding,

122:44but just because we can't observe it,

122:46why does that mean it doesn't exist?

122:49- It might exist, but it's not clear what it,

122:54so what, so to speak, whether it exists.

122:57What we're trying to understand

122:58is why does our universe exist?

123:00We're not trying to ask the question,

123:02what, you know, it's, let me say another thing,

123:06let me make a meta comment, okay?

123:08Which is that I have not thought through

123:11this hyper Rouliad business properly.

123:13So I can't, the--

123:15- The hyper Rouliad is referring to a Rouliad

123:20in which hyper computation is possible.

123:22- That's correct, yes.

123:24- So like what, that footnote,

123:27the footnote to the footnote is,

123:29we're not sure why this is important.

123:33- Yeah, that's right.

123:34So let's ignore that, okay?

123:36It's already abstract enough, okay?

123:38So, okay, so the one question is,

123:42we have to say, if we're saying,

123:45why does the universe exist?

123:46One question is, why is it this universe

123:48and not another universe, okay?

123:51So the important point about this Rouliad idea

123:54is that it's, in the Rouliad are all possible formal systems.

123:59So there's no choice being made.

124:01There's no like, oh, we pick this particular universe

124:04and not that one.

124:05That's the first thing.

124:06The second thing is that we have to ask the question.

124:10So you say, why does two plus two equals four exist?

124:15That's not really a, that is a thing

124:17that necessarily is that way,

124:19just on the basis of the meaning of the terms,

124:21two and plus and equals and so on, right?

124:24So the thing is that this Rouliad object

124:28is in a sense a necessary object.

124:30It is just a thing that is the consequence

124:33of working out the consequence

124:35of the formal definition of things.

124:38You don't, it is not a thing where you're saying,

124:40and this is picked as the particular thing.

124:43This is just something which necessarily is that thing

124:47because of the definition

124:49of what it means to have computation.

124:50- So the Rouliad, it's a formal system.

124:54- Yes.

124:55- But does it exist?

124:58- Ah, well, where are we in this whole thing?

125:03We are part of this Rouliad.

125:05And so our, so there is no sense to say,

125:09does two plus two equals four exist?

125:13Well, that's, in some sense, it necessarily exists.

125:18It's a necessary object.

125:19It's not a thing that where you can ask.

125:21Usually in philosophy, there's a sort of distinction made

125:26between necessary truths, contingent truths,

125:29analytic propositions, synthetic propositions,

125:32there are a variety of different versions of this.

125:34There are things which are necessarily true

125:36just based on the definition of terms.

125:39And there are things which happen to be true in our universe.

125:42- But we don't exist in Roulial space.

125:46That's one of the coordinates that define our existence.

125:50- Well, okay, so yes, yes.

125:53But this Rouliad is the set

125:56of all possible Roulial coordinates.

125:58So what we're saying is it contains that.

126:01So what we're saying is we exist as, okay,

126:04so our perception of what's going on

126:06is we're at a particular place in this Rouliad,

126:09and we are concluding certain things

126:11about how the universe works based on that.

126:13But the question is, do we understand,

126:17is there something where we say,

126:20so why does it work that way?

126:23Well, the answer is, I think it has to work that way

126:27because this Rouliad is a necessary object

126:32in the sense that it is a purely formal object,

126:35just like two plus two equals four.

126:37It's not an object that was made of something.

126:40It's an object that is just an expression

126:43of the necessary collection of formal relations that exist.

126:47And so then the issue is, can we, in our experience of that,

126:52is it, can we have tables and chairs, so to speak,

126:56in that just by virtue of our experience

126:59of that necessary thing?

127:01And what people have generally thought,

127:03and honestly, I don't know of a lot of discussion of this

127:07why does the universe exist question.

127:09It's been a very, I've been surprised, actually,

127:12at how little, I mean, I think it's one of these things

127:15that's really kind of far out there.

127:18But the thing that is, the surprise here

127:22is that all possible formal rules,

127:26when you run them together, and that's the critical thing,

127:29when you run them together,

127:30they produce this kind of entangled structure

127:32that has a definite structure.

127:34It's not just a random arbitrary thing.

127:38It's a thing with definite structure.

127:40And that structure is the thing,

127:42when we are embedded in that structure,

127:44when an entity embedded in that structure

127:48perceives something which is,

127:51then we can interpret as physics and things like this.

127:54So in other words, we don't have to ask the question,

127:57why does it exist?

127:59It necessarily exists.

128:01- I'm missing this part.

128:02Why does it necessarily exist?

128:04- Okay, let me try.

128:05- So like you need to have it if you want to formalize

128:09the relation between entities,

128:11but why do you need to have relations?

128:15- Okay, okay.

128:16So let's say you say, well-

128:20- It's like, why does math have to exist?

128:25- Okay, fair question.

128:27Yeah, okay, fair question.

128:29Let's see.

128:31I think the thing to think about is

128:33the existence of mathematics is something where,

128:36given a definition of terms,

128:40what follows from that definition inevitably follows.

128:44So now you can say, why define any terms?

128:48But in a sense, the, well, that's okay.

128:53So the definition of terms, I mean,

128:55I think the way to think about this, let me see.

128:58- So like concrete terms.

129:02- Well, not very concrete.

129:04I mean, they're just things like, you know,

129:09logical or.

129:10- Right, but that's a thing.

129:12That's a powerful thing.

129:14- Well, it's a, yes, okay.

129:15But it's a, the point is that it is not a thing of a,

129:19you know, people imagine there is, I don't know,

129:22the, you know, an elephant or something,

129:25or the, you know, elephants are presumably

129:29not necessary objects.

129:31They are, they happen to exist as a result of

129:34kind of biological evolution and whatever else.

129:37But the thing is that in some sense,

129:41that there is, it is a different kind of thing

129:44to say does plus exist.

129:46It is not like an elephant.

129:49- So a plus is, seems more fundamental,

129:51more basic than an elephant, yes.

129:54But you can imagine a world without plus

129:58or anything like it.

130:00Like why do formal things that are discrete,

130:04that can be used to reason have to exist?

130:09- Well, okay, so why, okay, so then the question is,

130:12but the whole point is computation,

130:15we can certainly imagine computation.

130:18That is, we can certainly say there is a formal system

130:21that we can construct abstractly in our minds

130:24that is computation.

130:26And that's the, you know, we can imagine it, right?

130:32Now the question is, is it is that formal system,

130:37once we exist as observers embedded in that formal system,

130:41that's enough to have something which is like our universe.

130:45And so then what you're kind of asking is perhaps,

130:49is why, I mean, the point is we definitely can imagine it.

130:54There's nothing that says that,

130:56we're not saying that there's,

130:59it's sort of inevitable that that is a thing

131:03that we can imagine.

131:04We don't have to ask, does it exist?

131:06We're just, it is definitely something we can imagine.

131:09Now that's, then we have this thing

131:12that is a formally constructible thing that we can imagine.

131:16And now we have to ask the question,

131:18what, you know, given that formally constructible thing,

131:22what is, what consequences does that,

131:25if we were to perceive that formally,

131:28if we were embedded in that formally constructible thing,

131:31what would we perceive about the world?

131:33And we would say, we perceive that the world exists

131:38because we are seeing all of this mechanism

131:41of all these things happening.

131:42And, but that's something that is just a feature of,

131:46it's something where we are--

131:48- See another way of asking this,

131:50that I'm trying to get at,

131:52I understand why it feels like this Rouliad

131:57is necessary,

131:59but maybe it's just me being human,

132:03but it feels like then you should be able to,

132:07not us, but somehow step outside of the Rouliad.

132:11Like what's outside the Rouliad?

132:14- Well, the Rouliad is all formal systems.

§17Transcript · 2:12:16–2:20:50

132:16So there's nothing because--

132:18- But that's what a human would say.

132:20- I know that's what a human would say

132:21'cause we're used to the idea that there's,

132:24but the whole point is that

132:26by the time it's all possible formal systems,

132:28it's like, it is all things you can imagine, but--

132:34- Not all computations you can imagine,

132:37but like we don't--

132:39- Well, so the issue is can we encode?

132:41Okay, so that's a fair question.

132:44Is it possible to encode all,

132:47I mean, once we,

132:50is there something that isn't

132:51what we can represent formally?

132:53- Right.

132:54- That is, is there something that,

132:56and that's I think related to the hyper-Rouliad footnote,

132:59so to speak, of which I'm afraid that the,

133:04one of the things sort of interesting about this is,

133:07there has been some discussion of this in theology

133:09and things like that,

133:11but which I don't necessarily understand all of,

133:15but the key sort of new input is this idea

133:20that all possible formal systems,

133:23it's like, if you make a world,

133:25people say, well, you make a world

133:27with a particular, in a particular way,

133:30with particular rules, but no, you don't do that.

133:32You can make a world that deals with all possible rules

133:35and then merely by virtue of living in a particular place

133:40in that world, so to speak,

133:42we have the perception we have of what the world is like.

133:45Now, I have to say,

133:46it's sort of interesting 'cause I've,

133:50I wrote this piece about this

133:51and I, this philosophy stuff is not super easy

133:56and I've, as I'm talking to you about it

133:59and I actually haven't,

134:01people have been interested in lots of different things

134:02we've been doing, but this, why does the universe exist,

134:05has been, I would say, one of the ones

134:08that you would think people would be most interested in,

134:11but actually, I think they're just like,

134:13oh, that's just something complicated that,

134:16so I haven't explained it as much

134:19as I've explained a bunch of other things

134:21and I have to say, I think I may be missing

134:23a couple of pieces of that argument that would be,

134:27so it's kind of like--

134:29- Well, you're conscious being is computationally bounded,

134:33so you're missing-- - Indeed.

134:34- Having written quite a few articles yourself,

134:38you're now missing some of the pieces.

134:40- Yes, well, it's always-- - That's the limitation

134:41of being human.

134:42- Right, one of the consequences of this,

134:44why the universe exists thing and this kind of concept

134:48of Rouillades and places in there representing

134:53our perception of the universe and so on,

134:55one of the weird consequences is,

134:57if the universe exists, mathematics must also exist.

135:01And that's a weird thing because mathematics,

135:05people have been very confused, including me,

135:07have been very confused about the question

135:11of kind of what is the foundation of mathematics?

135:15What is, what kind of a thing is mathematics?

135:17Is mathematics something where we just write down axioms

135:21like Euclid did for geometry and we just build the structure

135:24and we could have written down different axioms

135:26and we'd have a different structure?

135:28Or is it something that has a more fundamental

135:30sort of truth to it?

135:32And I have to say, it's one of these cases where

135:34I've long believed that mathematics has a great deal

135:37of arbitrariness to it, that there are particular axioms

135:39that kind of got written down by the Babylonians

135:42and that's what we've ended up with the mathematics

135:45that we have.

135:46And I have to say, actually, my wife has been telling me

135:48for 25 years, she's a mathematician,

135:50she's been telling me, "You're wrong about the foundations

135:52"of mathematics."

135:53And I'm like, "No, no, no, I know what I'm talking about."

135:57And finally, she's much more right than I've been.

136:02So it's one of the--

136:03- So I mean, her sense and your sense, are we just,

136:08so this is to the question of mathematics,

136:11are we just kind of on a trajectory through

136:14ruleal space except in mathematics,

136:17is there a trajectory, a certain kind of--

136:19- I think that's partly the idea.

136:21So I think that the notion is this.

136:22So 100 years ago, a little bit more than 100 years ago,

136:26well, people have been doing mathematics for ages,

136:28but then in the late 1800s, people decided to try

136:31and formalize mathematics and say,

136:33mathematics is, we're gonna break it down,

136:37we're gonna make it like logic, we're gonna make it

136:39out of sort of fundamental primitives.

136:42And that was people like Frege and Piano and Hilbert

136:44and so on, and they kind of got this idea of,

136:47let's do kind of Euclid, but even better,

136:50let's just make everything just in terms of this sort of

136:52symbolic axioms, and then build up mathematics from that.

136:56And that, they thought at the time,

136:59as soon as they get these symbolic axioms,

137:02that they made the same mistake,

137:03the kind of computational irreducibility mistake.

137:06They thought as soon as we've written down the axioms,

137:09then it'll just, we'll just have a machine,

137:11kind of a super Mathematica, so to speak,

137:13that can just grind out all true theorems of mathematics.

137:17That got exploded by Godel's theorem,

137:20which is basically the story

137:21of computational irreducibility.

137:23It's that even though you know those underlying rules,

137:25you can't deduce all the consequences in any finite way.

137:29And so that was, but now the question is,

137:32okay, so they broke mathematics down into these axioms,

137:35and they say, now you build up from that.

137:37So what I'm increasingly coming to realize is,

137:41that's similar to saying, let's take a gas

137:44and break it down into molecules.

137:46There's gas laws that are the large scale structure

137:49and so on that we humans are familiar with,

137:52and then there's the underlying molecular dynamics.

137:54And I think that the axiomatic level of mathematics,

137:57which we can access with automated theorem proving

138:00and proof assistance and these kinds of things,

138:02that's the molecular dynamics of mathematics.

138:05And occasionally we see through to that molecular dynamics.

138:08We see undecidability, we see other things like this.

138:11One of the things I've always found very mysterious

138:13is that Godel's theorem shows that there are sort of things

138:18which cannot be finitely proved in mathematics.

138:20There are proofs of arbitrary length,

138:22infinite length proofs that you might need.

138:24But in practical mathematics,

138:26mathematicians don't typically run into this.

138:28They just happily go along doing their mathematics.

138:31And I think what's actually happening is that

138:33what they're doing is they're looking at this,

138:36they are essentially observers in meta-mathematical space,

138:41and they are picking a reference frame

138:43in meta-mathematical space,

138:45and they are computationally bounded observers

138:47of meta-mathematical space,

138:49which is causing them to deduce

138:52that the laws of meta-mathematics

138:54and the laws of mathematics,

138:55like the laws of fluid mechanics,

138:57are much more understandable

138:59than this underlying molecular dynamics.

139:01And so what gets really bizarre is thinking about

139:05kind of the analogy between meta-mathematics,

139:08this idea of you exist in this kind of,

139:11in this sort of space of possible,

139:16in this kind of mathematical space

139:17where the individual kind of points

139:20in the mathematical space are statements in mathematics,

139:24and they're connected by proofs,

139:26where one statement, you know,

139:27you take a couple of different statements,

139:29you can use those to prove some other statement,

139:31and you've got this whole network of proofs.

139:33That's the kind of causal network of mathematics,

139:35of what can prove what, and so on.

139:38And you can say at any moment

139:40in the history of a mathematician,

139:42of a single mathematical consciousness,

139:45you are in a single kind of slice

139:48of this kind of meta-mathematical space.

139:51You know a certain set of mathematical statements.

139:54You can then deduce with proofs,

139:55you can deduce other ones, and so on.

139:57You're kind of gradually moving

139:59through meta-mathematical space.

140:01And so it's kind of the view is

140:03that the reason that mathematicians perceive mathematics

140:07to have the sort of integrity

140:08and lack of kind of undecidability and so on that they do,

140:11is because they, like we as observers

140:14of the physical universe,

140:15we have these limitations associated

140:17with computational boundedness, single thread of time,

140:20consciousness limitations, basically,

140:22that the same thing is true of mathematicians

140:24perceiving sort of meta-mathematical space.

140:26And so what's happening is that when you look at,

140:29if you look at one of these formalized mathematics systems,

140:32something like Pythagoras' theorem,

140:34it'll be, it'll take, oh, I don't know, what is it?

140:38Maybe 10,000 individual little steps

140:41to prove Pythagoras' theorem.

140:43And one of the bizarre things,

140:45that's sort of an empirical fact

140:46that I'm trying to understand a little bit better,

140:48if you look at different proof,

140:50if you look at different formalized mathematics systems,

§18Transcript · 2:20:52–2:28:26

140:52they actually have different axioms underneath,

140:55but they can all prove Pythagoras' theorem.

140:57And so, in other words,

140:58it's a little bit like what happens with gases.

141:01We can have air molecules, we can have water molecules,

141:03but they still have fluid dynamics.

141:05Both of them have fluid dynamics.

141:06And so similarly, at the level that mathematics,

141:09that mathematicians care about mathematics,

141:11it's way above the molecular dynamics, so to speak.

141:14And there are all kinds of weird things,

141:16like for example, one thing I was realizing recently

141:18is that the quantum theory of mathematics,

141:20that's a very bizarre idea.

141:22But basically, when you prove what is, you know,

141:25a proof is you've got one statement in mathematics,

141:29you go through other statements,

141:30you eventually get to a statement

141:31you're trying to prove, for example,

141:33that's a path in metamathematical space.

141:36And that's a single path, a single proof is a single path.

141:39But you can imagine there are other proofs

141:41of the same result.

141:43There are a bundle of proofs.

141:45There's this whole set of possible proofs.

141:47- You could think of it as branching,

141:48similar to the quantum mechanics model

141:50that you were talking about.

141:51- Exactly, and so-

141:52- And then there's some invariance that you can formalize

141:54in the same way that you can for the quantum mechanical.

141:56- Right, so the question is in proof space,

141:59you know, as you start thinking about multiple proofs,

142:01are there analogs of, for example,

142:03destructive interference of multiple proofs?

142:05So here's a bizarre idea, it's just a couple of days old,

142:08so not yet fully formed.

142:10But as you try and do that,

142:12when you have two different proofs,

142:14it's like two photons going in different directions.

142:16You have two proofs which at an intermediate stage

142:19are incompatible.

142:20And that's kind of like destructive interference.

142:22- Is it possible for this to instruct the engineering

142:25of automated proof systems?

142:28- Absolutely, I mean, as a practical matter,

142:29I mean, you know, this whole question,

142:32in fact, Jonathan Gorad has a nice heuristic

142:34for automated theorem provers

142:35that's based on our physics project

142:37that is looking for essentially using kind of,

142:42using energy, in our models,

142:44energy is kind of level of activity in this hypergraph.

142:49And so there's sort of a heuristic

142:51for automated theorem proving

142:52about how do you pick which path to go down

142:56that is based on essentially physics.

142:59And I mean, the thing that gets interesting about this

143:02is the way that one can sort of have the interplay

143:04between like, for example, a black hole.

143:06What is a black hole in mathematics?

143:09So the answer is, what is a black hole in physics?

143:11A black hole in physics is where,

143:14in the simplest form of black hole, time ends.

143:16That is all, you know, everything is crunched down

143:20to the space-time singularity

143:21and everything just ends up at that singularity.

143:24So in our models, and that's a little hard to understand

143:27in general relativity with continuous mathematics

143:29and what does singularity look like.

143:31In our models, it's something very pragmatic.

143:33It's just, you're applying these rules,

143:35time is moving forward,

143:36and then there comes a moment where the rules,

143:38no rules apply, so time stops.

143:41It's kind of like the universe dies.

143:42There's, you know, nothing happens in the universe anymore.

143:45Well, in mathematics, that's a decidable theory.

143:49That's a theory, so theories which have undecidability,

143:52which are things like arithmetic, set theory,

143:54all the serious models, theories in mathematics,

143:57they all have the feature that there are proofs

143:59of arbitrary long length.

144:01In something like Boolean algebra,

144:03which is a decidable theory,

144:04there are, you know, any question in Boolean algebra,

144:07you can just go crunch, crunch, crunch,

144:08and in a known number of steps, you can answer it.

144:11You know, satisfiability, you know, might be hard,

144:14but it's still a bounded number of steps

144:16to answer any satisfiability problem.

144:18And so that's the notion of a black hole in physics

144:22where time stops.

144:24That's analogous to in mathematics

144:27where there aren't infinite length proofs.

144:29Where when in physics, you know,

144:32you can wander around the universe forever

144:34if you don't run into a black hole.

144:35If you run into a black hole and time stops, you're done.

144:38And it's the same thing in mathematics

144:40between decidable theories and undecidable theories.

144:43So it's an example, and I think we're sort of,

144:46the attempt to understand, so another question is kind of,

144:49what is the generativity of metamathematics?

144:54What is the bulk theory of metamathematics?

144:57So in the literature of mathematics,

144:59there are about 3 million theorems

145:00that people have published.

145:02And those represent, it's kind of on this,

145:04it's like on the earth, we would be, you know,

145:09we've put cities in particular places on the earth,

145:11but yet there is ultimately, you know,

145:13we know the earth is roughly spherical

145:15and there's an underlying space.

145:17And we could just talk about, you know,

145:19the world of space in terms of where our cities

145:21happen to be, but there's actually an underlying space.

145:24And so the question is, what's that for metamathematics?

145:27And as we kind of explore what is, for example,

145:29for mathematics, which is always likes taking

145:32sort of abstract limits.

145:33So an obvious abstract limit for mathematics to take

145:36is the limit of the future of mathematics.

145:38That is, what will be, you know,

145:40the ultimate structure of mathematics?

145:43And one of the things that's an empirical observation

145:45about mathematics that's quite interesting

145:47is that a lot of theories in one area of mathematics,

145:50algebraic geometry or something, might have,

145:53they play into another area of mathematics.

145:55That same kind of a fundamental construct

145:59seem to occur in very different areas of mathematics.

146:02And that's structurally captured a bit

146:03with category theory and things like that.

146:05But I think that there's probably an understanding

146:08of this metamathematical space that will explain

146:11why different areas of mathematics

146:12ultimately sort of map into the same thing.

146:15And I mean, you know, my little challenge to myself

146:17is what's time dilation in metamathematics?

146:22In other words, as you basically,

146:24as you move around in this mathematical space

146:26of possible statements, you know,

146:29what's, how does that moving around?

146:31It's basically what's happening is that

146:34as you move around in the space of mathematical statements,

146:36it's like you're changing from algebra to geometry

146:38to whatever else.

146:39And you're trying to prove the same theorem.

146:42But as you try, if you keep on moving

146:44to these different places,

146:45it's slower to prove that theorem

146:47'cause you keep on having to translate what you're doing

146:49back to where you started from.

146:50And that's kind of the beginnings of the analog

146:52of time dilation in metamathematics.

146:54- Plus there's probably fractional dimensions

146:56in this space as well.

146:58- Oh, this space is a very messy space.

147:00This space is much messier than physical space.

147:02I mean, even in the models of physics,

147:05physical space is very tame

147:08compared to branchial space and ruleal space.

147:10I mean, the mathematical structure, you know,

147:13branchial space is probably more like Hilbert space,

147:15but it's a rather complicated Hilbert space.

147:17And ruleal space is more like this weird

147:21infinity groupoid story of growth and decay.

147:24And I can explain that a little bit

147:25because in metamathematical space,

147:29a path in metamathematical space

147:32is a path between two statements

147:35is a way to get by proofs,

147:37is a way to find a proof

147:38that goes from one statement to another.

147:41And so one of the things you can do,

147:42you can think about is you've got,

147:44between statements, you've got proofs.

147:46They are paths between statements.

147:48Okay, so now you can go to the next level

147:50and you can ask,

147:51what about a mapping from one proof to another?

147:54And so that's in category theory,

147:56that's kind of a higher category,

147:58a notion of higher categories

148:00where you're mapping not just between objects,

148:04but you're mapping between the mappings

148:05between objects and so on.

148:07And so you can keep doing that.

148:09You can keep saying higher order proofs.

148:10I want mappings between proofs between proofs and so on.

148:14And that limiting structure,

148:15oh, by the way,

148:16one thing that's very interesting is

148:18imagine in proof space,

148:19you've got these two proofs.

148:21And the question is,

148:22what is the topology of proof space?

148:24In other words, if you take these two paths,

148:26can you continuously deform them into each other?

§19Transcript · 2:28:29–2:35:43

148:29Or is there some big hole in the middle

148:31that prevents you from continuously deforming them

148:33one into the other?

148:34It's kind of like,

148:35when you think about some,

148:36I don't know, some puzzle, for example,

148:38you're moving pieces around on some puzzle,

148:40and you can think about the space

148:42of possible states of the puzzle,

148:44and you can make this graph that shows

148:46from one state of the puzzle

148:47to another state of the puzzle and so on.

148:49And sometimes you can easily get

148:51from one state to any other state,

148:52but sometimes there'll be a hole in that space.

148:55And there'll be,

148:56you always have to go around the circuitous route

148:58to get from here to there.

149:00There won't be any direct way.

149:01That's kind of a question

149:03of whether there's sort of an obstruction in the space.

149:06And so the question is, in proof space,

149:09what is the, what are,

149:11what does it mean if there's an obstruction in proof space?

149:14- Yeah, I don't even know what an obstruction means

149:17in proof space,

149:18'cause for it to be an obstruction,

149:20it should be reachable some other way

149:22from some other place, right?

149:24So this is like an unreachable part of the graph.

149:27- No, it's not just an unreachable part.

149:29It's a part where there are paths that go one way,

149:32there are paths that go the other way.

149:33And this question of homotopy and mathematics

149:35is this question, can you continuously deform,

149:38from one path to another path,

149:40or do you have to go in a jump, so to speak?

149:42So if you're going around a sphere, for example,

149:45if you're going around, I don't know,

149:47a cylinder or something, you can wind around one way

149:50and you can, there's no,

149:51there are paths where you can easily deform one path

149:55into another, because it's just sort of sitting

149:56on the same side of the cylinder.

149:58But when you've got something

149:59that winds all the way around a cylinder,

150:00you can't continuously deform that down to a point

150:03because it's stuck, wrapped around a cylinder.

150:05- My intuition about proof spaces,

150:07you should be able to deform it.

150:08I mean that, 'cause then otherwise

150:09it doesn't even make sense.

150:10'Cause if the topology matters

150:13of the way you move about the space,

150:15then I don't even know what that means.

150:17- Well, what it would mean is that you would have

150:19one way of doing a proof of something over here in algebra

150:23and another way of doing a proof of something

150:25over here in geometry,

150:26and there would not be an intermediate way

150:29to map between those proofs.

150:30- But how would that be possible

150:32if they start at the same place and end at the same place?

150:35- Well, it's the same thing as we've got points on a,

150:39if we've got paths on a cylinder.

150:41- Now I understand how it works in physical space,

150:43but it just doesn't,

150:44it feels like proof space shouldn't have that.

150:47Okay, I mean--

150:48- I'm not sure, I don't know.

150:49We'll know very soon,

150:50'cause we get to do some experiments.

150:52This is the great thing about this stuff,

150:53is that in fact, in the next few days,

150:57I hope to do a bunch of experiments on this.

150:58- So you're playing with like proofs in this kind of space?

151:02- Yes, yes.

151:03I mean, so this is toy theories,

151:06and we've got good,

151:08so this kind of segues to perhaps another thing,

151:10which is this whole idea of multi-computation.

151:13So this is another kind of bigger idea that,

151:18so, okay, this has to do with

151:20how do you make models of things?

151:22And it's going to, it's some,

151:25so I've sort of claimed that there've been sort of four epochs

151:28in the history of making models of things.

151:31And this multi-computation thing is the fourth,

151:35is a new epoch.

151:36- What are the first three?

151:38- The first one is back in antiquity,

151:40ancient Greek times,

151:42people were like, what's the universe made of?

151:44Oh, it's made of, you know, everything is water, Thales,

151:47you know, or everything is made of atoms.

151:50It's sort of what are things made of?

151:53Or, you know, there are these crystal spheres

151:55that represent where the planets are, and so on.

151:58It's like a structural idea

151:59of how the universe is constructed.

152:01There's no real notion of dynamics,

152:03it's just what is the universe, how is the universe made?

152:06Then we get to the 1600s,

152:08and we get to the sort of revolution of mathematics

152:11being introduced into physics.

152:12And then we have this kind of idea

152:15of you write down some equation,

152:18the what happens in the universe

152:20is the solving of that equation,

152:22time enters, but it's usually just a parameter.

152:25We just can, you know, sort of slide it back and forth

152:28and say, here's where it is.

152:30Okay, then we come to this kind of computational idea

152:33that I kind of started really pushing in the early 1980s.

152:38As a result, you know, the things we were talking about

152:40before about complexity, that was my motivation,

152:43but the bigger story was the story

152:45of kind of computational models of things.

152:47And the big difference there from the mathematical models

152:50is in mathematical models, there's an equation,

152:52you solve it, you got kind of slide time

152:55to the place where you want it.

152:57In computational models, you give the rule

153:00and then you just say, go run the rule.

153:02And time is not something you get to slide,

153:05time is something where it just, you run the rule,

153:07time goes in steps, and that's how you work out

153:12how the system behaves.

153:13You don't, time is not just a parameter,

153:15time is something that is about the running of these rules.

153:19And so there's this computational irreducibility,

153:21you can't jump ahead in time,

153:23but there's still, important thing is

153:25there's still one thread of time.

153:27It's still the case, you know, the cellular automaton state,

153:29then it has the next state and the next state and so on.

153:32The thing that is kind of, we've sort of tipped off

153:35by quantum mechanics in a sense,

153:36although it actually feeds back even into relativity

153:39and things like that,

153:41that there are these multiple threads of time.

153:43And so in this multi-computation paradigm,

153:46the kind of idea is, instead of there being

153:48this single thread of time,

153:50there are these kind of distributed asynchronous threads

153:52of time that are happening.

153:54And the thing that's sort of different there

153:56is if you want to know what happened,

153:58if you say what happened in the system,

154:01in the case of the computational paradigm,

154:03you just say, well, after a thousand steps,

154:06we got this result, right?

154:08But in the multi-computational paradigm,

154:10after a thousand steps,

154:11not even clear what a thousand steps means,

154:13because you've got all these different threads of time,

154:15but there is no state.

154:17There's all these different possible,

154:19you know, there's all these different parts.

154:21And so the only way you can know what happened

154:22is to have some kind of observer who is saying,

154:25here's how to parse the results of what was going on.

154:28- Right, but that observer is embedded

154:30and they don't have a complete picture, so.

154:32- In the case of physics, that's right, yes.

154:34And then, but that's, but so the idea is

154:37that in this multi-computation setup,

154:39that it's this idea of these multiple threads of time

154:42and models that are based on that.

154:44And this is similar to what people think about

154:47in non-deterministic computation.

154:49So you have a Turing machine,

154:50usually it has a definite state,

154:52it follows another state, it follows another state.

154:54But typically what people have done

154:55when they've thought about these kinds of things

154:57is they've said, well, there are all these possible paths,

155:00a non-deterministic Turing machine

155:01can follow all these possible paths,

155:03but we just want one of them.

155:04We just want the one that's the winner,

155:06that factors the number or whatever else.

155:08And similarly, you know, it's the same story

155:10in logic programming and so on,

155:11where we say, we've got this goal,

155:13find us a path to that goal.

155:15I just want one path, then I'm happy.

155:17Or theorem proving, same story.

155:19I just want one proof and then I'm happy.

155:21What's happening in multi-computation in physics

155:24is we actually care about many paths.

155:27And well, there is a case, for example,

155:29probabilistic programming is a version of multi-computation

155:31in which you're looking at all the paths,

155:33you're just asking for probabilities of things.

155:36But in a sense in physics,

155:38we're taking different kinds of samplings.

155:40For example, in quantum mechanics,

155:41we're taking a different kind of sampling

155:43of all these multiple paths.

§20Transcript · 2:35:46–2:43:35

155:46But the thing that is notable

155:48is that when you're an observer embedded in this thing,

155:51et cetera, et cetera, et cetera,

155:53with various other sort of footnotes and so on,

155:56it is inevitable that the thing that you parse

155:59out of the system looks like general relativity

156:02and quantum mechanics.

156:04In other words, that just by the very structure

156:06of this multi-computational setup,

156:08it inevitably is the case

156:11that you have certain emergent laws.

156:14Now, why is this perhaps not surprising?

156:18In thermodynamics and statistical mechanics,

156:20there are sort of inevitable emergent laws

156:22of sort of gas dynamics that are independent

156:25of the details of the molecular dynamics,

156:28sort of the same kind of thing.

156:30But I think what happens is,

156:31what's a sort of a funny thing

156:32that I've just been understanding very recently

156:35is when I kind of introduced this whole

156:39sort of computational paradigm complexity-ish thing

156:42back in the '80s, it was kind of like a big downer

156:45because it's like there's a lot of stuff you can't say

156:47about what systems will do.

156:49And then what I realized is,

156:50and then you might say, now we've got multi-computation,

156:52it's even worse.

156:53You know, it isn't just one thread of time

156:55that we can't explain, it's all these threads of time

156:57we can't explain anything.

156:58But the following thing happens.

157:01Because there is all this irreducibility

157:04and any detailed thing you might want to answer,

157:06it's very hard to answer.

157:08But when you have an observer

157:10who has certain characteristics

157:12like computational boundedness,

157:13sequentiality of time and so on,

157:15that observer only samples certain aspects

157:19of this incredible complexity going on

157:21in this multi-computational system.

157:22And that observer is sensitive only to

157:26some underlying core structure

157:28of this multi-computational system.

157:30There is all this irreducible computation going on,

157:32all these details, but to that kind of observer,

157:35what's important is only the core structure

157:38of multi-computation, which means that observer

157:41observes comparatively simple laws.

157:44And I think it is inevitable that that observer

157:47observes laws which are mathematically structured

157:50like general relativity and quantum mechanics,

157:52which by the way are the same law in our model of physics.

157:56- So that's an explanation why there's simple laws

157:58that explain a lot for this observer.

158:01- Potentially, yes.

158:02But the place where this gets really interesting

158:06is there are all these fields of science

158:09where people have kind of gotten stuck,

158:10where they say we'd really love to have

158:12a physics-like theory of economics.

158:14We'd really love to have a physics-like law in linguistics.

158:18- We gotta talk about molecular biology here.

158:20- Okay.

158:21- So where does multi-computation come in for biology?

158:24Economics is super interesting too, but biology--

158:26- Okay, let's talk about that.

158:27So let's talk about chemistry for a second, okay?

158:30So I mean, I have to say, you know,

158:32this is, it's such a weird business for me

158:34because, you know, there are these kind of

158:35paradigmatic ideas and then the actual applications.

158:38And it's like I've always said,

158:39I know nothing about chemistry.

158:41I learned all the chemistry I know, you know,

158:42the night before some exam when I was 14 years old.

158:45But I've actually learned a bunch more chemistry.

158:47And in Wolfram language these days,

158:49we have really pretty nice symbolic

158:50representation of chemistry.

158:52And in understanding the design of that,

158:54I've actually, I think, learned a certain amount of chemistry

158:56that if you quizzed me on sort of basic high school

158:58chemistry, I would probably totally fail.

159:01But, okay, so what is chemistry?

159:04I mean, chemistry is sort of a story of, you know,

159:07chemical reactions are like you've got

159:09this particular chemical, it's represented

159:11as some graph of, you know, these are,

159:14these are this configuration of molecules

159:15with these bonds and so on.

159:17And a chemical reaction happens,

159:19you've got these sort of two graphs,

159:21they interact in some way, you've got another graph

159:23or multiple other graphs out.

159:24So that's kind of the, the sort of the abstract view

159:28of what's happening in chemistry.

159:30And so when you do a chemical synthesis, for example,

159:33you are given certain sort of these are possible reactions

159:36that can happen, and you're asked, can you piece together

159:40this sequence of such reactions, a sequence of such sort of

159:43axiomatic reactions, usually called name reactions

159:45in chemistry, can you piece together a sequence

159:48of these reactions so that you get out at the end

159:51this great molecule you were trying to synthesize?

159:53And so that's a story very much like theorem proving.

159:56And people have done, actually, they started in the 1960s,

159:59looking at kind of the theorem proving approach to that,

160:02although it didn't really, it didn't, it didn't,

160:05was sort of done too early, I think.

160:07But anyway, so that's kind of the view is that chemistry,

160:10chemical reactions are the story of all these different

160:12sort of paths of possible things that go on.

160:16Okay, let's go to an even lower level.

160:18Let's say, instead of asking about which species

160:22of molecules we're talking about,

160:24let's look at individual molecules.

160:26And let's say we're looking at individual molecules,

160:28and they are having chemical reactions,

160:30and we're building up this big graph

160:32of all these reactions that are happening, okay?

160:34So then we've got this big graph, and by the way,

160:37that big graph is incredibly similar

160:40to these hypergraph rewriting things.

160:42In fact, in the underlying theory of multi-computation,

160:45there are these things we call token event graphs,

160:48which are basically, you've broken your state into tokens,

160:52like in the case of a hypergraph,

160:53you've broken it into hyperedges,

160:55and each event is just consuming some number of tokens

160:58and producing some number of tokens.

161:00- Yeah, but then you have to,

161:01there's a lot of work to be done on update rules.

161:04- In terms of what they actually are for chemistry?

161:06- Yeah, what they are for our observed chemistry.

161:09- Yes, indeed, yes, indeed.

161:11We've been working on that, actually,

161:12because we have this beautiful system in Wolfram language

161:15for representing chemistry symbolically.

161:17So we actually have, this is an ongoing thing

161:20to actually figure out what they are

161:21for some practical cases.

161:22- Does that require human injection,

161:24or can it be automatically discovered, these update rules?

161:28- Well, if we could do quantum chemistry better,

161:30we could probably discover them automatically,

161:31but I think in reality right now,

161:34it's like there are these particular reactions.

161:36And really, to understand what's going on,

161:38we're probably gonna pick a particular subtype of chemistry,

161:41and just, because let me explain where this is going.

161:44The place that, here's where this is going.

161:47So, you've got this whole network of all these molecules

161:51having all these reactions and so on.

161:53And this is some whole multi-computational story,

161:55because each sort of chemical reaction event

162:00is its own separate event.

162:02We're saying they all happen asynchronously.

162:03We're not describing in what order they happen.

162:06Maybe that order is governed

162:08by some quantum mechanics thing, doesn't really matter.

162:10We're just saying they happen in some order.

162:12And then we ask, what is the,

162:14how do we think about the system?

162:17Well, this thing is some kind

162:20of big multi-computational system.

162:21The question is, what is the chemical observer?

162:24And one possible chemical observer is,

162:26all you care about is,

162:27did you make that particular drug molecule?

162:29You're just asking for the one path.

162:31Another thing you might care about is,

162:33I want to know the concentration of each species.

162:36I want to know, at every stage,

162:39I'm going to solve the differential equations

162:40that represent the concentrations,

162:42and I want to know what those all are.

162:44But there's more, because when,

162:46and it's kind of like,

162:47you're going below in statistical mechanics,

162:50there's kind of all these molecules bouncing around,

162:52and you might say, we're just going to ignore,

162:56we're just going to look at the aggregate densities

162:59of certain kinds of molecules,

163:00but you can look at a lower level.

163:01You can look at this whole graph of possible interactions.

163:04And so, the kind of the idea would be,

163:07what, is the only chemical observer,

163:10one who just cares about overall concentrations,

163:13or can there be a chemical observer

163:15who cares about this network of what happened?

163:17And so, that, the question then is,

163:20so let me give an analogy.

163:22So this is where I think this is potentially

163:23very relevant to molecular biology and molecular computing.

163:27When we think about a computation,

163:29usually we say it's input, it's output.

163:32We, you know, or chemistry, we say, there's this input,

163:35we're going to make this molecule as the output.

§21Transcript · 2:43:38–2:51:29

163:38But what if what we actually encode,

163:41what if our computation,

163:42what if the thing we care about

163:44is some part of this dynamic network?

163:46What if it isn't just the input and the output

163:48that we care about?

163:49What if there's some dynamics of the network

163:51that we care about?

163:52Now, imagine you're a chemical observer.

163:54What is a chemical observer?

163:56Well, in molecular biology,

163:57there are all kinds of weird sorts of observers.

164:00There are membranes that exist

164:02that have, you know, different kinds of molecules

164:04that can bind to them, things like this.

164:06It's not obvious that the, from a human scale,

164:10we just measure the concentration of something,

164:12is the relevant story.

164:13We can imagine that, for example,

164:15when we look at this whole network of possible reactions,

164:18we can imagine, you know, at a physical level,

164:20we can imagine, well, what was the actual

164:22momentum direction of that molecule?

164:24What was it, which we don't pay any attention to

164:26when we're just talking about chemical concentrations.

164:29What was the orientation of that molecule?

164:31These kinds of things.

164:32And so here's the place where I have a little suspicion.

164:36Okay?

164:37So one of the questions in biology

164:38is what matters in biology?

164:40And that is, you know, we have all these chemical reactions.

164:42We have all these molecular processes going on

164:45in biological systems.

164:48What matters?

164:49And, you know, one of the things is

164:51to be able to tell what matters,

164:53well, so a big story of the what matters question

164:56was what happened in genetics in 1953,

164:58when DNA, when it was figured out how DNA worked.

165:01Because before that time, you know,

165:03genetics had been all these different effects

165:04and complicated things.

165:06And then it was realized, ah, there's something new.

165:09A molecule can store information,

165:11which wasn't obvious before that time.

165:13A single molecule can store information.

165:14So there's a place where there can be something important

165:18that's happening in molecular biology,

165:19and it's just in the sequence

165:21that's storing information in a molecule.

165:23So the possibility now is, imagine this dynamic network,

165:27this, you know, causal graphs and multi-way causal graphs

165:31and so on, that represent all of these different reactions

165:34between molecules.

165:35What if there is some aspect of that

165:37that is storing information

165:39that's relevant for molecular biology?

165:41- And the dynamic aspect of that.

165:42- Yes, that's right.

165:43- So it's similar to how the structure

165:46of a DNA molecule stores information.

165:49It could be the dynamics of the system

165:51somehow stores information.

165:52And this kind of process might allow you

165:55to give predictions of what that would be.

165:58- Well, yes, but also imagine that you're trying to do,

166:02for example, imagine you're trying

166:03to do molecular computation, okay?

166:06You might think the way we're gonna do

166:07molecular computation is, we're just gonna run the thing,

166:10we're gonna see what came out,

166:11we're gonna see what molecule came out.

166:13This is saying, that's not the only thing you can do.

166:16There is a different kind of chemical observer

166:18that you can imagine constructing,

166:20which is somehow sensitive to this dynamic network.

166:23Exactly how that works, how we make that measurement,

166:25I don't know, but I have a few ideas,

166:27but that's what's important, so to speak.

166:31And that means, and by the way,

166:32you can do the same thing even for Turing machines.

166:35You can say, if you have a multi-way Turing machine,

166:38you can say, how do you compute

166:40with a multi-way Turing machine?

166:41You can't say, well, we've got this input and this output,

166:44because the thing has all these threads of time,

166:46and it's got lots of outputs.

166:48And so then you say, well, what does it even mean

166:50to be a universal multi-way Turing machine?

166:52I don't fully know the answer to that.

166:54- That's an interesting idea, it would freak Turing out,

166:57for sure, 'cause then the dynamics,

167:00the trajectory of the computation matters.

167:02- Yes, yes, but the thing is,

167:06so this is, again, a story of what's the observer,

167:08so to speak, in chemistry, what's the observer there?

167:11Now, to give an example of where that might matter,

167:14a very sort of present-day example is in immunology,

167:18where we have whatever it is,

167:2210 billion different kinds of antibodies

167:25that are all these different shapes and so on.

167:27We have a trillion different kinds of T-cell receptors

167:31that we produce, and the traditional theory of immunology

167:36is this clonal selection theory

167:38where we are constantly producing,

167:39randomly producing all these different antibodies,

167:42and as soon as one of them binds to an antigen,

167:45then that one gets amplified,

167:46and we produce more of that antibody and so on.

167:49Back in the 1960s, an immunologist called Nils Joerner,

167:53who was the guy who invented monoclonal antibodies,

167:56various other things, kind of had this network theory

167:59of the immune system, where it would be like,

168:01well, we produce antibodies,

168:02but then we produce antibodies to the antibodies,

168:05anti-antibodies, and we produce anti-anti-antibodies,

168:07and we get this whole dynamic network of interactions

168:10between different immune system cells,

168:13and that was kind of a qualitative theory at that time,

168:18and I've been a little disappointed

168:20'cause I've been studying immunology a bit recently,

168:22and I knew something about this 35 years ago or something,

168:25and I knew, I'd read a bunch of the books,

168:27and I'd talked to a bunch of the people and so on,

168:29and it was like an emerging theoretical immunology world,

168:33and then I look at the books now,

168:35and they're very thick because they've got,

168:37there's just a ton known about immunology,

168:39and all these different pathways,

168:41all these different details and so on,

168:43but the theoretical sections seem to have shrunk,

168:46and so it's, so the question is, what,

168:51for example, immune memory,

168:53where does the immune memory reside?

168:55Is it actually some cell sitting in our bone marrow

168:57that is living for the whole of our lives

168:59that's gonna spring into action

169:01as soon as we're shown the same antigen,

169:04or is it something different from that?

169:05Is it something more dynamic?

169:07Is it something more like some network of interactions

169:09between these different kinds of immune system cells

169:12and so on, and it's known

169:13that there are plenty of interactions between T cells,

169:15and there's plenty of dynamics,

169:18but what the consequence of that dynamics is is not clear,

169:21and to have a qualitative theory for that

169:24doesn't seem to exist.

169:26In fact, I was just been trying to study this,

169:28so I'm quite incomplete in my study of these things,

169:30but I was a little bit taken aback

169:32'cause I've been looking at these things,

169:34and it's like, and then they get to the end

169:35where they have the most advanced theory that they've got,

169:38and it turns out it's the cellular automaton theory.

169:41It's like, okay, well, at least I understand that theory,

169:44but I think that the possibility is that

169:49this is a place where if you want to know,

169:53explain roughly how the immune system works,

169:56it ends up being this dynamic network,

169:58and then the immune consciousness, so to speak,

170:02the observer, ends up being something that in the end,

170:06it's kind of like does the human get sick or whatever,

170:08but it's something which is a complicated story

170:12that relates to this whole sort of dynamic network

170:14and so on, and I think that's another place

170:16where this kind of notion of,

170:18where I think multi-computation has the possibility.

170:21See, one of the things, okay,

170:23you can end up with something where,

170:24yes, there is a general relativity in there,

170:27but it turns out, but it may turn out

170:28that the observer who sees general relativity

170:31in the immune system is an observer that's irrelevant

170:34to what we care about about the immune system.

170:36I mean, it could be, yes, there is some effect

170:38where there's some time dilation of T cells

170:42interacting with whatever, but it's like,

170:44that's an effect that's just irrelevant,

170:46and the thing we actually care about is things about

170:49what happens when you have a vaccine

170:51that goes into some place in shape space,

170:53and how does that affect other places in shape space,

170:56and how does that spread?

170:58What's the analog of the speed of light in shape space,

171:01for example?

171:02That's an important issue

171:03if you have one of these dynamic theories.

171:04It's like you poke into shape space by having,

171:08let's say, a vaccine or something

171:10that has a particular configuration in shape space.

171:13How quickly, as this dynamic network spreads out,

171:16how quickly do you get sort of other antibodies

171:20in different places in shape space, things like that.

171:22- When you say shape space,

171:23you mean the shape of the molecules?

171:25And then, so this is like,

171:27could be deeply connected to the protein

171:29and multi-protein folding, all of that kind of stuff.

§22Transcript · 2:51:32–2:59:29

171:32- To be able to say something interesting

171:33about the dance of proteins.

171:36- Right, exactly.

171:37- That actually has an impact on

171:39helping develop drugs, for example,

171:42or has an impact on virology, immunology,

171:46helping to deal with viruses.

171:47- Well, I think the big thing is,

171:49when we think about molecular biology,

171:52what is the qualitative way to think about it?

171:57In other words, is it chemical reaction networks?

172:00Is it genetics, DNA, big news,

172:05it's kind of, there's a digital aspect to the whole thing.

172:08What is the qualitative way to think about

172:10how things work in biology?

172:13When we think about, I don't know,

172:14some phenomenon like aging or something,

172:16which is a big, complicated phenomenon,

172:17which just seems to have all these different tentacles,

172:20is it really the case that that can be thought about

172:22in some, without DNA,

172:25when people were describing genetic phenomena,

172:28there were dominant, recessive, this, that, and the other,

172:31it got very, very complicated,

172:32and then people realized, oh, it's just,

172:35and what is a gene, and so on, and so on, and so on,

172:37then people realize it's just base pairs,

172:39and there's this digital representation.

172:41And so the question is,

172:42what is the overarching representation

172:44that we can now start to think about using in microbiology?

172:47I don't know how this will work out,

172:48and this is, again, one of these things where,

172:51and the place where that gets important is,

172:54maybe molecular biology is doing molecular computing

172:58by using some dynamic process

173:00that is something where it is very happily saying,

173:03oh, I just got a result.

173:04It's in the dynamic structure of this network.

173:06Now I'm gonna go and do some other thing

173:08based on that result, for example,

173:10but we're like, oh, I don't know what's going on.

173:12It's just, we just measured the levels of these chemicals,

173:15and we couldn't conclude anything,

173:17but it just, we're looking at the wrong thing.

173:19And so that's kind of the potential there,

173:23and it's, I mean, these things are,

173:26I don't know, it's, for me, it's like,

173:28I've not really, that was not a view.

173:31I mean, I've thought about molecular computing

173:33for ages and ages and ages,

173:34and I've always imagined that the big story

173:37is kind of the original promise of nanotechnology

173:40of like, can we make a molecular scale constructor

173:43that will just build a molecule in any shape?

173:45But I don't think, I'm now increasingly concluding

173:48that's not the big point.

173:50The big point is something more dynamic.

173:52That will be an interesting end point

173:54for any of these things,

173:55but that's perhaps not the thing,

173:57'cause the one example we have in molecular computing

174:00that's really working is us biological organisms.

174:03And maybe the thing that's important there

174:06is not this, what chemicals do you make, so to speak,

174:10but more this kind of dynamic process.

174:11- Dynamic process, and then you can have a good model

174:14like the hypergraph to then explore,

174:16what, like simulate, again, make predictions,

174:20and if they-- - I think just have a way

174:22to reason about biology.

174:24I mean, it's hard.

174:25First of all, biology doesn't have theories like physics.

174:29Physics is a much more successful

174:31sort of global theory kind of area.

174:34Biology, what are the global theories of biology?

174:37Pretty much Darwinian evolution.

174:39That's the only global theory of biology.

174:41Any other theory is just a, well, the kidneys work this way,

174:44this thing works this way, and so on.

174:46There isn't, I suppose another global theory

174:48is digital information in DNA.

174:50That's another sort of global fact about biology.

174:53- But the difficult thing to do is to match

174:56something you have a model of in the hypergraph

175:00to the actual, like how do you discover the theory?

175:03How do you discover the theory?

175:04Okay, you have something that looks nice and makes sense,

175:07but like you have to match it to validation.

175:10- Oh, sure, right. - And that's tricky

175:12because you're walking around in the dark.

175:15- Not entirely.

175:16I mean, so, you know, for example,

175:18in what we've been trying to think about

175:19is take actual chemical reactions, okay?

175:23So, you know, one of my goals is

175:25can I compute the primes with molecules?

175:28Okay, that's, if I can do that,

175:30then I kind of, maybe I can compute things.

175:32And, you know, there's this nice automated lab,

175:34these guys, these Emerald Cloud Lab people

175:37have built with Wolfram Language and so on.

175:38That's an actual physical lab,

175:40and you send it a piece of Wolfram Language code,

175:42and it goes and, you know,

175:44actually does physical experiments.

175:45And so one of my goals,

175:47because I'm not a test tube kind of guy,

175:50I'm more of a software kind of person,

175:52is can I make something where, you know,

175:54in this automated lab, we can actually get it

175:56so that there's some gel that we made,

175:58and, you know, the positions of the stripes are the primes.

176:00- Is the primes, I love it, yeah.

176:02- I mean, that would be an example of where,

176:06and that would be with a particular, you know,

176:08framework for actually doing the molecular computing,

176:12you know, with particular kinds of molecules.

176:13And there's a lot of kind of ambient technological mess,

176:17so to speak, associated with, oh, is it carbon?

176:19Is it this, is it that?

176:21You know, is it important that there's a bromine atom here?

176:24Et cetera, et cetera, et cetera.

176:24This is all chemistry that I don't know much about.

176:27And, you know, that's a sort of, you know,

176:30unfortunately, that's down at the level, you know,

176:32I would like to be at the software level,

176:34not at the level of the transistors, so to speak.

176:37But in chemistry, you know, there's a certain amount

176:39we have to do, I think, at the level of transistors

176:41before we get up to being able to do it,

176:44although, you know, automated labs

176:45certainly help in setting that up.

176:48- I talked to a guy named Charles Hoskinson.

176:53He mentioned that he's collaborating with you.

176:55He's an interesting guy.

176:56He sends me papers on, speaking of automated theorem

177:00proving a lot.

177:01He's exceptionally well read on that area as well.

177:04So what's the nature of your collaboration with him?

177:06He's the creator of Cardano.

177:08What's the nature of the collaboration between Cardano

177:12and the whole space of blockchain and Wolfram,

177:14Wolfram Alpha, Wolfram Blockchain, all that kind of stuff?

177:17- Well, okay, we're segueing to a slightly different world.

177:21But so, although not completely unconnected.

177:25- Right, the whole thing is somehow connected.

177:27- I know, I mean, you know, the strange thing in my life

177:31is I've sort of alternated between doing basic science

177:33and doing technology about five times in my life so far.

177:37And the thing that's just crazy about it is, you know,

177:40every time I do one of these alternations,

177:42I think there's not gonna be a way back to the other thing.

177:45And like I thought for this physics project,

177:47I thought, you know,

177:48we're doing fundamental theory of physics,

177:50maybe it'll have an application in 200 years.

177:53But now I've realized,

177:55actually this multi-computation idea

177:57is applicable here and now.

177:59It's, and in fact, it's also giving us this way.

178:02I'll just mention one other thing

178:03and then we can talk about blockchain.

178:05The question of,

178:09actually that relates to several different things,

178:11but one of the things about, okay,

178:15so our Wolfram Language,

178:17which is our attempt to kind of represent everything

178:20in the world computationally.

178:22And it's the thing I kind of started building 40 years ago

178:25in the form of actual Wolfram Language 35 years ago.

178:29It's kind of this idea of,

178:30can we express things about the world

178:35in computational terms?

178:36And, you know, we've come a long way

178:38in being able to do that.

178:39Wolfram Alpha is kind of the consumer version of that

178:42where you're just using natural languages as input.

178:44And it turns it into our symbolic language.

178:47And that's, you know, the symbolic language,

178:49Wolfram Language is what people use

178:51and have been using for the last 33 years.

178:54Actually, Mathematica, which is its first instantiation,

178:57will be one third of a century old in October.

179:01And that, it's kind of interesting.

179:06- What do you mean one third of a century?

179:07Does that mean 33 or 30?

179:08What are we--

179:09- 33 and a third.

179:10- 33 and a third.

179:12(laughing)

179:14- I've never heard of anyone celebrating that anniversary,

179:17but I like it.

179:17- I know, a third of a century though.

179:19It's like, you don't get many slices of a century

179:22that are interesting.

179:23But, you know, I think that the thing

179:25that's really striking about that is that means,

179:28you know, including the whole sort of technology stack

179:29I built around that's about 40 years old,

§23Transcript · 2:59:32–3:07:21

179:32and that means it's a significant fraction

179:33of the total age of the computer industry.

179:36And it's, I mean, I think it's cool

179:38that we can still run, you know,

179:39Mathematica version one programs today and so on,

179:42and we've sort of maintained compatibility.

179:45And we've been just building this big tower

179:47all those years of just more and more

179:49and more computational capabilities.

179:51It's sort of interesting.

179:51We just made this picture of kind of the different

179:55kind of threads of computational content,

179:59of, you know, mathematical content,

180:00and, you know, all sorts of things with, you know,

180:04data and graphs and whatever else.

180:06And what you see in this picture

180:07is about the first 10 years,

180:09it's kind of like it's just a few threads.

180:11And then about maybe 15, 20 years ago,

180:15it kind of explodes in this whole collection

180:17of different threads of all these different capabilities

180:19that are now part of Wolfram Language

180:21and representing different things in the world.

180:23But the thing that was super lucky in some sense

180:27is it's all based on one idea.

180:29It's all based on the idea of symbolic expressions

180:31and transformation rules for symbolic expressions,

180:34which was kind of what I originally

180:36put into this SMP system back in 1979

180:39that was a predecessor of the whole Wolfram Language stack.

180:42So that idea was an idea that I got

180:46from sort of trying to understand

180:47mathematical logic and so on.

180:48It was my attempt to kind of make a general

180:52human comprehensible model of computation

180:54of just everything is a symbolic expression

180:57and all you do is transform symbolic expressions.

181:00And, you know, in retrospect,

181:02I was very lucky that I understood

181:05as little as I understood then,

181:07because had I understood more,

181:08I would have been completely freaked out

181:10about all the different ways

181:11that that kind of model can fail.

181:14Because what do you do when you have a symbolic expression,

181:18you make transformations for symbolic expressions?

181:20Well, for example, one question is there may be

181:22many transformations that could be made

181:24in a very multi-computational kind of way.

181:26But what we're doing is picking,

181:28we're using the first transformation that applies.

181:31And we keep doing that until we reach a fixed point.

181:34And that's the result.

181:35And that's kind of a very,

181:37it's kind of a way of sort of sliding around

181:40the edge of multi-computation.

181:42And back when I was working on SMP and things,

181:44I actually thought about these questions

181:46about how, you know, how,

181:48what determines this kind of evaluation path.

181:52So for example, you know, you work out Fibonacci,

181:54you know, Fibonacci is a recursive thing.

181:56F of N is F of N minus one plus F of N minus two.

181:59And you get this whole tree of recursion, right?

182:01And there's the question of how do you evaluate

182:03that tree of recursion?

182:04Do you do it sort of depth first,

182:06where you go all the way down one side?

182:07Do you do it breadth first,

182:09where you're kind of collecting the terms together,

182:12where you know that, you know,

182:13F of eight plus F of seven,

182:14F of seven plus F of six,

182:15you can collect the F of sevens and so on.

182:18These are, you know, I didn't realize it at the time.

182:20It's kind of funny.

182:21I was working on gauge field theories back in 1979.

182:25And I was also working on the evaluation model in SMP

182:29and they're the same problem.

182:30But it took me 40 more years to realize that.

182:33And this question about how you do

182:35this sort of evaluation front,

182:37that's a question of reference frames.

182:39It's a question of kind of the story of,

182:42I mean, that is basically this question of

182:45in what order is the universe evaluated?

182:48And that, and so what you realize is

182:50there's this whole sort of world

182:52of different kinds of computation that you can do

182:54sort of multi computationally.

182:56And that's an interesting thing.

182:58It has a lot of implications

182:59for distributed computing and so on.

183:01It also has a potential implication for blockchain,

183:03which we haven't fully worked out,

183:05which is, and this is not what we're doing with Cardano,

183:07but this is a different thing.

183:09This is something where one of the questions is

183:15when you have, in a sense,

183:17blockchain is a deeply sequentialized story of time.

183:21Because in blockchain,

183:22there's just one copy of the ledger.

183:25And you're saying, this is what happened.

183:27You know, time has progressed in this way.

183:29And there are little things around the edge

183:30as you try and reach consensus and so on.

183:33And, you know, actually we just recently,

183:36we've had this little conference we organized

183:38about the theory of distributed consensus.

183:40'Cause I realized that a bunch of interesting things

183:42that some of our science can tell one about that.

183:45But that's a different, let's not go down that path.

183:47- Yeah, but distributed consensus,

183:49that still has a sequential, there's like one-

183:51- There's still sequentiality.

183:52So distributed consensus-

183:53- Don't tell me you're thinking through like

183:55how to apply multi computation to blockchain.

183:59- Yes, and so that becomes a story of, you know,

184:03instead of transactions all having to settle in one ledger,

184:06it's like a story of all these different ledgers

184:09and they all have to have some ultimate consistency,

184:12which is what causal invariance would give one,

184:14but it can take a while.

184:15And the, it can take a while

184:17is kind of like quantum mechanics.

184:19So it's kind of what's happening is

184:20there are these different paths of history

184:23that correspond to, you know,

184:24in one path of history, you got paid this amount.

184:27In another path of history, you got paid this amount.

184:29In the end, the universe will always become consistent.

184:32Now, the way it works is,

184:35okay, it's a little bit more complicated than that.

184:37What happens is the way space is knitted together

184:40in our theory of physics is through all these events.

184:43And the idea is that the way that economic space

184:48is knitted together is there these autonomous events

184:52that essentially knit together economic space.

184:54So there are all these threads of transactions

184:56that are happening.

184:57And the question is, can they be made consistent?

184:59Are there, is there something forcing them

185:01to be sort of a consistent fabric of economic reality?

185:05And sort of what this has led me to

185:07is trying to realize how does economics fundamentally work?

185:11And, you know, what is economics?

185:13And, you know, what are the atoms of economics,

185:16so to speak?

185:17And so what I've kind of realized is that,

185:20that sort of the, perhaps,

185:22I don't even know if this is right yet.

185:24There's sort of events in economics of transactions.

185:27There are states of agents

185:28that are kind of the atoms of economics.

185:31And then transactions are kind of agents

185:34transact in some,

185:36transact in some way, and that's an event.

185:38And then the question is,

185:39how do you knit together sort of economic space from that?

185:43What is there in economic space?

185:44Well, all these transactions,

185:46there's a whole complicated collection

185:47of possible transactions.

185:48But one thing that's true about economics

185:50is we tend to have the notion

185:52of a definite value for things.

185:54We could imagine that, you know,

185:57you buy a cookie from somebody

186:01and they want to get a movie ticket.

186:05And there is some way that AI bots could make some path

186:09from the cookie to the movie ticket

186:12by all these different intermediate transactions.

186:15But in fact, we have an approximation to that,

186:18which is we say they each have a dollar value.

186:21And we have this kind of numeraire concept

186:24of there's just a way of kind of,

186:26of taking this whole complicated space of transactions

186:29and parsing it in something

186:31which is a kind of a simplified thing

186:34that is kind of like a parsing of physical space.

186:37And so my guess is that the, yet again, I mean, it's crazy

186:42that all these things are so connected.

186:44This is another multi-computation story,

186:46another story of where what's happening

186:48is that the economic consciousness,

186:51the economic observer is not going to deal

186:54with all of those different microscopic transactions.

186:56They're just going to parse the whole thing by saying,

186:59there's this value, it's a number.

187:00And that's their understanding of their summary

187:03of this economic network.

187:05And there will be all kinds of things,

187:06like there are all kinds of arbitrage opportunities,

187:08which are kind of like the quantum effects

187:10in this whole thing.

187:12And that's, you know, and places where there's sort

187:15of different paths that can be followed and so on.

187:18And so the question is,

187:21can one make a sort of global theory of economics?

§24Transcript · 3:07:24–3:15:35

187:24And then my test case is, again,

187:27what is time dilation in economics?

187:29And I know for, you know,

187:31if you imagine a very agricultural economics

187:33where people are growing lettuces in fields

187:35and things like this, and you ask questions about,

187:38well, if you're transporting lettuces to different places,

187:41you know, what is the value of the lettuces

187:43after you have to transport them

187:44versus if you're just sitting in one place and selling them?

187:47And you can kind of get a little bit of an analogy there,

187:49but I think there's a better and more complete analogy.

187:52And that's the question of,

187:53is there a theory like general relativity

187:55that is a global theory of economics?

187:58And is it about something we care about?

188:00It could be that there is a global theory,

188:01but it's about a feature of economic reality

188:04that isn't important to us.

188:05Now, another part of the story is,

188:07can one use those ideas to make essentially

188:10a distributed blockchain,

188:12a distributed generalization of blockchain,

188:14kind of the quantum analog of money, so to speak,

188:17where you have, for example,

188:19you can have uncertainty relations where you're saying,

188:22you know, well, if I insist on knowing my bank account

188:25right now, there'll be some uncertainty.

188:27If I'm prepared to wait a while,

188:29then it'll be much more certain.

188:31And so there's, you know, is there a way of using,

188:34and so we've made a bunch of prototypes of this,

188:37which I'm not yet happy with,

188:39because what I realized is

188:41to really understand these prototypes,

188:42I actually have to have a foundational theory of economics.

188:45And so that's kind of a, you know,

188:47it may be that we could deploy one of these prototypes

188:49as a practical system,

188:51but I think it's really gonna be much better

188:52if we actually have an understanding

188:54of how this plugs into kind of the economic system.

188:56- And that means like a fundamental theory

188:58of transactions between entities.

189:01- Well, and how- - That's what you mean

189:02by economics.

189:03- Yes, I think so.

189:04But I mean, you know, how there emerge

189:07sort of laws of economics,

189:08I don't even know, and I've been asking friends of mine

189:10who are economists and things, what is economics?

189:14You know, is it an axiomatic theory?

189:16Is it a theory that is a kind of

189:18a qualitative description theory?

189:20Is it, you know, what kind of a theory is it?

189:22Is it a theory, you know, what kind of thinking?

189:24It's like in biology, in evolutionary biology, for example,

189:28there's a certain pattern of thinking

189:30that goes on in evolutionary biology,

189:31where if you're a good evolutionary biologist,

189:35somebody says, "That creature has a weird horn."

189:37And they'll say, "Well, that's because this and this

189:40"and this and this selection of this kind and that kind,

189:42"and that's the story."

189:44And it's not a mathematical story,

189:46it's a story of a different type of thinking

189:48about these things.

189:49By the way, evolutionary biology is yet another place

189:52where it looks like this multi-computational idea

189:55can be applied.

189:56And that's where maybe speciation is related

189:59to things like event horizons,

190:01and there's a whole other kind of world of that.

190:04But- - It seems like this kind of model

190:06can be applicable to so many aspects,

190:09like at the different levels of understanding of our reality.

190:14So it could be the biology, the chemistry,

190:16at the physics level, the economics,

190:19and you could potentially...

190:21The thing is, it's like, okay, sure,

190:25at all these levels, it might rhyme,

190:26it might make sense as a model.

190:28The question is, can you make useful predictions

190:30at one of these levels? - That's right.

190:32That's right, and that's really a question of...

190:35It's a weird situation, because it's a situation

190:37where the model probably has definite consequences.

190:41The question is, are they consequences we care about?

190:44And that's some...

190:45In the case of, in the economic case,

190:50so one thing is this idea of using physics-like notions

190:59to construct a distributed analog of blockchain.

191:03Okay, the much more pragmatic thing

191:05is a different direction,

191:07and it has to do with this computational language

191:09that we built to describe the world

191:11that knows about different kinds of cookies

191:14and knows about different cities

191:15and knows about how to compute all these kinds of things.

191:18One of the things that is of interest is,

191:21if you want to run the world,

191:23you need, with contracts and laws and rules and so on,

191:27there are rules at a human level,

191:29and there are kind of things like...

191:31And so this gets one into the idea

191:34of computational contracts.

191:36Right now, when we write a contract,

191:38it's a piece of legalese, it's just written in English,

191:41and it's not something that's automatically

191:43analyzable, executable, whatever else.

191:45It's just English.

191:47Back in Gottfried Leibniz, back in 1680 or whatever,

191:52was like, "I'm gonna figure out how to use logic

191:57"to decide legal cases," and so on,

191:59and he had kind of this idea of,

192:01"Let's make a computational language for human law.

192:05"Forget about modeling nature,

192:07"forgot about natural laws, what about human law?

192:09"Can we make kind of a computational

192:11"representation of that?"

192:13Well, I think finally we're close to being able to do that,

192:16and one of the projects that I hope to get to

192:18as soon as there's a little bit of slowing down

192:21of some of this Cambrian explosion that's happening

192:23is a project I've been meaning to really do for a long time,

192:26which is what I'm calling a symbolic discourse language.

192:29It's just finishing the job of being able

192:31to represent everything, like the conversation we're having

192:35in computational terms, and one of the use cases for that

192:38is computational contracts.

192:40Another use case is something like the Constitution

192:43that says what the AIs, what we want the AIs to do.

192:46- But this is useful, so you're saying,

192:48so these are like, you're saying computational contracts,

192:50but smart contracts, this is what's in the domain

192:53of cryptocurrencies known as smart contracts,

192:56and so the language you've developed,

192:58this symbolic or seek to further develop

193:01symbolic discourse language enables you

193:04to write a contract.

193:06- Write a contract that richly represents

193:10some aspect of the world, yeah.

193:12- But so, I mean, smart contracts tend to be right now

193:15mostly about things happening on the blockchain.

193:18Sometimes they have oracles, and in fact,

193:20Wolfram Alpha API is the main thing people use

193:23to get information about the real world, so to speak,

193:26within smart contracts.

193:27- So Wolfram Alpha, as it stands, is a really good oracle

193:31for whoever wants to use it.

193:32That's perhaps where the relationship with Cardano is.

193:34- Yeah, well, that's how we started getting involved

193:36with blockchains is we realized people were using,

193:38you know, Wolfram Alpha as the oracle

193:41for smart contracts, so to speak,

193:42and so that got us interested in blockchains in general,

193:45and what was ended up happening is Wolfram Language is,

193:49with its symbolic representation of things,

193:51is really very good at representing things like blockchains,

193:54and so I think we now have,

193:56and we don't really know all the comparisons,

193:58but we now have a really nice environment

194:00within Wolfram Language for dealing with the sort of,

194:03you know, for representing what happens in blockchains,

194:06for analyzing what happens in blockchains.

194:08We have a whole effort in blockchain analytics,

194:12and, you know, we've sort of published some samples

194:15of how that works, but it's, you know,

194:17because our technology stack, Wolfram Language

194:19and Mathematica, are very widely used

194:21in the quant finance world, there's a sort of immediate

194:25sort of co-evolution there of sort of

194:29the quant finance kind of thing, and blockchain analytics,

194:32and that's, so it's kind of the representation

194:35of blockchain in computational language,

194:37then ultimately, it's kind of like,

194:39how do you run the world with code?

194:41That is, how do you write sort of all these things

194:44which are right now regulations, and laws,

194:46and contracts, and things in computational language,

194:49and kind of the ultimate vision is that sort of

194:52something happens in the world,

194:53and then there's this giant domino effect

194:55of all these computational contracts

194:57that trigger based on the thing that happened,

194:59and there's a whole story to that,

195:01and of course, you know, I like to always pay attention

195:05to the latest things that are going on,

195:07and I really, I kind of like blockchain

195:08because it's another rethinking of kind of computation.

195:13It's kind of like, you know, cloud computing

195:14was a little bit of that, of sort of persistent

195:18kind of computational resources and so on,

195:21and, you know, this multi-computation

195:23is a big rethinking of kind of what it means to compute.

195:26Blockchain is another bit of rethinking

195:28of what it means to compute.

195:29The idea that you lodge kind of these autonomous lumps

195:32of computation out there in the blockchain world,

195:35and one of the things that just sort of,

§25Transcript · 3:15:38–3:23:44

195:38for fun, so to speak, is we've been doing a bit of stuff

195:41with NFTs, and we just did some NFTs on Cardano,

195:44and we'll be doing some more,

195:45and, you know, we did some cellular automaton NFTs

195:48on Cardano, which people seem to like quite a bit,

195:51and, you know, one of the things I've realized about NFTs

195:55is that there's kind of this notion,

195:57and we're really working on this, you know,

195:59I like recording stuff, you know,

196:02one of the things that's come out of kind of my science,

196:05I suppose, is this history matters type story

196:09of, you know, it's not just the current stage,

196:10it's the history that matters,

196:12and I've kind of, I don't think this is,

196:14I should be realizing, maybe it's not coincidental

196:16that I'm sort of the human who's recorded

196:18more about themselves than anybody else,

196:20and then I end up with these science results

196:22that say history matters, which was not,

196:24those things, I didn't think those were connected, but--

196:27- They're at least correlated, yes.

196:29- Yeah, right, so, you know, this question

196:31about sort of recording what has happened,

196:34and having sort of a permanent record of things,

196:36one of the things that's kind of interesting there

196:39is, you know, you put up a website,

196:40and it's got a bunch of stuff on it,

196:41but, you know, you have to keep paying the hosting fees,

196:43or the thing's gonna go away,

196:45but one of the things about blockchain

196:47that's kind of interesting is,

196:48if you put something on a blockchain,

196:50and you pay, you know, your commission to get that thing,

196:53you know, put on, you know, mine, put on the blockchain,

196:56then, in a sense, everybody who comes after you is,

197:01you know, they are motivated to keep your thing alive,

197:03'cause that's what keeps the consistency of the blockchain.

197:06So, in a sense, with sort of the NFT world,

197:08it's kind of like, if you want to have something permanent,

197:11well, at least for the life of the blockchain,

197:13but even if the blockchain goes out of circulation,

197:16so to speak, there's gonna be enough value

197:18in that whole collection of transactions

197:20that people are gonna archive the thing,

197:22but that means that, you know, pay once,

197:25and you're kind of, you're lodged in the blockchain forever,

197:28and so we've been kind of playing around

197:29with sort of a hobby thing of mine,

197:32of thinking about sort of the NFTs,

197:35and how you, and sort of the consumer idea

197:39of kind of the, it's the anti, you know,

197:41it's the opposite of the Snapchat view of the world.

197:44- Sure, there's a permanence to it

197:45that's heavily incentivized,

197:48and thereby you can have a permanence of history.

197:52- Right, and that's kind of the, now, you know,

197:56so that's one of the things we've been doing with Cardano,

197:58and it's kind of fun.

197:59I think that, I mean, this whole question about,

198:02you know, you mentioned automated theorem proving,

198:04and blockchains, and so on,

198:06and as I've thought about this kind of physics-inspired

198:08distributed blockchain,

198:09obviously there, the sort of the proof that it works,

198:14that there are no double spends, there's no whatever else,

198:16that proof becomes a very formal kind of,

198:20almost a matter of physics, so to speak.

198:22And, you know, it's been an interesting thing

198:25for the practical blockchains

198:27to do kind of actual automated theorem proving,

198:29and I don't think anybody's really managed it

198:31in an interesting case yet.

198:33It's a thing that people, you know, aspire to,

198:35but I think it's a challenging thing,

198:37'cause basically the point is,

198:39one of the things about proving correctness of something

198:42is, well, you know, people say, "I've got this program,

198:44"and I'm going to prove it's correct."

198:46And it's like, what does that mean?

198:47You have to say what correct means.

198:49I mean, it's kind of like,

198:50then you have to have another language,

198:52and people were very confused back in past decades of,

198:55you know, "Oh, we're going to prove the correctness

198:57"by representing the program in another language,

199:00"which we also don't know whether it's correct."

199:02And, you know, often by correctness,

199:04we just mean it can't crash, or it can't scribble on memory,

199:07but the thing is that there's this complicated trade-off,

199:10because as soon as you're really using computation,

199:14you have computational irreducibility,

199:16you have undecidability.

199:18If you want to use computation seriously,

199:20you have to kind of let go of the idea

199:23that you're going to be able to box it in,

199:25and say, "We're going to have just this happen,

199:27"and not anything else."

199:28I mean, this is an old fact.

199:30I mean, Godel's theorem tries to say, you know,

199:33Peano arithmetic, the axioms of arithmetic,

199:35can you box in the integers,

199:37and say these axioms give just the integers,

199:39and nothing but the integers.

199:41Godel's theorem showed that wasn't the case.

199:43There's a, you know, you can have all these wild,

199:45weird things that obey the Peano axioms,

199:48but aren't integers.

199:49And there's this kind of infinite hierarchy

199:51of additional axioms you would have to add,

199:53and it's kind of the same thing.

199:54You don't get to, you know, if you want to say,

199:57"I want to know what happens," you're boxing yourself in,

200:00and there's a limit to what can happen, so to speak.

200:02So it's a complicated trade-off,

200:04and it's a big trade-off for AI, so to speak.

200:06It's kind of like, do you want to let computation

200:09actually do what it can do, or do you want to say,

200:12"No, it's very, very boxed in to the point

200:14"where we can understand every step?"

200:16And that's kind of a thing that becomes difficult to do.

200:20But that's some, I mean, in general,

200:22I would say one of the things that's kind of complicated

200:25in my sort of life and the whole sort of story

200:29of computational language and all this technology

200:31and science and so on, I mean, I kind of,

200:34in the flow of one's life, it's sort of interesting

200:36to see how these things play out,

200:38because I, you know, I've kind of concluded

200:41that I'm in the business of making kind of artifacts

200:43from the future, which means, you know,

200:46there are things that I've done, I don't know,

200:48this physics project, I don't know whether anybody

200:49would have gotten to it for 50 years.

200:52You know, the fact that Mathematica

200:53is a third of a century old, and I know

200:56that a bunch of the core ideas are not well-absorbed.

200:59I mean, that is, people finally got this idea

201:01that I thought was a triviality of notebooks.

201:03That was 25 years.

201:05And, you know, some of these core ideas

201:07about symbolic computation and so on are not absorbed.

201:11I mean, people use them every day in Wolfram Language

201:15and, you know, do all kinds of cool things with them,

201:17but if you say, what is the fundamental

201:19intellectual point here, it's not well-absorbed.

201:22And it's something where you kind of realize

201:24that you're sort of building things,

201:26and I kind of made this thing about, you know,

201:29we're building artifacts from the future, so to speak,

201:31and I mentioned that at our, we have a conference,

201:34it's coming up actually in a couple of weeks,

201:36our annual technology conference,

201:38where we talk about all the things we're doing.

201:41And, you know, so I was talking about it last year

201:44about, you know, we're making artifacts from the future,

201:46and I was kind of like, I had some version of that

201:49that was kind of a dark and frustrated thing of like,

201:52you know, I'm building things which nobody's gonna care

201:54about until long after I'm dead, so to speak.

201:57But then I realized, you know, people were sort of telling

202:01me afterwards, you know, that's exactly how, you know,

202:05we're using Wolfram Language in some particular setting

202:07in some computational X field or some organization

202:10or whatever, and it's like people are saying,

202:13oh, you know, what did you manage to do?

202:15You know, well, we know that in principle

202:16it will be possible to do that,

202:18but we didn't know that was possible now,

202:20and it's kind of like that's sort of the business we're in,

202:22and in a sense, with some of these ideas in science,

202:25you know, I feel a little bit the same way,

202:27that there are some of these things where, you know,

202:29some things, like for example, this whole idea,

202:33well, so to relate to another sort of piece of history

202:36and the future, one of, you know, I mentioned,

202:38we mentioned at the beginning kind of complexity

202:41as this thing that I was interested in back 40 years ago

202:44and so on, where does complexity come from?

202:46Well, I think we kind of nailed that.

202:48The answer is in the computational universe,

202:51even simple programs make it, and that's kind of the secret

202:54that nature has that allows you to make it.

202:56So that's kind of the, that's that part,

202:59but the bigger picture there was this idea

203:02of this kind of computational paradigm,

203:04the idea that you could go beyond mathematical equations,

203:06which have been sort of the primary modeling medium

203:09for 300 years, and so it was like, look,

203:13it is inexorably the case that people will use programs

203:16rather than just equations, and you know,

203:18I was saying that in the 1980s, and people were,

203:21you know, I published my big book, "New Kind of Science,"

203:23that'll be 20 years ago next year, so in 2002,

203:27and people were saying, oh no, this can't possibly be true,

203:30you know, we know for 300 years,

203:31we've been doing all this stuff, right?

203:33To be fair, I now realize, on a little bit more analysis

203:37of what people actually said, in pretty much every field

203:40other than physics, people said, oh, these are new models,

203:44that's pretty interesting, and physics, people were like,

§26Transcript · 3:23:47–3:31:31

203:47we've got our physics models, we're very happy with them.

203:49- Yeah, in physics, there's more resistance

203:51because of the attachment and the power of the equations.

203:54The idea that programs might be the right way

203:57to approach this field was, there's some resistance,

204:01and like you're saying, it takes time.

204:04For somebody who likes the idea of time dilation

204:06and all these applications,

204:08I thought you would understand this.

204:09- Yeah, right, but you know,

204:10and computational irreducibility as well.

204:12- Yes, exactly.

204:13- But I mean, it is really interesting that just 20 years,

204:17the span of 20 years, it's gone from, you know,

204:20pitchforks and horror to, yeah, we get it,

204:24and you know, it's helped that we've, you know,

204:27in our current effort in fundamental physics,

204:30we've gotten a lot further,

204:32and we've managed to put a lot of puzzle pieces together

204:35that make sense.

204:36But the thing that I've been thinking about recently

204:38is this field of complexity.

204:39So I've kind of was a sort of a field builder

204:43back in the 1980s.

204:44I was kind of like, okay, you know, can we, you know,

204:49I'd understood this point

204:50that there was this sort of fundamental phenomenon

204:52of complexity, and it showed up in lots of places.

204:54And I was like,

204:55this is an interesting sort of field of science.

204:58And I was recently was reminded,

205:01I was at this, the very first sort of get together

205:04of what became the Santa Fe Institute.

205:07I was like, in fact, there's even an audio recording

205:09of me sort of saying, people have been talking about,

205:11oh, what should this, you know, outfit do?

205:13And I was saying, well, there is this thing

205:15that I've been thinking about.

205:16It's this kind of idea of complexity.

205:18And it's kind of like, and that's what that ended up.

205:22- And you planted the seed of complexity at Santa Fe.

205:25That's beautiful.

205:25That's a beautiful vision.

205:26- But, I mean, so that, but what's happened then

205:29is this idea of complexity and, you know,

205:32and I started the first research center

205:34at University of Illinois for doing that

205:36in the first journal, complex systems and so on.

205:39And it's kind of an interesting thing in my life,

205:42at least that it's kind of like you plant the seed,

205:45you have this idea, it's a kind of a science idea.

205:48You have this idea of sort of focusing

205:50on the phenomenon of complexity.

205:52The deeper idea was this computational paradigm.

205:54But the nominal idea is this kind of idea of complexity.

205:58Okay, then you roll time forward 30 years or whatever,

206:0135 years, whatever it is, and you say, what happened?

206:05Okay, well, now there are a thousand

206:06complexity institutes around the world.

206:09I think more or less, we've been trying to count them.

206:12And, you know, there are 40 complexity journals, I think.

206:16And so it's kind of like what actually happened

206:19in this field, right?

206:20And I look at a lot of what happened

206:22and I'm like, you know, I have to admit

206:25to some eye rolling, so to speak,

206:27because it's kind of like, what's actually going on?

206:31Well, what people definitely got

206:34was this idea of computational models.

206:36And then they got, but they thought,

206:38one of the kind of cognitive mistakes I think is,

206:41they say, we've got a computational model

206:43and we're looking at a system that's complex

206:48and our computational model gives complexity.

206:51By golly, that must mean it's right.

206:53And unfortunately, because complexity

206:55is a generic phenomenon and computational irreducibility

206:58is a generic phenomenon that actually tells you nothing.

207:01And so then the question is, well, what can you do?

207:04You know, there's a lot of things

207:06that have been sort of done under this banner of complexity.

207:08I think it's been very successful

207:10in providing sort of an interdisciplinary way

207:12of connecting different fields together.

207:14- Which is powerful in itself.

207:16- Right, I mean, it's a very useful--

207:16- Biology and economics and yeah, it is.

207:18- Right, it's a good organizing principle.

207:20But in the end, a lot of that is around

207:22this sort of computational paradigm, computational modeling.

207:25That's the raw material that powers

207:27that kind of correspondence, I think.

207:30But the question is sort of what is the,

207:32you know, I was just thinking recently,

207:34you know, we've been, I mean, the other,

207:36we've been, for years people have told me,

207:39you should start some Wolfram Institute

207:41that does basic science.

207:42You know, all I have is a company that builds software

207:45and we, you know, we have a little piece

207:47that does basic science as kind of a hobby.

207:49People are saying, you should start

207:50this Wolfram Institute thing.

207:52And I've been, you know, 'cause I've known

207:54about lots of institutes and I've seen kind of

207:56that flow of money and kind of, you know,

207:58what happens in different situations and so on.

208:00So I've been kind of reluctant, but I have realized

208:03that, you know, what we've done with our company

208:05over the last 35 years, you know,

208:07we built a very good machine for doing R&D

208:10and, you know, innovating and creating things.

208:12And I just applied that machine to the physics project.

208:16That's how we did the physics project

208:17in a fairly short amount of time with a, you know,

208:20efficient machine with, you know,

208:22various people involved and so on.

208:25And so, you know, it works for basic science

208:28and it's like, we can do more of this.

208:30And so now-- - In biology and chemistry,

208:32so it's become an institute.

208:34- Yes, well, it needs to become an institute.

208:36- An official institute. - Right, right.

208:37But the thing that, so I was thinking about,

208:40okay, so what do we do with complexity?

208:42You know, what, there are all these people who've,

208:45you know, what should happen to that field?

208:47And what I realized is there's kind of this area

208:50of foundations of complexity that's about these questions

208:53about simple programs, what they do,

208:55that's far away from a bunch of the detailed applications

208:58that people, well, it's not far away.

208:59It's the under, you know,

209:01the bedrock underneath those applications.

209:04And so I realized recently,

209:05this is my recent kind of little innovation of a sort,

209:10a post that I'll do very soon,

209:13about kind of, you know, the foundations of complexity,

209:18what really are they?

209:20I think they're really two ideas, two conceptual ideas

209:23that I hadn't really enunciated, I think, before.

209:26One is what I call metamodeling, the other is ruleology.

209:30So what is metamodeling?

209:31So metamodeling is, you've got this complicated model,

209:34and it's a model of, you know, hedgehogs interacting

209:36with this, interacting with that.

209:38And the question is, what's really underneath that?

209:40What is it?

209:41You know, is it a Turing machine?

209:43Is it a cellular automaton?

209:45You know, what is the underlying stuff

209:47underneath that model?

209:49And so there's this kind of meta-science question

209:52of, given these models, what is the core model?

209:55And I realized, I mean, to me,

209:56that's sort of an obvious question,

209:58but then I realized I've been doing language design

210:00for 40 years, and language design is exactly that question.

210:03You know, underneath all of this detailed stuff people do,

210:06what are the underlying primitives?

210:08And that's a question people haven't tended to ask

210:11about models.

210:12They say, "Well, we've got this nice model

210:13for this and that and the other.

210:14What's really underneath it?

210:16And what, you know, because once you have the thing

210:18that's underneath it, well, for example,

210:20this multi-computation idea

210:22is an ultimate metamodeling idea,

210:24because it's saying underneath all these fields

210:27is one kind of paradigmatic structure.

210:29And, you know, you can imagine the same kind of thing

210:32in much more sort of, much sort of shallower levels

210:36in different kinds of modeling.

210:38So the first activity is this kind of metamodeling,

210:41the kind of the models about models, so to speak.

210:45You know, what is the, what's, you know,

210:48drilling down into models?

210:49That's one thing.

210:50The other thing is this thing that I think

210:53we're going to call ruleology,

210:54which is kind of the, okay, you've got these simple rules.

210:57You've got cellular automata, you've got Turing machines,

210:59you've got substitution systems,

211:01you've got register machines,

211:02you've got all these different things.

211:03What do they actually do in the wild?

211:05And this is an area that I've spent a lot of time,

211:08you know, working on.

211:09It's a lot of stuff in my new kind of science book

211:11is about this.

211:13You know, this new book I wrote about combinators

211:15is full of stuff like this.

211:17And this journal, "Complex Systems,"

211:19has lots of papers about these kinds of things.

211:21But there isn't really a home

211:23for people who do ruleology or whatever.

211:26- As you call the basic science of rules.

211:29- Yes, yes, right.

211:31So it's like you've got some, what is it?

§27Transcript · 3:31:34–3:38:36

211:34Is it mathematics?

211:35No, it isn't really like mathematics.

211:36In fact, from my now understanding of metamathematics,

211:39I understand that it's the molecular dynamics level.

211:41It's not the level that mathematicians

211:43have traditionally cared about.

211:45It's not computer science,

211:47because computer science is about writing programs

211:48that do things, you know, that were for a purpose,

211:51not programs in the wild, so to speak.

211:53It's not physics.

211:54It doesn't have anything to do with, you know,

211:56it may be underneath some physics,

211:57but it's not physics as such.

211:59So it just hasn't had a home.

212:01And if you look at, you know,

212:02but what's great about it is it's a surviving field,

212:07so to speak.

212:07It's something where, you know,

212:08one of the things I find sort of inspiring

212:11about mathematics, for example,

212:13is you look at mathematics that was done,

212:15you know, in ancient Greece, ancient, you know,

212:17Babylon, Egypt, and so on.

212:19It's still here today.

212:20You know, you find an icosahedron

212:22that somebody made in ancient Egypt.

212:24You look at it, oh, that's a very modern thing.

212:27It's an icosahedron.

212:28You know, it's a timeless kind of activity.

212:31And this idea of studying simple rules and what they do,

212:34it's a timeless activity.

212:36And I can see that over the last 40 years or so,

212:38as, you know, even with cellular automata,

212:41it's kind of like, you know,

212:43you can sort of catalog what are the different

212:45cellular automata used for,

212:47and, you know, like the simplest rules,

212:49like one, you might even know this one, rule 184.

212:52It's rule 184 is a minimal model for road traffic flow.

212:56And, you know, it's also a minimal model

212:57for various other things.

212:58But it's kind of fun that you can literally say,

213:01you know, rule 90 is a minimal model

213:03for this and this and this.

213:05Rule four is a minimal model for this.

213:07And it's kind of remarkable that you can just,

213:10by in this raw level of this kind of study of rules,

213:13they then branch, they're the raw material

213:16that you can use to make models of different things.

213:18So it's a very pure basic science,

213:20but it's one that, you know, people have explored it,

213:23but they've been kind of a little bit in the wilderness.

213:26And I think, you know, one of the things

213:27that I would like to do finally is, you know,

213:30I always thought that sort of this notion of pure

213:33and chaos pure and chaos being the acronym for my book,

213:36"New Kind of Science" was something

213:40that people should be doing.

213:41And, you know, we tried to figure out

213:43what's the right institutional structure to do this stuff.

213:45You know, we dealt with a bunch of universities.

213:48Oh, you know, can we do this here?

213:50Well, what department would it be in?

213:51Well, it isn't in a department.

213:52It's its own new kind of thing.

213:54That's why the book was called "A New Kind of Science."

213:58It's kind of the, because that's an increasingly

214:01good description of what it is, so to speak.

214:03We're actually, we were thinking about kind

214:05of the ruleological society, because we're realizing

214:08that it's kind of, it's, you know,

214:11there's a, it's very interesting.

214:13I mean, I've never really done something like this before,

214:15because there's this whole group of researchers

214:17who've been doing things that are really,

214:20in some cases, very elegant, very surviving, very solid.

214:24You know, here's this thing that happens

214:26in this very abstract system.

214:28But it's like, what is that part of?

214:31You know, it doesn't have a home.

214:33And I think that's something, you know,

214:35I kind of fault myself for not having been more,

214:38you know, when complexity was developing in the '80s,

214:40I didn't understand the danger of applications.

214:45That is, it's really cool that you can apply this

214:47to economics, and you can apply it to evolutionary biology,

214:50and this and that and the other.

214:51But what happens with applications is everything

214:53gets sucked into the applications.

214:55And the pure stuff, it's like the pure mathematics,

214:58there isn't any pure mathematics, so to speak.

215:01It's all just applications of mathematics.

215:03And I failed to kind of make sure

215:05that this kind of pure area

215:07was kind of maintained and developed.

215:11And I think now, you know,

215:12one of the things I want to try to do,

215:14and you know, it's a funny thing,

215:16because I'm used to, look, I've been a tech CEO

215:19for more than half my life now.

215:20So, you know, this is what I know how to do.

215:23And, you know, I can make stuff happen

215:26and get projects to happen,

215:27even as it turns out basic science projects

215:30in that kind of setting,

215:31and how that translates into kind of, you know,

215:35there are a lot of people working on, for example,

215:36our physics project sort of distributed

215:38through the academic world, and that's working just great.

215:40But the question is, you know,

215:41can we have a sort of accelerator mechanism

215:44that makes use of kind of what we've learned

215:46in sort of R&D innovation?

215:49And, you know, but on the other hand,

215:50it's a funny thing because, you know,

215:53in a company, in the end, the thing is, you know,

215:56it's a company, it makes products,

215:57it sells things to people.

216:00And, you know, when you're doing basic research,

216:02one of the challenges is there isn't that same kind

216:04of sort of mechanism.

216:06And so it's, you know, how do you drive the thing

216:10in a kind of, in a lead kind of way

216:12so that it really can make forward progress

216:15rather than, you know, what can often happen in,

216:17you know, in academic settings where it's like,

216:20well, there are all these flowers blooming,

216:21but it's not clear that they're, you know, that it's-

216:24- You have to have a central mission and a drive,

216:27just like you do with a company

216:28that's delivering a big overarching product.

216:31And that's- - Right.

216:32But the challenge is, you know, when you have a,

216:34the economics of the world are such that, you know,

216:39when you're delivering a product and people say,

216:40"Wow, that's useful, we'll buy it."

216:42And then that kind of feeds back and, okay,

216:44then you can pay the people who build it to eat,

216:48you know, so they can eat and so on.

216:50And with basic science, the payoff is very much less visible

216:55and, you know, with this physics project, as I say,

216:57the big surprise has been that, I mean, you know,

217:00for example, well, the big surprise with the physics project

217:03is that it looks like it has near-term applications.

217:07And I was like, I'm guessing this is 200 years away.

217:10It's, I was kind of using the analogy of, you know,

217:13Newton starting a satellite launch company,

217:16which would have been kind of wrong time.

217:19And, you know, but it turns out that's not the case,

217:22but we can't guarantee that.

217:23And if you say we're signing up to do basic research,

217:27basic rheology, let's say, and, you know,

217:30and we can't, we don't know the horizon, you know,

217:33it's an unknown horizon.

217:34It's kind of like an undecidable kind of proposition

217:37of when is this proof going to end, so to speak?

217:39When is it going to be something that gets applied?

217:43- Well, I hope this is,

217:45this becomes a vibrant new field of rheology.

217:48I love it.

217:49Like I told you many, many times,

217:50it's one of the most amazing ideas

217:54that has been brought to this world.

217:55So I hope you get a bunch of people to explore this world.

217:59Thank you once again

218:02for spending your really valuable time with me today.

218:05- Fun stuff.

218:06Thank you.

218:07- Thanks for listening to this conversation

218:10with Stephen Wolfram.

218:11To support this podcast,

218:12please check out our sponsors in the description.

218:15And now let me leave you with some words

218:17from Richard Feynman.

218:19"Nature uses only the longest threads

218:22"to weave her patterns.

218:24"So each small piece of her fabric

218:27"reveals the organization of the entire tapestry."

218:30Thank you for listening and hope to see you next time.

218:34(upbeat music)

218:36(upbeat music)

— A LITTLE MORE TO THINK ABOUT. —