← Lex Fridman

Stephen Wolfram: Fundamental Theory of Physics, Life, and the Universe

第124期2020-09-15English

嘉宾:Stephen Wolfram

收听本集00:00 / 4:24:06
阅读设置
按你的习惯阅读
正文字号
下载播客精读
把这一篇,带走慢慢读

精读待补充

下载功能还未开放

§01Transcript · 00:00–09:30

00:00The following is a conversation with Stephen Wolfram,

00:02his second time on the podcast.

00:05He's a computer scientist, mathematician,

00:07theoretical physicist, and the founder and CEO

00:10of Wolfram Research, a company behind Mathematica,

00:14Wolfram Alpha, Wolfram Language,

00:16and the new Wolfram Physics Project.

00:19He's the author of several books,

00:21including A New Kind of Science, and the new book,

00:24A Project to Find the Fundamental Theory of Physics.

00:28This second round of our conversation is primarily focused

00:30on this latter endeavor of searching for the physics

00:33of our universe in simple rules that do their work

00:37on hypergraphs and eventually generate the infrastructure

00:40from which space, time, and all of modern physics can emerge.

00:45Quick summary of the sponsors,

00:47SimpliSafe, Sunbasket, and Masterclass.

00:50Please check out these sponsors in the description

00:52to get a discount and to support this podcast.

00:55As a side note, let me say that to me,

00:58the idea that seemingly infinite complexity can arise

01:02from very simple rules and initial conditions

01:05is one of the most beautiful and important

01:07mathematical and philosophical mysteries in science.

01:10I find that both cellular automata

01:12and the hypergraph data structure

01:14that Stephen and team are currently working on

01:17to be the kind of simple, clear mathematical playground

01:21within which fundamental ideas about intelligence,

01:24consciousness, and the fundamental laws of physics

01:28can be further developed in totally new ways.

01:31In fact, I think I'll try to make a video or two

01:34about the most beautiful aspects of these models

01:37in the coming weeks, especially, I think,

01:40trying to describe how fellow curious minds like myself

01:43can jump in and explore them either just for fun

01:47or potentially for publication of new innovative research

01:51in math, computer science, and physics.

01:54But honestly, I think the emerging complexity

01:56in these hypergraphs can capture the imagination

01:58of everyone, even if you're someone

02:00who never really connected with mathematics.

02:04That's my hope, at least, to have these conversations

02:06that inspire everyone to look up to the skies

02:09and into our own minds in awe of our amazing universe.

02:15Let me also mention that this is the first time

02:17I ever recorded a podcast outdoors

02:20as a kind of experiment to see if this is an option

02:23in times of COVID.

02:25I'm sorry if the audio is not great.

02:27I did my best and promise to keep improving

02:30and learning as always.

02:32If you enjoy this thing, subscribe on YouTube,

02:35review it with Five Stars and Apple Podcast,

02:37follow on Spotify, support on Patreon,

02:39or connect with me on Twitter at Lex Friedman.

02:42As usual, I'll do a few minutes of ads now

02:44and no ads in the middle.

02:46I tried to make these interesting,

02:48but I do give you timestamps, so you're welcome to skip,

02:52but still, please do check out the sponsors

02:54by clicking the links in the description.

02:56It's the best way to support this podcast.

02:59Also, let me say, even though I'm talking way too much,

03:02that I did a survey and it seems like over 90% of people

03:06either enjoy these ad reads somehow magically

03:09or don't mind them, at least.

03:11That honestly just warms my heart

03:14that people are that supportive.

03:16This show is sponsored by SimpliSafe,

03:18a home security company.

03:20Go to SimpliSafe.com to get a free HD camera.

03:23It's simple, no contracts, 15 bucks a month, easy setup.

03:28Even I figured it out.

03:29I have it set up in my apartment.

03:31Of course, I also welcome intruders.

03:34One of my favorite movies is Leon or The Professional

03:38with Jean Reno, Gary Oldman,

03:40and the brilliant young Natalie Portman.

03:43If you haven't seen the movie,

03:44he's a hit man with a minimalist life that resembles my own.

03:48In fact, when I was younger, the idea of being a hit man

03:52or targeting evil in a skilled way,

03:56which is how I thought about it, really appealed to me.

03:59The skill of it, the planning, the craftsmanship.

04:03In another life, perhaps,

04:05if I didn't love engineering and science so much,

04:07I could see myself being something like a Navy SEAL.

04:10And in general, I love the idea of serving my country,

04:14of serving society by contributing my skill

04:16in some small way.

04:18Anyway, go to Simplisafe.com slash Lex

04:21to get a free HD camera and to support this podcast.

04:24They're a new sponsor, and this is a trial run,

04:27so you know what to do.

04:28This show is also sponsored by Sun Basket,

04:31a meal delivery service.

04:33Visit SunBasket.com slash Lex

04:35and use code LEX to get $30 off your order

04:38and to support this podcast.

04:40This is the last read of the trial they're doing,

04:43so this is the time to get them if you're considering it.

04:46And if you do, it'll help ensure

04:48that they decide to support this podcast long term.

04:51Their meals are healthy and delicious,

04:54a nice break from the minimalist meals of meat

04:56and vegetables that I usually eat.

04:59Maybe on a personal note,

05:00one of my favorite things to do is watch people cook,

05:03especially people who love cooking,

05:05and hang out with people over amazing meals.

05:09I still tend to be strict in my diet no matter what,

05:11even in fancy restaurants,

05:12but it brings me joy to see friends and family indulge

05:17something like a cake that has way too many calories

05:20or ice cream or whatever.

05:22My mom, in fact, for much of my life,

05:24made this cake called an anthill on my birthday

05:27that brings me a lot of joy and way too many calories.

05:32I was thinking of doing a video with my mom as she makes it.

05:36I thought it'd be a fun thing to do together.

05:39Anyway, go to SunBasket.com slash Lex and use code LEX.

05:44Do it now.

05:45So they signed a longterm contract for this podcast.

05:48This show is also sponsored by Masterclass.

05:50Sign up at masterclass.com slash LEX.

05:53180 bucks a year, you get an all access pass

05:57to watch lessons from Chris Hadfield,

05:59Neil deGrasse Tyson, Tony Hawk, Carlos Santana,

06:02Garrett Casparov, Daniel Nagano,

06:03and many more brilliant world experts.

06:07Masterclass has been a really special sponsor.

06:10They believe in this podcast in a way that gives me strength

06:13and motivation to take intellectual risks.

06:16I'm thinking of doing a few solo podcast episodes

06:18on difficult topics, especially in history,

06:22like the rise and fall of the Third Reich or Stalin, Putin,

06:26and many other difficult topics that I'm fascinated by.

06:29I have a worldview that seeks inspiring positive insights,

06:33even and perhaps especially from periods of tragedy and evil

06:38that perhaps some folks may find value in.

06:40If I can only learn to convey the ideas in my mind

06:43as clearly as I think them.

06:45I think deeply and rigorously and precisely,

06:50but to be honest, have trouble speaking in a way

06:53that reflects that rigor of thought.

06:56So it really does mean a lot, the love and support I get

07:00as I try to get better at this thing,

07:02at this talking thing.

07:03Anyway, go to masterclass.com slash LEX to get a discount

07:07and to support this podcast.

07:09And now finally, here's my conversation with Stephen Wolfram.

07:14You said that there are moments in history of physics

07:17and maybe mathematical physics or even mathematics

07:20where breakthroughs happen

07:22and then a flurry of progress follows.

07:24So if you look back through the history of physics,

07:28what moments stand out to you as important such breakthroughs

07:32where a flurry of progress follows?

07:34So the big famous one was 1920s,

07:36the invention of quantum mechanics,

07:38where in about five or 10 years,

07:41lots of stuff got figured out.

07:43That's now quantum mechanics.

07:45Can you mention the people involved?

07:46Yeah, it was kind of the Schrodinger, Heisenberg,

07:50Einstein had been a key figure, originally Planck,

07:53then Dirac was a little bit later.

07:56That was something that happened at that time,

07:58that's sort of before my time, right?

08:00In my time was in the 1970s,

08:04there was this sort of realization

08:06that quantum field theory was actually going to be useful

08:09in physics and QCD, quantum thermodynamics theory

08:13of quarks and gluons and so on was really getting started.

08:16And there was again, sort of big flurry of things

08:19happened then, I happened to be a teenager at that time

08:22and happened to be really involved in physics.

08:26And so I got to be part of that, which was really cool.

08:29Who were the key figures

08:31aside from your young selves at that time?

08:33You know, who won the Nobel Prize for QCD, okay?

08:37People, David Gross, Frank Wilczek, you know, David Politzer.

08:41The people who are the sort of the slightly older generation,

08:44Dick Feynman, Murray Gellman, people like that,

08:48who were Steve Weinberg, Gerhard Hoft, he's younger,

08:52he's in the younger group actually.

08:54But these are all, you know, characters who were involved.

08:59I mean, it's funny because those are all people

09:02who are kind of in my time and I know them

09:05and they don't seem like sort of historical,

09:08you know, iconic figures.

09:10They seem more like everyday characters, so to speak.

09:14And so it's always, you know, when you look at history

09:18from long afterwards, it always seems like

09:21everything happened instantly.

09:24And that's usually not the case.

09:25There was usually a long buildup,

09:27but usually there's, you know,

09:28there's some methodological thing happens

§02Transcript · 09:30–18:02

09:30and then there's a whole bunch of low hanging fruit

09:32to be picked.

09:33And that usually lasts five or 10 years.

09:36You know, we see it today with machine learning

09:38and, you know, deep learning neural nets and so on.

09:42You know, methodological advance,

09:44things actually started working in, you know, 2011, 2012

09:47and so on.

09:48And, you know, there's been this sort of rapid

09:51picking of low hanging fruit, which is probably, you know,

09:56some significant fraction of the way done, so to speak.

10:00Do you think there's a key moment?

10:01Like if I had to really introspect,

10:03like what was the key moment

10:04for the deep learning, quote unquote, revolution?

10:08I mean.

10:08It's probably the AlexNet business.

10:10AlexNet with ImageNet.

10:11So is there something like that with physics

10:13where, so deep learning neural networks

10:18have been around for a long time.

10:19Absolutely, since the 1940s, yeah.

10:22There's a bunch of little pieces that came together

10:23and then all of a sudden everybody's eyes lit up.

10:27Like, wow, there's something here.

10:29Like even just looking at your own work,

10:32just your thinking about the universe,

10:34that there's simple rules can create complexity.

10:40You know, at which point was there a thing

10:42where your eyes light up?

10:45It's like, wait a minute, there's something here.

10:46Is it the very first idea

10:49or is it some moment along the line of implementations

10:53and experiments and so on?

10:54There's a couple of different stages to this.

10:56I mean, one is the think about the world computationally.

11:01Can we use programs instead of equations

11:03to make models of the world?

11:05That's something that I got interested in

11:07in the beginning of the 1980s.

11:10I did a bunch of computer experiments.

11:13When I first did them, I didn't really,

11:15I could see some significance to them,

11:17but it took me a few years to really say,

11:20wow, there's a big important phenomenon here

11:22that lets sort of complex things arise

11:25from very simple programs.

11:27That kind of happened back in 1984 or so.

11:30Then, you know, a bunch of other years go by,

11:33then I start actually doing a lot

11:35of much more systematic computer experiments and things

11:37and find out that the, you know,

11:39this phenomenon that I could only have said occurs

11:41in one particular case

11:43is actually something incredibly general.

11:45And then that led me to this thing called

11:46principle of computational equivalence.

11:48And that was a long story.

11:51And then, you know, as part of that process,

11:53I was like, okay, you can make simple programs,

11:56can make models of complicated things.

11:59What about the whole universe?

12:00That's our sort of ultimate example of a complicated thing.

12:03And so I got to thinking, you know,

12:05could we use these ideas to study fundamental physics?

12:10You know, I happen to know a lot about,

12:11you know, traditional fundamental physics.

12:14My first, you know, I had a bunch of ideas

12:17about how to do this in the early 1990s.

12:19I made a bunch of technical progress.

12:21I figured out a bunch of things

12:22I thought were pretty interesting.

12:23You know, I wrote about them back in 2002.

12:26With the new kind of science

12:27in the cellular automata world.

12:29And there's echoes in the cellular automata world

12:32with your new Wolfram physics project.

12:36We'll get to all that.

12:37Allow me to sort of romanticize a little more

12:40on the philosophy of science.

12:43So Thomas Kuhn, philosopher of science,

12:45describes that, you know, the progress in science

12:49is made with these paradigm shifts.

12:52And so to link on the sort of original line of discussion,

12:56do you agree with this view

12:58that there is revolutions in science

13:01that just kind of flip the table?

13:03What happens is it's a different way

13:05of thinking about things.

13:07It's a different methodology for studying things.

13:09And that opens stuff up.

13:11There's this idea of,

13:15he's a famous biographer,

13:16but I think it's called the innovators.

13:19There's a biographer of Steve Jobs, of Albert Einstein.

13:22He also wrote a book,

13:23I think it's called the innovators,

13:24where he discusses how a lot of the innovations

13:30in the history of computing has been done by groups.

13:33There's a complicated group dynamic going on,

13:37but there's also a romanticized notion

13:39that the individual is at the core of the revolution.

13:42Like where does your sense fall?

13:45Is ultimately like one person responsible

13:49for these revolutions that creates the spark

13:52or one or two, whatever,

13:54or is it just the big mush and mess and chaos

13:58of people interacting, of personalities interacting?

14:01I think it ends up being like many things,

14:03there's leadership and there ends up being,

14:05it's a lot easier for one person to have a crisp new idea

14:08than it is for a big committee to have a crisp new idea.

14:10And I think, but I think it can happen

14:13that you have a great idea,

14:16but the world isn't ready for it.

14:19And you can, I mean, this has happened to me plenty, right?

14:24It's, you have an idea, it's actually a pretty good idea,

14:27but things aren't ready,

14:29either you're not really ready for it,

14:31or the ambient world isn't ready for it.

14:34And it's hard to get the thing to get traction.

14:37It's kind of interesting.

14:38I mean, when I look at a new kind of science,

14:41you're now living inside the history,

14:43so you can't tell the story of these decades,

14:46but it seems like the new kind of science

14:49has not had the revolutionary impact

14:55I would think it might.

14:59Like, it feels like at some point, of course it might be,

15:02but it feels at some point people will return to that book

15:07and say, that was something special here.

15:09This was incredible.

15:10What happened?

15:11Or do you think that's already happened?

15:13Oh, yeah, it's happened, except that people aren't,

15:16the sort of the heroism of it may not be there,

15:19but what's happened is for 300 years,

15:22people basically said,

15:24if you want to make a model of things in the world,

15:27mathematical equations are the best place to go.

15:29Last 15 years, doesn't happen.

15:32New models that get made of things

15:34most often are made with programs, not with equations.

15:38Now, was that sort of going to happen anyway?

15:42Was that a consequence of my particular work

15:45and my particular book?

15:47It's hard to know for sure.

15:48I mean, I am always amazed at the amounts of feedback

15:51that I get from people where they say,

15:52oh, by the way, I started doing this whole line of research

15:56because I read your book, blah, blah, blah, blah, blah.

15:58It's like, well, can you tell that

15:59from the academic literature?

16:01Was there a chain of academic references?

16:04Probably not.

16:05One of the interesting side effects of publishing

16:09in the way you did this tome

16:11is it serves as an education tool and an inspiration

16:15to hundreds of thousands, millions of people,

16:19but because it's not a single,

16:21it's not a chain of papers with spiffy titles,

16:25it doesn't create a splash of citations.

16:29It's had plenty of citations, but it's, you know,

16:31I think that people think of it as probably more,

16:36you know, conceptual inspiration than kind of a,

16:41you know, this is a line from here to here to here

16:43in our particular field.

16:45I think that the thing which I am disappointed by

16:49and which will eventually happen

16:51is this kind of study of the sort of pure computationalism,

16:55this kind of study of the abstract behavior

16:58of the computational universe.

17:00That should be a big thing that lots of people do.

17:03You mean in mathematics purely, almost like.

17:06It's like pure mathematics, but it isn't mathematics.

17:08But it isn't, it isn't.

17:10It's a new kind of mathematics.

17:12Is it a new title of the book?

17:14Yeah, right.

17:15That's why the book is called that.

17:17Right, that's not coincidental.

17:19Yeah.

17:20It's interesting that I haven't seen

17:22really rigorous investigation

17:24by thousands of people of this idea.

17:26I mean, you look at your competition around rule 30.

17:30I mean, that's fascinating.

17:31If you can say something.

17:34Right.

17:35Is there some aspect of this thing that could be predicted?

17:38That's the fundamental question of science.

17:40That's the core.

17:41Well, that has been a question of science.

17:42I think that is some people's view of what science is about

17:47and it's not clear that's the right view.

17:48In fact, as we live through this pandemic

17:51full of predictions and so on,

17:53it's an interesting moment to be pondering

17:55what science's actual role in those kinds of things is.

17:58Or you think it's possible that in science,

§03Transcript · 18:02–26:36

18:02clean, beautiful, simple prediction

18:04may not even be possible in real systems.

18:07That's the open question.

18:08I don't think it's open.

18:09I think that question is answered and the answer is no.

18:12Well, no, no.

18:13The answer could be just humans are not smart enough yet.

18:16Like we don't have the tools yet.

18:17No, that's the whole point.

18:18I mean, that's sort of the big discovery

18:20of this principle of computational equivalence of mine.

18:23And this is something which is kind of a follow on

18:26to Gödel's theorem, to Turing's work

18:28on the halting problem, all these kinds of things.

18:31That there is this fundamental limitation

18:34built into science,

18:36this idea of computational irreducibility

18:39that says that even though you may know the rules

18:42by which something operates,

18:44that does not mean that you can readily sort of

18:47be smarter than it and jump ahead

18:49and figure out what it's going to do.

18:51Yes, but do you think there's a hope

18:53for pockets of computational reducibility?

18:56Computational reducibility.

19:02And then a set of tools and mathematics

19:04that help you discover such pockets.

19:07That's where we live is in the pockets of reducibility.

19:10That's why, and this is one of the things

19:12that sort of come out of this physics project

19:14and actually something that, again,

19:15I should have realized many years ago, but didn't,

19:18is it could very well be that everything about the world

19:23is computationally reducible and completely unpredictable.

19:26But in our experience of the world,

19:29there is at least some amount of prediction we can make.

19:32And that's because we have sort of chosen a slice of,

19:36probably talk about this in much more detail,

19:38but I mean, we've kind of chosen a slice

19:39of how to think about the universe

19:41in which we can kind of sample

19:43a certain amount of computational reducibility.

19:46And that's sort of where we exist.

19:51And it may not be the whole story of how the universe is,

19:55but it is the part of the universe that we care about

19:59and we sort of operate in.

20:01And that's, you know, in science,

20:03that's been sort of a very special case of that.

20:05That is science has chosen to talk a lot about places

20:09where there is this computational reducibility

20:12that it can find, you know,

20:13the motion of the planets can be more or less predicted.

20:16You know, something about the weather

20:19is much harder to predict.

20:20Something about, you know, other kinds of things

20:22that are much harder to predict.

20:25And it's, these are, but science has tended to,

20:29you know, concentrate itself on places

20:31where its methods have allowed successful prediction.

20:35So you think rule 30, if we could linger on it,

20:39because it's just such a beautiful, simple formulation

20:41of the essential concept underlying

20:43all the things we're talking about.

20:45Do you think there's pockets of reducibility

20:47inside rule 30?

20:48Yes, that is the question of how big are they?

20:51What will they allow you to say?

20:53And so on.

20:53And that's, and figuring out where those pockets are,

20:56I mean, in a sense, that's the, that's sort of a,

21:00you know, that is an essential thing

21:02that one would like to do in science.

21:05But it's also, the important thing to realize

21:08that has not been, you know, is that science,

21:13if you just pick an arbitrary thing,

21:15you say, what's the answer to this question?

21:18That question may not be one

21:20that has a computationally reducible answer.

21:22That question, if you choose, you know,

21:26if you walk along the series of questions

21:28and you've got one that's reducible

21:30and you get to another one that's nearby

21:31and it's reducible too,

21:33if you stick to that kind of stick to the land,

21:36so to speak, then you can go down this chain

21:39of sort of reducible, answerable things.

21:41But if you just say, I'm just pick a question at random,

21:44I'm gonna have my computer pick a question at random.

21:47Most likely it's gonna be reducible.

21:49Most likely it will be reducible.

21:50And what we're thrown in the world, so to speak,

21:54we, you know, when we engineer things,

21:56we tend to engineer things to sort of keep

21:58in the zone of reducibility.

22:00When we're throwing things by the natural world,

22:02for example, not at all certain

22:05that we will be kept in this kind of zone of reducibility.

22:08Can we talk about this pandemic then?

22:11Sure.

22:12For a second, is a, so how do we,

22:16there's obviously huge amount of economic pain

22:18that people are feeling.

22:19There's a huge incentive and medical pain,

22:23health, just all kind of psychological.

22:26There's a huge incentive to figure this out,

22:28to walk along the trajectory of reducible, of reducibility.

22:34There's a lot of disparate data.

22:38You know, people understand generally how viruses spread,

22:40but it's very complicated

22:43because there's a lot of uncertainty.

22:45There's a, there could be a lot of variability also,

22:49like so many, obviously a nearly infinite number

22:52of variables that represent human interaction.

22:57And so you have to figure out,

22:59from the perspective of reducibility,

23:02figure out which variables are really important

23:06in this kind of, from an epidemiological perspective.

23:10So why aren't we, you kind of said

23:13that we're clearly failing.

23:15Well, I think it's a complicated thing.

23:17So, I mean, you know, when this pandemic started up,

23:20you know, I happened to be in the middle

23:21of being about to release this whole physics project thing,

23:24but I thought, you know.

23:25The timing is just cosmically absurd.

23:28A little bit bizarre, but you know,

23:30but I thought, you know,

23:31I should do the public service thing of, you know,

23:33trying to understand what I could about the pandemic.

23:36And, you know, we'd been curating data about it

23:38and all that kind of thing.

23:39But, you know, so I started looking at the data

23:41and started looking at modeling

23:43and I decided it's just really hard.

23:46You need to know a lot of stuff that we don't know

23:48about human interactions.

23:49It's actually clear now that there's a lot of stuff

23:51we didn't know about viruses

23:53and about the way immunity works and so on.

23:56And it's, you know, I think what will come out in the end

23:58is there's a certain amount of what happens

24:02that we just kind of have to trace each step

24:04and see what happens.

24:05There's a certain amount of stuff

24:06where there's going to be a big narrative

24:08about this happened because, you know, of T cell immunity.

24:12This could happen because there's this whole giant

24:14sort of field of asymptomatic viral stuff out there.

24:18You know, there will be a narrative

24:20and that narrative, whenever there's a narrative,

24:22that's kind of a sign of reducibility.

24:24But when you just say,

24:26let's from first principles figure out what's going on,

24:28then you can potentially be stuck

24:30in this kind of a mess of irreducibility

24:33where you just have to simulate each step

24:35and you can't do that unless you know details about,

24:38you know, human interaction networks

24:40and so on and so on and so on.

24:41The thing that has been very sort of frustrating to see

24:46is the mismatch between people's expectations

24:48about what science can deliver

24:50and what science can actually deliver, so to speak.

24:53Because people have this idea that, you know, it's science.

24:56So there must be a definite answer

24:58and we must be able to know that answer.

25:00And, you know, this is, it is both, you know,

25:05when you've, after you've played around

25:07with sort of little programs in the computational universe,

25:10you don't have that intuition anymore.

25:11You know, it's, I always, I'm always fond of saying,

25:14you know, the computational animals

25:17are always smarter than you are.

25:18That is, you know, you look at one of these things

25:20and it's like, it can't possibly do such and such a thing.

25:23Then you run it and it's like, wait a minute,

25:25it's doing that thing.

25:26How does that work?

25:27Okay, now I can go back and understand it.

25:29But that's the brave thing about science

25:31is that in the chaos of the irreducible universe,

25:35we nevertheless persist to find those pockets.

25:38That's kind of the whole point.

25:40That's like, you say that the limits of science,

25:43but that, you know, yes, it's highly limited,

25:46but there's a hope there.

25:48And like, there's so many questions I want to ask here.

25:51So one, you said narrative, which is really interesting.

25:54So obviously from a, at every level of society,

25:58you look at Twitter, everybody's constructing narratives

26:00about the pandemic, about not just the pandemic,

26:03but all the cultural tension that we're going through.

26:06So there's narratives,

26:07but they're not necessarily connected

26:10to the underlying reality of these systems.

26:17So our human narratives, I don't even know if they're,

26:22I don't like those pockets of reducibility

26:25because we're, it's like constructing things

26:29that are not actually representative of reality,

26:33and thereby not giving us like good solutions

§04Transcript · 26:36–34:59

26:36to how to predict the system.

26:39Look, it gets complicated because, you know,

26:41people want to say, explain the pandemic to me,

26:43explain what's going to happen.

26:45In the future.

26:46Yes, but also, can you explain it?

26:48Is there a story to tell?

26:49What already happened in the past?

26:51Yeah, or what's going to happen,

26:53but I mean, you know, it's similar to sort of

26:55explaining things in AI or in any computational system.

26:58It's like, you know, explain what happened.

27:00Well, it could just be this happened

27:03because of this detail and this detail and this detail,

27:05and a million details,

27:06and there isn't a big story to tell.

27:08There's no kind of big arc of the story that says,

27:12oh, it's because, you know, there's a viral field

27:14that has these properties

27:15and people start showing symptoms.

27:17You know, when the seasons change,

27:20people will show symptoms

27:21and people don't even understand, you know,

27:22seasonal variation of flu, for example.

27:24It's something where, you know,

27:28there could be a big story,

27:29or it could be just a zillion little details that mount up.

27:33See, but, okay, let's pretend that this pandemic,

27:38like the coronavirus, resembles something

27:41like the 1D rule 30 cellular automata, okay?

27:45So, I mean, that's how epidemiologists model virus spread.

27:51Indeed, yes.

27:52They sometimes use cellular automata, yes.

27:54Yeah, and okay, so you could say it's simplistic,

27:57but okay, let's say it's representative

28:00of actually what happens.

28:02You know, the dynamic of,

28:06you have a graph,

28:07it probably is closer to the hypergraph model.

28:09It is, yes.

28:10It's actually, that's another funny thing.

28:13As we were getting ready to release this physics project,

28:15we realized that a bunch of things we'd worked out

28:17about foliations of causal graphs and things

28:20were directly relevant to thinking about contact tracing.

28:23Yeah, exactly.

28:24And interactions with cell phones and so on,

28:25which is really weird.

28:27But like, it just feels like,

28:29it feels like we should be able to get

28:31some beautiful core insight about the spread

28:34of this particular virus

28:36on the hypergraph of human civilization, right?

28:40I tried, I didn't manage to figure it out.

28:42But you're one person.

28:43Yeah, but I mean, I think actually it's a funny thing

28:46because it turns out the main model,

28:48you know, this SIR model,

28:49I only realized recently was invented by the grandfather

28:53of a good friend of mine from high school.

28:55So that was just a, you know, it's a weird thing, right?

28:58The question is, you know, okay, so you know,

29:02on this graph of how humans are connected,

29:04you know something about what happens

29:05if this happens and that happens.

29:07That graph is made in complicated ways

29:09that depends on all sorts of issues

29:11that where we don't have the data

29:13about how human society works well enough

29:15to be able to make that graph.

29:17There's actually, one of my kids did a study

29:20of sort of what happens on different kinds of graphs

29:23and how robust are the results, okay?

29:25His basic answer is there are a few general results

29:28that you can get that are quite robust.

29:30Like, you know, a small number of big gatherings

29:33is worse than a large number of small gatherings, okay?

29:36That's quite robust.

29:37But when you ask more detailed questions,

29:40it seemed like it just depends.

29:42It depends on details.

29:44In other words, it's kind of telling you in that case,

29:47you know, the irreducibility matters, so to speak.

29:49It's not, there's not gonna be this kind of one

29:53sort of master theorem that says,

29:55and therefore this is how things are gonna work.

29:57Yeah, but there's a certain kind of,

29:59from a graph perspective,

30:01the certain kind of dynamic to human interaction.

30:04So like large groups and small groups,

30:08I think it matters who the groups are.

30:10For example, you could imagine large,

30:12depends how you define large,

30:13but you can imagine groups of 30 people,

30:17as long as they are cliques or whatever.

30:22Right.

30:23As long as the outgoing degree of that graph is small

30:27or something like that,

30:28like you can imagine some beautiful underlying rule

30:31of human dynamic interaction where I can still be happy,

30:34where I can have a conversation with you

30:36and a bunch of other people that mean a lot to me in my life

30:39and then stay away from the bigger, I don't know,

30:42not going to a Miley Cyrus concert or something like that

30:45and figuring out mathematically some nice.

30:49See, this is an interesting thing.

30:51So I mean, this is the question of what you're describing

30:54is kind of the problem of the many situations

30:59where you would like to get away

31:00from computational irreducibility.

31:02A classic one in physics is thermodynamics.

31:05The second law of thermodynamics,

31:06the law that says entropy tends to increase things

31:09that start orderly tend to get more disordered,

31:13or which is also the thing that says,

31:15given that you have a bunch of heat,

31:16it's hard, heat is the microscopic motion of molecules,

31:19it's hard to turn that heat into systematic mechanical work.

31:23It's hard to just take something being hot

31:26and turn that into, oh, all the atoms are gonna line up

31:29in the bar of metal and the piece of metal

31:31is gonna shoot in some direction.

31:33That's essentially the same problem

31:35as how do you go from this computationally irreducible

31:40mess of things happening

31:41and get something you want out of it.

31:43It's kind of mining, you're kind of,

31:45now, actually I've understood in recent years

31:48that the story of thermodynamics

31:50is actually precisely a story of computational irreducibility,

31:54but it is a, it is already an analogy.

31:58You can kind of see that as can you take the,

32:02what you're asking to do there

32:03is you're asking to go from the kind of,

32:07the mess of all these complicated human interactions

32:10and all this kind of computational processes going on

32:12and you say, I want to achieve

32:14this particular thing out of it.

32:15I want to kind of extract from the heat of what's happening.

32:18I want to kind of extract this useful piece

32:22of sort of mechanical work that I find helpful.

32:25I mean.

32:26Do you have a hope for the pandemic?

32:27So we'll talk about physics,

32:28but for the pandemic, can that be extracted?

32:31Do you think?

32:32What's your intuition?

32:33The good news is the curves basically,

32:36for reasons we don't understand,

32:38the curves, the clearly measurable mortality curves

32:42and so on for the Northern Hemisphere have gone down.

32:46Yeah, but the bad news is that it could be a lot worse

32:50for future viruses.

32:51And what this pandemic revealed is we're highly unprepared

32:55for the discovery of the pockets of reducibility

32:59within a pandemic that's much more dangerous.

33:02Well, my guess is the specific risk of viral pandemics,

33:07you know, that the pure virology

33:10and immunology of the thing,

33:12this will cause that to advance to the point

33:14where this particular risk

33:16is probably considerably mitigated.

33:19But is the structure of modern society robust

33:25to all kinds of risks?

33:26Well, the answer is clearly no.

33:29And it's surprising to me the extent to which people,

33:34as I say, it's kind of scary actually

33:37how much people believe in science.

33:39That is people say, oh, you know,

33:41because the science says this, that and the other,

33:43we'll do this and this and this,

33:44even though from a sort of common sense point of view,

33:46it's a little bit crazy and people are not prepared

33:50and it doesn't really work in society

33:52as it is for people to say,

33:53well, actually we don't really know how the science works.

33:56People say, well, tell us what to do.

33:58Yeah, because then, yeah, what's the alternative?

34:01For the masses, it's difficult to sit,

34:04it's difficult to meditate on computational reducibility.

34:08It's difficult to sit,

34:10it's difficult to enjoy a good dinner meal

34:13while knowing that you know nothing about the world.

34:15Well, I think this is a place where, you know,

34:17this is what politicians and political leaders do

34:21for a living, so to speak,

34:22is you've got to make some decision about what to do.

34:24And it's...

34:25Tell some narrative that while amidst the mystery

34:29and knowing not much about the past or the future,

34:33still telling a narrative that somehow gives people hope

34:37that we know what the heck we're doing.

34:39Yeah, and get society through the issue.

34:41You know, even though, you know,

34:43the idea that we're just gonna, you know,

34:45sort of be able to get the definitive answer from science

34:48and it's gonna tell us exactly what to do.

34:50Unfortunately, you know, it's interesting

34:54because let me point out that if that was possible,

34:56if science could always tell us what to do,

§05Transcript · 34:59–42:43

34:59then in a sense, our, you know,

35:01that would be a big downer for our lives.

35:03If science could always tell us

35:05what the answer is gonna be,

35:06it's like, well, you know,

35:08it's kind of fun to live one's life

35:10and just sort of see what happens.

35:11If one could always just say,

35:12let me check my science.

35:15Oh, I know, you know,

35:16the result of everything is gonna be 42.

35:18I don't need to live my life and do what I do.

35:21It's just, we already know the answer.

35:23It's actually good news in a sense

35:24that there is this phenomenon

35:25of computational irreducibility

35:27that doesn't allow you to just sort of jump through time

35:30and say, this is the answer, so to speak.

35:33And that's, so that's a good thing.

35:35The bad thing is it doesn't allow you to jump through time

35:38and know what the answer is.

35:39It's scary.

35:40Do you think we're gonna be okay as a human civilization?

35:44You said, we don't know.

35:46Absolutely.

35:47Do you think we'll prosper or destroy ourselves?

35:53In general?

35:54In general.

35:55I'm an optimist.

35:57No, I think that, you know,

35:59it'll be interesting to see, for example,

36:01with this, you know, pandemic,

36:02I, you know, to me, you know,

36:05when you look at like organizations, for example,

36:08you know, having some kind of perturbation,

36:10some kick to the system,

36:12usually the end result of that is actually quite good.

36:16You know, unless it kills the system,

36:17it's actually quite good usually.

36:19And I think in this case, you know, people,

36:22I mean, my impression, you know,

36:23it's a little weird for me because, you know,

36:25I've been a remote tech CEO for 30 years.

36:28It doesn't, you know, this is bizarrely, you know,

36:30and the fact that, you know, like this coming to see you here

36:33is the first time in six months that I've been like,

36:39you know, in a building other than my house, okay?

36:41So, you know, I'm a kind of ridiculous outlier

36:46in these kinds of things.

36:47But overall, your sense is when you shake up the system

36:50and throw in chaos that you challenge the system,

36:55we humans emerge better.

36:57Seems to be that way.

36:58Who's to know?

36:59I think that, you know, people, you know,

37:01my sort of vague impression is that people are sort of,

37:05you know, oh, what's actually important?

37:07You know, what is worth caring about and so on?

37:10And that seems to be something that perhaps is more,

37:14you know, emergent in this kind of situation.

37:16It's so fascinating that on the individual level,

37:19we have our own complex cognition.

37:22We have consciousness, we have intelligence,

37:24we're trying to figure out little puzzles.

37:25And then that somehow creates this graph

37:28of collective intelligence.

37:30Well, we figure out, and then you throw in these viruses

37:33of which there's millions different, you know,

37:36there's entire taxonomy and the viruses are thrown

37:39into the system of collective human intelligence.

37:42And when little humans figure out what to do about it,

37:45we get like, we tweet stuff about information.

37:48There's doctors as conspiracy theorists.

37:50And then we play with different information.

37:53I mean, the whole of it is fascinating.

37:55I am like you also very optimistic,

37:58but you said the computational reducibility.

38:04There's always a fear of the darkness

38:06of the uncertainty before us.

38:09Yeah, I know. And it's scary.

38:11I mean, the thing is, if you knew everything,

38:13it will be boring.

38:15And it would be, and then, and worse than boring,

38:19so to speak.

38:20It would reveal the pointlessness, so to speak.

38:24And in a sense, the fact that there is

38:26this computational irreducibility,

38:28it's like as we live our lives, so to speak,

38:30something is being achieved.

38:31We're computing what our lives, you know,

38:35what happens in our lives.

38:36That's funny.

38:37So the computational reducibility is kind of like,

38:40it gives the meaning to life.

38:41It is the meaning of life.

38:43Computational reducibility is the meaning of life.

38:45There you go.

38:46It gives it meaning, yes.

38:47I mean, it's what causes it to not be something

38:51where you can just say, you know,

38:53you went through all those steps to live your life,

38:55but we already knew what the answer was.

38:58Hold on one second.

38:59I'm going to use my handy Wolfram Alpha sunburn

39:03computation thing, so long as I can get network here.

39:06There we go.

39:08Oh, actually, you know what?

39:09It says sunburn unlikely.

39:11This is a QA moment.

39:12This is a good moment.

39:16Okay, well, let me just check what it thinks.

39:20See why it thinks that.

39:22It doesn't seem like my intuition.

39:23This is one of these cases where we can,

39:25the question is, do we trust the science

39:27or do we use common sense?

39:30The UV thing is cool.

39:32Yeah, yeah, well, we'll see.

39:32This is a QA moment, as I say.

39:35It's, do we trust the product?

39:37Yes, we trust the product, so.

39:39And then there'll be a data point either way.

39:42If I'm desperately sunburned,

39:43I will send in an angry feedback.

39:46Because we mentioned the concept so much

39:50and a lot of people know it,

39:51but can you say what computational reducibility is?

39:54Yeah, right.

39:55The question is, if you think about things

39:58that happen as being computations,

40:01you think about some process in physics,

40:06something that you compute in mathematics, whatever else,

40:09it's a computation in the sense it has definite rules.

40:11You follow those rules.

40:13You follow them many steps and you get some result.

40:18So then the issue is,

40:20if you look at all these different kinds of computations

40:21that can happen,

40:22whether they're computations

40:23that are happening in the natural world,

40:24whether they're happening in our brains,

40:26whether they're happening in our mathematics,

40:28whatever else,

40:29the big question is, how do these computations compare?

40:32Is, are there dumb computations and smart computations

40:35or are they somehow all equivalent?

40:37And the thing that I kind of was sort of surprised to realize

40:41from a bunch of experiments that I did in the early nineties

40:43and now we have tons more evidence for it,

40:46this thing I call the principle of computational equivalence,

40:48which basically says, when one of these computations,

40:51one of these processes that follows rules,

40:54doesn't seem like it's doing something obviously simple,

40:57then it has reached the sort of equivalent level

41:00of computational sophistication of everything.

41:03So what does that mean?

41:04That means that, you might say, gosh,

41:07I'm studying this little tiny program on my computer.

41:11I'm studying this little thing in nature,

41:14but I have my brain

41:15and my brain is surely much smarter than that thing.

41:18I'm gonna be able to systematically outrun

41:20the computation that it does

41:22because I have a more sophisticated computation

41:24that I can do.

41:25But what the principle of computational equivalence says

41:27is that doesn't work.

41:29Our brains are doing computations

41:31that are exactly equivalent to the kinds of computations

41:34that are being done in all these other sorts of systems.

41:36And so what consequences does that have?

41:38Well, it means that we can't systematically

41:40outrun these systems.

41:42These systems are computationally irreducible

41:45in the sense that there's no sort of shortcut

41:47that we can make that jumps to the answer.

41:50Now the general case.

41:51Right, right.

41:52But the, so what has happened,

41:55what science has become used to doing

41:58is using the little sort of pockets

42:00of computational reducibility,

42:02which by the way are an inevitable consequence

42:04of computational irreducibility,

42:06that there have to be these pockets

42:08scattered around of computational reducibility

42:11to be able to find those particular cases

42:14where you can jump ahead.

42:15I mean, one thing sort of a little bit

42:17of a parable type thing that I think is fun to tell.

42:20If you look at ancient Babylon,

42:22they were trying to predict three kinds of things.

42:25They tried to predict where the planets would be,

42:27what the weather would be like,

42:29and who would win or lose a certain battle.

42:32And they had no idea which of these things

42:34would be more predictable than the other.

42:36That's funny.

42:37And it turns out where the planets are

42:40is a piece of computational reducibility

§06Transcript · 42:43–51:19

42:43that 300 years ago or so we pretty much cracked.

42:46I mean, it's been technically difficult

42:48to get all the details right,

42:49but it's basically, we got that.

42:52Who's gonna win or lose the battle?

42:54No, we didn't crack that one.

42:55That one, that one, right.

42:57Game theorists are trying.

42:58Yes. And then the weather.

43:00It's kind of halfway on that one.

43:02Halfway?

43:03Yeah, I think we're doing okay on that one.

43:05Long term climate, different story.

43:07But the weather, we're much closer on that.

43:10But do you think eventually we'll figure out the weather?

43:11So do you think eventually most think

43:15we'll figure out the local pockets in everything,

43:17essentially the local pockets of reducibility?

43:19No, I think that it's an interesting question,

43:22but I think that there is an infinite collection

43:25of these local pockets.

43:26We'll never run out of local pockets.

43:28And by the way, those local pockets

43:30are where we build engineering, for example.

43:33That's how we, if we want to have a predictable life,

43:36so to speak, then we have to build

43:40in these sort of pockets of reducibility.

43:43Otherwise, if we were sort of existing

43:46in this kind of irreducible world,

43:48we'd never be able to have definite things

43:51to know what's gonna happen.

43:53I have to say, I think one of the features,

43:55when we look at sort of today from the future, so to speak,

43:59I suspect one of the things where people will say

44:02I can't believe they didn't see that

44:04is stuff to do with the following kind of thing.

44:07So if we describe, oh, I don't know,

44:10something like heat, for instance,

44:12we say, oh, the air in here, it's this temperature,

44:17this pressure, that's as much as we can say.

44:20Otherwise, just a bunch of random molecules bouncing around.

44:23People will say, I just can't believe they didn't realize

44:26that there was all this detail

44:27and how all these molecules were bouncing around

44:29and they could make use of that.

44:31And actually, I realized there's a thing

44:32I realized last week, actually,

44:34was a thing that people say, one of the scenarios

44:37for the very long term history of our universe

44:40is a so called heat death of the universe,

44:42where basically everything just becomes

44:44thermodynamically boring.

44:47Everything's just this big kind of gas

44:48and thermal equilibrium.

44:50People say, that's a really bad outcome.

44:52But actually, it's not a really bad outcome.

44:54It's an outcome where there's all this computation going on

44:57and all those individual gas molecules

44:58are all bouncing around in very complicated ways

45:01doing this very elaborate computation.

45:03It just happens to be a computation that right now,

45:06we haven't found ways to understand.

45:09We haven't found ways, our brains haven't,

45:12and our mathematics and our science and so on,

45:14haven't found ways to tell an interesting story about that.

45:17It just looks boring to us.

45:19So you're saying there's a hopeful view

45:23of the heat death, quote unquote, of the universe

45:26where there's actual beautiful complexity going on.

45:30Similar to the kind of complexity we think of

45:34that creates rich experience in human life and life on Earth.

45:38So those little molecules interacting complex ways,

45:40that could be intelligence in that, there could be.

45:43Absolutely.

45:44I mean, this is what you learn from this principle.

45:46Wow, that's a hopeful message.

45:48Right.

45:48I mean, this is what you kind of learn

45:49from this principle of computational equivalence.

45:51You learn it's both a message of sort of hope

45:56and a message of kind of, you know,

45:59you're not as special as you think you are, so to speak.

46:01I mean, because, you know, we imagine that

46:03with sort of all the things we do with human intelligence

46:06and all that kind of thing,

46:07and all of the stuff we've constructed in science,

46:09it's like, we're very special.

46:12But actually it turns out, well, no, we're not.

46:15We're just doing computations

46:17like things in nature do computations,

46:19like those gas molecules do computations,

46:21like the weather does computations.

46:23The only thing about the computations that we do

46:26that's really special is that we understand

46:30what they are, so to speak.

46:31In other words, we have a, you know,

46:33to us they're special because kind of,

46:35they're connected to our purposes,

46:37our ways of thinking about things and so on.

46:39And that's some, but so.

46:41That's very human centric.

46:42That's, we're just attached to this kind of thing.

46:45So let's talk a little bit of physics.

46:48Maybe let's ask the biggest question.

46:50What is a theory of everything in general?

46:55What does that mean?

46:56Yeah, so I mean, the question is,

46:58can we kind of reduce what has been physics

47:01as a something where we have to sort of pick away and say,

47:05do we roughly know how the world works

47:08to something where we have a complete formal theory

47:11where we say, if we were to run this program

47:14for long enough, we would reproduce everything,

47:17you know, down to the fact that we're having

47:19this conversation at this moment,

47:21et cetera, et cetera, et cetera.

47:22Any physical phenomena, any phenomena in this world?

47:25Any phenomenon in the universe.

47:27But the, you know, because of computational irreducibility,

47:30it's not, you know, that's not something where you say,

47:33okay, you've got the fundamental theory of everything.

47:36Then, you know, tell me whether, you know,

47:39lions are gonna eat tigers or something.

47:42You know, that's a, no, you have to run this thing

47:45for, you know, 10 to the 500 steps or something

47:48to know something like that, okay?

47:50So at some moment, potentially, you say,

47:54this is a rule and run this rule enough times

47:57and you will get the whole universe, right?

47:59That's what it means to kind of have

48:02a fundamental theory of physics as far as I'm concerned

48:04is you've got this rule.

48:06It's potentially quite simple.

48:07We don't know for sure it's simple,

48:09but we have various reasons to believe it might be simple.

48:12And then you say, okay, I'm showing you this rule.

48:15You just run it only 10 to the 500 times

48:18and you'll get everything.

48:20In other words, you've kind of reduced the problem

48:22of physics to a problem of mathematics, so to speak.

48:25It's like, it's as if, you know, you'd like,

48:27you generate the digits of pi.

48:29There's a definite procedure.

48:30You just generate them and it'd be the same thing

48:33if you have a fundamental theory of physics

48:35of the kind that I'm imagining, you know,

48:38you get this rule and you just run it out

48:42and you get everything that happens in the universe.

48:45So a theory of everything is a mathematical framework

48:52within which you can explain everything that happens

48:55in the universe, it's kind of in a unified way.

48:58It's not, there's a bunch of disparate modules of,

49:01does it feel like if you create a rule

49:07and we'll talk about the Wolfram physics model,

49:11which is fascinating, but if you have a simple set

49:16of rules with a data structure, like a hypergraph,

49:21does that feel like a satisfying theory of everything?

49:25Because then you really run up against the irreducibility,

49:29computational irreducibility.

49:32Right, so that's a really interesting question.

49:34So I, you know, what I thought was gonna happen

49:38is I thought we, you know, I thought we had a pretty good,

49:42I had a pretty good idea for what the structure

49:45of this sort of theory that sort of underneath space

49:47and time and so on might be like.

49:50And I thought, gosh, you know, in my lifetime,

49:52so to speak, we might be able to figure out what happens

49:55in the first 10 to the minus 100 seconds of the universe.

49:58And that would be cool, but it's pretty far away

50:01from anything that we can see today.

50:03And it will be hard to test whether that's right

50:05and so on and so on and so on.

50:07To my huge surprise, although it should have been obvious

50:10and it's embarrassing that it wasn't obvious to me,

50:12but to my huge surprise,

50:15we managed to get unbelievably much further than that.

50:18And basically what happened is that it turns out

50:21that even though there's this kind of bed

50:23of computational irreducibility,

50:25that sort of these, all these simple rules run into,

50:30there are certain pieces of computational reducibility

50:34that quite generically occur

50:36for large classes of these rules.

50:38And, and this is the really exciting thing

50:40as far as I'm concerned,

50:42the big pieces of computational reducibility

50:46are basically the pillars of 20th century physics.

50:49That's the amazing thing,

50:50that general relativity and quantum field theory

50:52is sort of the pillars of 20th century physics

50:55turn out to be precisely the stuff you can say.

50:59There's a lot you can't say,

51:00there's a lot that's kind of at this irreducible level

51:03where you kind of don't know what's going to happen,

51:05you have to run it, you know,

51:06you can't run it within our universe,

51:07et cetera, et cetera, et cetera, et cetera.

51:10But the thing is there are things you can say

51:13and the things you can say turn out to be very beautifully

51:17exactly the structure that was found

§07Transcript · 51:19–59:30

51:19in 20th century physics,

51:21namely general relativity and quantum mechanics.

51:24And general relativity and quantum mechanics

51:26are these pockets of reducibility that we think of as,

51:32that 20th century physics

51:34is essentially pockets of reducibility.

51:36And then it is incredibly surprising

51:39that any kind of model that's generative

51:43from simple rules would have such pockets.

51:47Yeah, well, I think what's surprising

51:49is we didn't know where those things came from.

51:52It's like general relativity,

51:53it's a very nice mathematically elegant theory.

51:56Why is it true?

51:58You know, quantum mechanics, why is it true?

52:00What we realized is that from this,

52:04that these theories are generic

52:07to a huge class of systems

52:09that have these particular

52:10very unstructured underlying rules.

52:13And that's the thing that is sort of remarkable

52:16and that's the thing to me

52:18that's just, it's really beautiful.

52:20I mean, it's, and the thing that's even more beautiful

52:22is that it turns out that, you know,

52:24people have been struggling for a long time.

52:26You know, how does general relativity theory of gravity

52:29relate to quantum mechanics?

52:30They seem to have all kinds of incompatibilities.

52:32It turns out what we realized is

52:34at some level they are the same theory.

52:37And that's just, it's just great as far as I'm concerned.

52:40So maybe like taking a little step back

52:43from your perspective, not from the low,

52:47not from the beautiful hypergraph,

52:50well, from physics model perspective,

52:52but from the perspective of 20th century physics,

52:55what is general relativity?

52:57What is quantum mechanics?

52:58How do you think about these two theories

53:00from the context of the theory of everything?

53:04Like just even definition.

53:05Yeah, yeah, yeah, right.

53:06So I mean, you know, a little bit of history of physics,

53:08right?

53:09So, I mean the, you know, okay,

53:12very, very quick history of this, right?

53:14So, I mean, you know, physics, you know,

53:16in ancient Greek times, people basically said,

53:19we can just figure out how the world works.

53:21As you know, we're philosophers,

53:22we're gonna figure out how the world works.

53:24You know, some philosophers thought there were atoms.

53:26Some philosophers thought there were,

53:28you know, continuous flows of things.

53:30People had different ideas about how the world works.

53:33And they tried to just say,

53:33we're gonna construct this idea of how the world works.

53:36They didn't really have sort of notions

53:38of doing experiments and so on quite the same way

53:40as developed later.

53:41So that was sort of an early tradition

53:43for thinking about sort of models of the world.

53:46Then by the time of 1600s, time of Galileo and then Newton,

53:51sort of the big idea there was, you know,

53:55title of Newton's book, you know, Principia Mathematica,

53:57mathematical principles of natural philosophy.

54:00We can use mathematics to understand natural philosophy,

54:04to understand things about the way the world works.

54:07And so that then led to this kind of idea that, you know,

54:10we can write down a mathematical equation

54:12and have that represent how the world works.

54:14So Newton's one of his most famous ones

54:16is his universal law of gravity,

54:19inverse square law of gravity

54:21that allowed him to compute all sorts of features

54:23of the planets and so on.

54:24Although some of them he got wrong

54:26and it took another hundred years

54:28for people to actually be able to do the math

54:30to the level that was needed.

54:31But so that had been this sort of tradition

54:34was we write down these mathematical equations.

54:36We don't really know where these equations come from.

54:38We write them down.

54:39Then we figure out, we work out the consequences

54:42and we say, yes, that agrees with what we actually observe

54:45in astronomy or something like this.

54:47So that tradition continued.

54:49And then the first of these two

54:51sort of great 20th century innovations was,

54:55well, the history is actually a little bit more complicated,

54:57but let's say that there were two,

55:01quantum mechanics and general relativity.

55:03Quantum mechanics kind of 1900

55:05was kind of the very early stuff done by Planck

55:08that led to the idea of photons, particles of light.

55:12But let's take general relativity first.

55:14One feature of the story is that special relativity

55:19thing Einstein invented in 1905

55:21was something which surprisingly

55:24was a kind of logically invented theory.

55:27It was not a theory where it was something where

55:29given these ideas that were sort of axiomatically

55:32thought to be true about the world,

55:34it followed that such and such a thing would be the case.

55:38It was a little bit different

55:39from the kind of methodological structure

55:42of some existing theories in the more recent times,

55:45where it's just been, we write down an equation

55:47and we find out that it works.

55:49So what happened there.

55:51So there's some reasoning about the light.

55:53The basic idea was the speed of light

55:57appears to be constant.

55:59Even if you're traveling very fast,

56:01you shine a flashlight, the light will come out.

56:05Even if you're going at half the speed of light,

56:07the light doesn't come out of your flashlight

56:08at one and a half times the speed of light.

56:11It's still just the speed of light.

56:13And to make that work,

56:14you have to change your view of how space and time work

56:18to be able to account for the fact

56:20that when you're going faster,

56:21it appears that length is foreshortened

56:24and time is dilated and things like this.

56:26And that's special relativity.

56:27That's special relativity.

56:28So then Einstein went on with sort of

56:33vaguely similar kinds of thinking.

56:34In 1915, invented general relativity,

56:37which is the theory of gravity.

56:39And the basic point of general relativity

56:42is it's a theory that says,

56:44when there is mass in space, space is curved.

56:49And what does that mean?

56:52Usually you think of what's the shortest distance

56:55between two points.

56:56Like ordinarily on a plane in space, it's a straight line.

57:00Photons, light goes in straight lines.

57:04Well, then the question is,

57:06is if you have a curved surface,

57:10a straight line is no longer straight.

57:12On the surface of the earth,

57:13the shortest distance between two points is a great circle.

57:16It's a circle.

57:18So, you know, Einstein's observation was

57:21maybe the physical structure of space

57:24is such that space is curved.

57:26So the shortest distance between two points,

57:29the path, the straight line in quotes,

57:32won't be straight anymore.

57:34And in particular, if a photon is, you know,

57:37traveling near the sun or something,

57:39or if a particle is going,

57:40something is traveling near the sun,

57:42maybe the shortest path will be one

57:45that is something which looks curved to us

57:48because it seems curved to us

57:50because space has been deformed by the presence of mass

57:53associated with that massive object.

57:55So the kind of the idea there is,

57:59think of the structure of space

58:01as being a dynamical changing kind of thing.

58:03But then what Einstein did

58:04was he wrote down these differential equations

58:07that basically represented the curvature of space

58:10and its response to the presence of mass and energy.

58:13And that ultimately is connected to the force of gravity,

58:18which is one of the forces that seems to,

58:20based on its strength,

58:21operate on a different scale than some of the other forces.

58:24So it operates in a scale that's very large.

58:27What happens there is just this curvature of space,

58:32which causes, you know, the paths of objects to be deflected.

58:35That's what gravity does.

58:37It causes the paths of objects to be deflected.

58:39And this is an explanation for gravity, so to speak.

58:43And the surprise is that from 1915 until today,

58:47everything that we've measured about gravity

58:49precisely agrees with general relativity.

58:52And that, you know, it wasn't clear black holes

58:55were sort of a predict,

58:56well, actually the expansion of the universe

58:57was an early potential prediction,

58:59although Einstein tried to sort of patch up his equations

59:02to make it not cause the universe to expand,

59:05because it was kind of so obvious

59:06the universe wasn't expanding.

59:08And, you know, it turns out it was expanding

59:10and he should have just trusted the equations.

59:11And that's a lesson for those of us

59:14interested in making fundamental theories of physics

59:16is you should trust your theory and not try and patch it

59:19because of something that you think might be the case

59:22that might turn out not to be the case.

59:25Even if the theory says something crazy is happening.

59:28Yeah, right.

59:29Like the universe is expanding.

§08Transcript · 59:30–1:07:25

59:30Like the universe is expanding, right, which is,

59:31but, you know, then it took until the 1940s,

59:35probably even really until the 1960s,

59:36until people understood that black holes

59:38were a consequence of general relativity and so on.

59:42But that's, you know, the big surprise has been

59:45that so far this theory of gravity has perfectly agreed

59:50with, you know, these collisions of black holes

59:51seen by their gravitational waves, you know,

59:54it all just works.

59:55So that's been kind of one pillar of the story of physics

59:59it's mathematically complicated to work out

60:01the consequences of general relativity,

60:03but it's not, there's no, I mean,

60:05and some things are kind of squiggly and complicated.

60:09Like people believe, you know, energy is conserved.

60:12Okay, well, energy conservation doesn't really work

60:14in general activity in the same way as it ordinarily does.

60:16And it's all a big mathematical story

60:19of how you actually nail down something that is definitive

60:22that you can talk about it and not specific to the,

60:25you know, reference frames you're operating in

60:27and so on and so on and so on.

60:28But fundamentally, general relativity is a straight shot

60:31in the sense that you have this theory,

60:32you work out its consequences.

60:34And that theory is useful in terms of basic science

60:39and trying to understand the way black holes work,

60:41the way the creation of galaxies work,

60:43sort of all of these kinds of cosmological things,

60:45understanding what happened, like you said, at the Big Bang.

60:49Yeah. Like all those kinds of,

60:50well, no, not at the Big Bang actually, right?

60:52But the...

60:53Well, features of the expansion of the universe, yes.

60:55I mean, and there are lots of details

60:58where we don't quite know how it's working, you know,

60:59is there, you know, where's the dark matter,

61:02is there dark energy, you know, et cetera, et cetera, et cetera.

61:04But fundamentally, the, you know,

61:06the testable features of general relativity,

61:08it all works very beautifully.

61:10And it's in a sense, it is mathematically sophisticated,

61:13but it is not conceptually hard to understand in some sense.

61:17Okay. So that's general relativity.

61:18And what's its friendly neighbor, like you said,

61:21there's two theories, quantum mechanics.

61:22Right. So quantum mechanics,

61:24the sort of the way that that originated was,

61:28one question was, is the world continuous or is it discrete?

61:31You know, in ancient Greek times,

61:32people have been debating this.

61:34People debated it, you know, throughout history.

61:36Is light made of waves?

61:38Is it continuous? Is it discrete?

61:39Is it made of particles, corpuscles, whatever.

61:43You know, what had become clear in the 1800s is that atoms,

61:47that, you know, materials are made of discrete atoms.

61:51You know, when you take some water,

61:53the water is not a continuous fluid,

61:55even though it seems like a continuous fluid

61:57to us at our scale.

61:58But if you say, let's look at it,

62:00smaller and smaller and smaller and smaller scale,

62:02eventually you get down to these, you know,

62:04these molecules and then atoms.

62:06It's made of discrete things.

62:07The question is sort of how important is this discreteness?

62:10Just what's discrete, what's not discrete?

62:12Is energy discrete?

62:14Is, you know, what's discrete, what's not?

62:17And so.

62:18Does it have mass?

62:19Those kinds of questions.

62:20Yeah, yeah, right.

62:21Well, there's a question, I mean, for example,

62:23is mass discrete is an interesting question,

62:26which is now something we can address.

62:28But, you know, what happened in the coming up to the 1920s,

62:35there was this kind of mathematical theory developed

62:37that could explain certain kinds of discreteness

62:40in particularly in features of atoms and so on.

62:44And, you know, what developed was this mathematical theory

62:47that was the theory of quantum mechanics,

62:50theory of wave functions, Schrodinger's equation,

62:52things like this.

62:53That's a mathematical theory that allows you to calculate

62:57lots of features of the microscopic world,

62:59lots of things about how atoms work,

63:01et cetera, et cetera, et cetera.

63:03Now, the calculations all work just great.

63:05The question of what does it really mean

63:09is a complicated question.

63:11Now, I mean, to just explain a little bit historically,

63:14the, you know, the early calculations of things like atoms

63:17worked great in 1920s, 1930s and so on.

63:20There was always a problem.

63:21There were, in quantum field theory,

63:24which is a theory of, in quantum mechanics,

63:27you're dealing with a certain number of electrons

63:30and you fix the number of electrons.

63:31You say, I'm dealing with a two electron thing.

63:34In quantum field theory,

63:35you allow for particles being created and destroyed.

63:38So you can emit a photon that didn't exist before.

63:41You can absorb a photon, things like that.

63:43That's a more complicated,

63:44mathematically complicated theory.

63:46And it had all kinds of mathematical issues

63:47and all kinds of infinities that cropped up.

63:49And it was finally figured out more or less

63:51how to get rid of those.

63:52But there were only certain ways of doing the calculations

63:55and those didn't work for atomic nuclei among other things.

63:59And that led to a lot of development up until the 1960s

64:03of alternative ideas for how one could understand

64:07what was happening in atomic nuclei, et cetera,

64:09et cetera, et cetera.

64:10End result, in the end,

64:12the kind of most quotes obvious mathematical structure

64:16of quantum field theory seems to work.

64:18Although it's mathematically difficult to deal with,

64:20but you can calculate all kinds of things.

64:22You can calculate to a dozen decimal places,

64:26certain things, you can measure them.

64:27It all works.

64:28It's all beautiful.

64:29Now you say...

64:30The underlying fabric is the model

64:32of that particular theory is fields.

64:34Like you keep saying fields.

64:37Those are quantum fields.

64:37Those are different from classical fields.

64:40A field is something like you say,

64:44like you say the temperature field in this room.

64:46It's like there is a value of temperature

64:49at every point around the room.

64:51That's some, or you can say the wind field

64:53would be the vector direction of the wind at every point.

64:56It's continuous.

64:57Yes, and that's a classical field.

65:00The quantum field is a much more

65:01mathematically elaborate kind of thing.

65:04And I should explain that one of the pictures

65:06of quantum mechanics that's really important is,

65:09in classical physics, one believes

65:11that sort of definite things happen in the world.

65:13You pick up a ball, you throw it,

65:16the ball goes in a definite trajectory

65:17that has certain equations of motion.

65:20It goes in a parabola, whatever else.

65:22In quantum mechanics, the picture is

65:25definite things don't happen.

65:26Instead, sort of what happens is this whole

65:29sort of structure of all many different paths being followed

65:34and we can calculate certain aspects of what happens,

65:37certain probabilities of different outcomes and so on.

65:40And you say, well, what really happened?

65:42What's really going on?

65:43What's the sort of, what's the underlying,

65:45what's the underlying story?

65:47How do we turn this mathematical theory

65:50that we can calculate things with

65:52into something that we can really understand

65:54and have a narrative about?

65:56And that's been really, really hard for quantum mechanics.

65:58My friend, Dick Feynman, always used to say,

66:01nobody understands quantum mechanics,

66:03even though he'd made his whole career

66:06out of calculating things about quantum mechanics.

66:10And so it's a little bit.

66:11Nevertheless, it's what the quantum field theory is very,

66:16very accurate at predicting a lot of the physical phenomena.

66:20So it works.

66:21Yeah.

66:22But there are things about it, it has certain,

66:25when we apply it, the standard model of particle physics,

66:27for example, we, which we apply to calculate

66:31all kinds of things that works really well.

66:33And you say, well, it has certain parameters.

66:34It has a whole bunch of parameters actually.

66:36You say, why is the, why does the muon particle exist?

66:41Why is it 206 times the mass of the electron?

66:44We don't know, no idea.

66:46But so the standard model of physics is one of the models

66:50that's very accurate for describing

66:51three of the fundamental forces of physics.

66:55And it's looking at the world of the very small.

66:58Right.

66:59And then there's back to the neighbor of gravity,

67:03of general relativity.

67:04So, and then in the context of a theory of everything,

67:07what's traditionally the task of the unification

67:13of these theories?

67:15And why is it hard?

67:16The issue is you try to use the methods

67:18of quantum field theory to talk about gravity

67:20and it doesn't work.

67:22Just like there are photons of light.

67:24So there are gravitons,

§09Transcript · 1:07:25–1:16:21

67:25which are sort of the particles of gravity.

67:27And when you try and compute sort of the properties

67:30of the particles of gravity,

67:32the kind of mathematical tricks that get used

67:36in working things out in quantum field theory don't work.

67:39And that's, so that's been a sort of fundamental issue.

67:43And when you think about black holes,

67:44which are a place where sort of the structure of space

67:48is, you know, has sort of rapid variation

67:52and you get kind of quantum effects mixed in

67:55with effects from general relativity,

67:57things get very complicated

67:58and there are apparent paradoxes and things like that.

68:01And people have, you know,

68:02there've been a bunch of mathematical developments

68:05in physics over the last, I don't know, 30 years or so,

68:08which have kind of picked away at those kinds of issues

68:11and got hints about how things might work.

68:15But it hasn't been, you know,

68:17and the other thing to realize is,

68:19as far as physics is concerned,

68:20it's just like here's general relativity,

68:22here's quantum field theory, you know, be happy.

68:25Yeah, so do you think there's a quantization of gravity,

68:28so quantum gravity, what do you think of efforts

68:31that people have tried to, yeah,

68:33what do you think in general of the efforts

68:36of the physics community to try to unify these laws?

68:39So I think what's, it's interesting.

68:41I mean, I would have said something very different

68:43before what's happened with our physics project.

68:46I mean, you know, the remarkable thing is

68:48what we've been able to do is to make

68:51from this very simple, structurally simple,

68:55underlying set of ideas,

68:57we've been able to build this, you know,

69:00very elaborate structure that's both very abstract

69:04and very sort of mathematically rich.

69:06And the big surprise, as far as I'm concerned,

69:09is that it touches many of the ideas that people have had.

69:12So in other words, things like string theory and so on,

69:15twister theory, it's like the, you know,

69:18we might've thought, I had thought we're out on a prong,

69:21we're building something that's computational,

69:22it's completely different from what other people have done.

69:25But actually it seems like what we've done

69:27is to provide essentially the machine code that, you know,

69:30these things are various features

69:33of domain specific languages, so to speak,

69:35that talk about various aspects of this machine code.

69:37And I think this is something that to me is very exciting

69:41because it allows one both for us to provide

69:45sort of a new foundation for what's been thought about there

69:48and for all the work that's been done in those areas

69:52to give us, you know, more momentum

69:55to be able to figure out what's going on.

69:57Now, you know, people have sort of hoped,

69:58oh, we're just gonna be able to get, you know,

70:01string theory to just answer everything.

70:03That hasn't worked out.

70:04And I think we now kind of can see a little bit about

70:07just sort of how far away certain kinds of things are

70:10from being able to explain things.

70:12Some things, one of the big surprises to me,

70:14actually I literally just got a message

70:16about one aspect of this is the, you know,

70:20it's turning out to be easier.

70:22I mean, this project has been so much easier

70:24than I could ever imagine it would be.

70:26That is, I thought we would be, you know,

70:29just about able to understand

70:31the first 10 to the minus 100 seconds of the universe.

70:34And, you know, it would be a hundred years

70:35before we get much further than that.

70:37It's just turned out, it actually wasn't that hard.

70:40I mean, we're not finished, but, you know.

70:42So you're seeing echoes of all the disparate theories

70:45of physics in this framework.

70:47Yes, yes.

70:48I mean, it's a very interesting, you know,

70:50sort of history of science like phenomenon.

70:53I mean, the best analogy that I can see

70:55is what happened with the early days

70:58of computability and computation theory.

71:00You know, Turing machines were invented in 1936.

71:03People sort of understand computation

71:06in terms of Turing machines,

71:07but actually there had been preexisting theories

71:09of computation, combinators, general recursive functions,

71:12Lambda calculus, things like this.

71:14But people hadn't, those hadn't been concrete enough

71:18that people could really wrap their arms around them

71:20and understand what was going on.

71:21And I think what we're gonna see in this case

71:23is that a bunch of these mathematical theories,

71:26including some very,

71:28I mean, one of the things that's really interesting

71:29is one of the most abstract things

71:31that's come out of sort of mathematics,

71:36higher category theory, things about infinity group voids,

71:39things like this, which to me always just seemed

71:41like they were floating off into the stratosphere,

71:44ionosphere of mathematics, turn out to be things

71:48which our sort of theory anchors down

71:52to something fairly definite and says are super relevant

71:56to the way that we can understand how physics works.

71:59Give me a sec.

72:00By the way, I just threw a hat on.

72:01You've said that with this metaphor analogy

72:06that the theory of everything is a big mountain

72:09and you have a sense that however far we are up the mountain,

72:14that the Wolfram physics model view of the universe

72:21is at least the right mountain.

72:22We're the right mountain, yes, without question.

72:25Which aspect of it is the right mountain?

72:27So for example, I mean, so there's so many aspects

72:31to just the way of the Wolfram physics project,

72:34the way it approaches the world that's clean, crisp,

72:39and unique and powerful, so there's a discreet nature to it,

72:45there's a hypergraph, there's a computational nature,

72:48there's a generative aspect, you start from nothing,

72:51you generate everything, do you think the actual model

72:56is actually a really good one,

72:58or do you think this general principle

73:00from simplicity generating complexity is the right,

73:02like what aspect of the mountain is the correct?

73:05Yeah, right, I think that the kind of the meta idea

73:10about using simple computational systems to do things,

73:14that's the ultimate big paradigm

73:18that is sort of super important.

73:21The details of the particular model are very nice and clean

73:25and allow one to actually understand what's going on.

73:27They are not unique, and in fact, we know that.

73:30We know that there's a very, very, very, very,

73:34there's a large number of different ways

73:37to describe essentially the same thing.

73:38I mean, I can describe things in terms of hypergraphs,

73:41I can describe them in terms of higher category theory,

73:43I can describe them in a bunch of different ways.

73:45They are in some sense all the same thing,

73:47but our sort of story about what's going on

73:50and the kind of cultural mathematical resonances

73:53are a bit different.

73:54And I think it's perhaps worth sort of saying a little bit

73:57about kind of the foundational ideas

74:00of these models and things.

74:04Great, so can you maybe, can we like rewind?

74:09We've talked about it a little bit,

74:11but can you say like what the central idea is

74:14of the Wolfram Physics Project?

74:16Right, so the question is we're interested

74:19in finding sort of simple computational rule

74:21that describes our whole universe.

74:24Can we just pause on that?

74:25It's just so beautiful, that's such a beautiful idea

74:30that we can generate our universe

74:32from a data structure, a simple structure,

74:39simple set of rules, and we can generate our entire universe.

74:42Yes, that's the idea. That's awe inspiring.

74:44Right, but so the question is how do you actualize that?

74:50What might this rule be like?

74:52And so one thing you quickly realize is

74:55if you're gonna pack everything about our universe

74:57into this tiny rule, not much that we are familiar with

75:01in our universe will be obvious in that rule.

75:05So you don't get to fit all these parameters of the universe,

75:07all these features of, you know, this is how space works,

75:10this is how time works, et cetera, et cetera, et cetera.

75:12You don't get to fit that all in.

75:13It all has to be sort of packed in to this thing,

75:16something much smaller, much more basic,

75:18much lower level machine code, so to speak, than that.

75:22And all the stuff that we're familiar with

75:23has to kind of emerge from the operation.

75:26So the rule in itself,

75:27because of the computational reducibility,

75:30is not gonna tell you the story.

75:32It's not gonna give you the answer to,

75:36it's not gonna let you predict

75:38what you're gonna have for lunch tomorrow,

75:40and it's not going to let you predict

75:42basically anything about your life, about the universe.

75:44Right, and you're not going to be able to see in that rule,

75:47oh, there's the three

75:49for the number of dimensions of space and so on.

75:51That's not gonna be there.

75:52Spacetime is not going to be obviously.

75:54Right, so the question is then,

75:55what is the universe made of?

75:57That's a basic question.

76:00And we've had some assumptions

76:01about what the universe is made of

76:02for the last few thousand years

76:04that I think in some cases just turn out not to be right.

76:08And the most important assumption

76:11is that space is a continuous thing.

76:13That is that you can, if you say,

76:17let's pick a point in space.

76:19We're gonna do geometry.

76:20We're gonna pick a point.

§10Transcript · 1:16:21–1:24:25

76:21We can pick a point absolutely anywhere in space.

76:24Precise numbers we can specify of where that point is.

76:28In fact, Euclid who kind of wrote down

76:30the original kind of axiomatization of geometry

76:32back in 300 BC or so,

76:36his very first definition, he says,

76:38a point is that which has no part.

76:40A point is this indivisible infinitesimal thing.

76:47Okay, so we might've said that about material objects.

76:50We might've said that about water, for example.

76:52We might've said water is a continuous thing

76:54that we can just pick any point we want in some water,

76:59but actually we know it isn't true.

77:00We know that water is made of molecules that are discrete.

77:04And so the question, one fundamental question

77:06is what is space made of?

77:08And so one of the things that's sort of a starting point

77:10for what I've done is to think of space as a discrete thing,

77:15to think of there being sort of atoms of space

77:18just as there are atoms of material things,

77:20although very different kinds of atoms.

77:23And by the way, I mean, this idea,

77:25you know, there were ancient Greek philosophers

77:27who had this idea.

77:28There were, you know, Einstein actually thought

77:30this is probably how things would work out.

77:31I mean, he said, you know, repeatedly he thought

77:34that's the way it would work out.

77:35We don't have the mathematical tools in our time,

77:38which was 1940s, 1950s and so on to explore this.

77:42Like the way he thought,

77:44you mean that there is something very, very small

77:48and discrete that's underlying space.

77:52Yes.

77:53And that means that, so, you know, the mathematical theory,

77:56mathematical theories in physics assume that space

77:59can be described just as a continuous thing.

78:02You can just pick coordinates

78:04and the coordinates can have any values.

78:06And that's how you define space.

78:07Space is this just sort of background sort of theater

78:11on which the universe operates.

78:13But can we draw a distinction between space

78:17as a thing that could be described by three values,

78:22coordinates, and how you're,

78:25are you using the word space more generally when you say?

78:29No, I'm just talking about space

78:30as in what we experience in the universe.

78:34So that you think this 3D aspect of it is fundamental.

78:38No, I don't think that 3D is fundamental at all, actually.

78:40I think that the thing that has been assumed

78:45is that space is this continuous thing

78:48where you can just describe it by,

78:49let's say three numbers, for instance.

78:51But most important thing about that

78:53is that you can describe it by precise numbers

78:56because you can pick any point in space

78:58and you can talk about motions,

78:59any infinitesimal motion in space.

79:01And that's what continuous means.

79:03That's what continuous means.

79:04That's what, you know, Newton invented calculus

79:06to describe these kind of continuous small variations

79:08and so on.

79:09That was, that's kind of a fundamental idea

79:11from Euclid on that's been a fundamental idea about space.

79:15And so.

79:16Is that right or wrong?

79:18It's not right.

79:20It's not right.

79:20It's right at the level of our experience most of the time.

79:25It's not right at the level of the machine code,

79:27so to speak.

79:28And so.

79:29Machine code.

79:31Yeah, of the simulation.

79:32That's right.

79:33That's right.

79:33They're the very lowest level of the fabric of the universe,

79:36at least under the Wolfram physics model

79:41is your senses is discrete.

79:44Right.

79:45So now what does that mean?

79:46So it means what is space then?

79:49So in models, the basic idea is you say

79:54there are these sort of atoms of space.

79:56They're these points that represent,

79:59you know, represent places in space,

80:02but they're just discrete points.

80:03And the only thing we know about them

80:06is how they're connected to each other.

80:08We don't know where they are.

80:09They don't have coordinates.

80:10We don't get to say this is a position, such and such.

80:12It's just, here's a big bag of points.

80:15Like in our universe,

80:16there might be 10 to the 100 of these points.

80:18And all we know is this point is connected

80:21to this other point.

80:22So it's like, you know,

80:23all we have is the friend network, so to speak.

80:25We don't have, you know, people's, you know,

80:27physical addresses.

80:29All we have is the friend network of these points.

80:31Yeah.

80:32The underlying nature of reality is kind of like a Facebook.

80:35We don't know their location, but we have the friends.

80:37Yeah, yeah, right.

80:38We know which point is connected to which other points.

80:41And that's all we know.

80:43And so you might say, well,

80:44how on earth can you get something

80:46which is like our experience of, you know,

80:49what seems like continuous space?

80:50Well, the answer is,

80:51by the time you have 10 to the 100 of these things,

80:54those connections can work in such a way

80:57that on a large scale,

80:59it will seem to be like continuous space

81:02in let's say three dimensions

81:03or some other number of dimensions

81:05or 2.6 dimensions or whatever else.

81:07Because they're much, much, much, much larger.

81:10So like the number of relationships here we're talking about

81:15is just a humongous amount.

81:16So the kind of thing you're talking about

81:18is very, very, very small relative

81:20to our experience of daily life.

81:22Right, so I mean, you know,

81:23we don't know exactly the size,

81:25but maybe 10 to the minus,

81:30maybe around 10 to the minus 100 meters.

81:32So, you know, the size of, to give a comparison,

81:34the size of a proton is 10 to the minus 15 meters.

81:38And so this is something incredibly tiny compared to that.

81:42And the idea that from that would emerge

81:45the experience of continuous space is mind blowing.

81:51Well, what's your intuition why that's possible?

81:53Like, first of all, I mean, we'll get into it,

81:57but I don't know if we will

81:59through the medium of conversation,

82:01but the construct of hypergraphs is just beautiful.

82:06Right.

82:07Cellular automata are beautiful.

82:08We'll talk about it.

82:09But this thing about, you know,

82:11continuity arising from discrete systems

82:14is in today's world is actually not so surprising.

82:17I mean, you know, your average computer screen, right?

82:19Every computer screen is made of discrete pixels.

82:21Yet we have the, you know,

82:23we have the idea that we're seeing

82:25these continuous pictures.

82:27I mean, it's, you know,

82:27the fact that on a large scale,

82:29continuity can arise from lots of discrete elements.

82:33This is at some level unsurprising now.

82:35Wait, wait, wait, wait, wait, wait.

82:37But the pixels have a very definitive structure

82:42of neighbors on a computer screen.

82:46Right.

82:46There's no concept of spatial,

82:50of space inherent in the underlying fabric of reality.

82:55Right, right, right.

82:56So the point is that, but there are cases where there are.

82:59So for example, let's just imagine you have a square grid.

83:03Okay, and at every point on the grid,

83:05you have one of these atoms of space

83:07and it's connected to four other,

83:09four other atoms of space on the, you know,

83:11Northeast, Southwest corners, right?

83:14There you have something where if you zoom out from that,

83:17it's like a computer screen.

83:19Yeah, so the relationship creates the spatial,

83:23like the relationship creates a constraint,

83:26which then in an emergent sense creates a like,

83:33yeah, like basically a spatial coordinate for that thing.

83:37Yeah, right.

83:38Even though the individual point doesn't have a space.

83:40Even though the individual point doesn't know anything,

83:42it just knows what its neighbors are.

83:45On a large scale, it can be described by saying,

83:48oh, it looks like it's a, you know,

83:50this grid is zoomed out grid.

83:52You can say, well, you can describe these different points

83:54by saying they have certain positions,

83:56coordinates, et cetera.

83:57Now, in the sort of real setup,

83:59it's more complicated than that.

84:00It isn't just a square grid or something.

84:03It's something much more dynamic and complicated,

84:05which we'll talk about.

84:07But so, you know, the first idea,

84:10the first key idea is, you know,

84:12what's the universe made of?

84:13It's made of atoms of space basically

84:15with these connections between them.

84:17What kind of connections do they have?

84:19Well, so the simplest kind of thing you might say is,

84:23we've got something like a graph

§11Transcript · 1:24:25–1:32:41

84:25where every atom of space,

84:28where we have these edges that go between,

84:31these connections that go between atoms of space.

84:33We're not saying how long these edges are.

84:34We're just saying there is a connection

84:36from this place, from this atom to this atom.

84:39Just a quick pause,

84:40because there's a lot of very people that listen to this.

84:44Just to clarify, because I did a poll actually,

84:46what do you think a graph is a long time ago?

84:49And it's kind of funny how few people

84:52know the term graph outside of computer science.

84:55It's good.

84:56Let's call it a network.

84:57I think that's it.

84:58Let's call it a network is better.

84:59So, but every time, I like the word graph though.

85:00So let's define, let's just say that a graph

85:03will use terms nodes and edges maybe.

85:06And it's just the nodes represent some abstract entity

85:11and then the edges represent relationships

85:13between those entities.

85:14Right, exactly.

85:15So that's what a graph says.

85:16Sorry, so there you go.

85:18So that's the basic structure.

85:20That is the simplest case of a basic structure.

85:23Actually, it tends to be better to think about hypergraphs.

85:27So a hypergraph is just, instead of saying

85:31there are connections between pairs of things,

85:34we say there are connections between any number of things.

85:37So there might be ternary edges.

85:39So instead of just having two points

85:42are connected by an edge,

85:44you say three points are all associated with a hyperedge,

85:48are all connected by a hyperedge.

85:50That's just, at some level, that's a detail.

85:54It's a detail that happens to make the, for me,

85:57sort of in the history of this project,

86:00the realization that you could do things that way

86:02broke out of certain kinds of arbitrariness

86:04that I felt that there was in the model

86:06before I had seen how this worked.

86:07I mean, a hypergraph can be mapped to a graph.

86:12It's just a convenient representation.

86:14Mathematical speaking.

86:15That's correct. That's correct.

86:16But so then, so, okay, so the first question,

86:19the first idea of these models of ours is

86:22space is made of these connected sort of atoms of space.

86:26The next idea is space is all there is.

86:29There's nothing except for this space.

86:31So in traditional ideas in physics,

86:33people have said there's space, it's kind of a background.

86:36And then there's matter, all these particles, electrons,

86:39all these other things, which exist in space, right?

86:43But in this model, one of the key ideas is

86:46there's nothing except space.

86:48So in other words, everything that exists in the universe

86:52is a feature of this hypergraph.

86:54So how can that possibly be?

86:55Well, the way that works is

86:58that there are certain structures in this hypergraph

87:01where you say that little twisty knotted thing,

87:05we don't know exactly how this works yet,

87:07but we have sort of idea about how it works mathematically.

87:10This sort of twisted knotted thing,

87:13that's the core of an electron.

87:14This thing over there that has this different form,

87:17that's something else.

87:18So the different peculiarities of the structure

87:21of this graph are the very things

87:24that we think of as the particles inside the space,

87:29but in fact, it's just a property of the space.

87:31Mind blowing, first of all, that it's mind blowing,

87:34and we'll probably talk in its simplicity and beauty.

87:38Yes, I think it's very beautiful.

87:40I mean, this is, I'm...

87:41But okay, but that's space,

87:43and then there's another concept

87:44we didn't really kind of mention,

87:45but you think it of computation as a transformation.

87:50Let's talk about time in a second.

87:51Let's just, I mean, on the subject of space,

87:55there's this question of kind of what,

87:57there's this idea, there is this hypergraph,

87:59it represents space,

88:01and it represents everything that's in space.

88:03The features of that hypergraph,

88:05you can say certain features in this part we do know,

88:08certain features of the hypergraph

88:09represent the presence of energy, for example,

88:11or the presence of mass or momentum,

88:13and we know what the features of the hypergraph

88:16that represent those things are,

88:17but it's all just the same hypergraph.

88:20So one thing you might ask is,

88:22you know, if you just look at this hypergraph and you say,

88:24and we're gonna talk about sort of what the hypergraph does,

88:27but if you say, you know,

88:28how much of what's going on in this hypergraph

88:31is things we know and care about,

88:34like particles and atoms and electrons

88:36and all this kind of thing,

88:37and how much is just the background of space?

88:40So it turns out, so far as in one rough estimate of this,

88:45everything that we care about in the universe

88:47is only one part in 10 to the 120

88:50of what's actually going on.

88:52The vast majority of what's happening

88:54is purely things that maintain the structure of space.

88:57That, in other words, that the things that are

88:59the features of space that are the things

89:03that we consider notable,

89:04like the presence of particles and so on,

89:06that's a tiny little piece of froth

89:08on the top of all this activity

89:10that mostly is just intended to,

89:13you know, mostly, I can't say intended,

89:15there's no intention here,

89:16that just maintains the structure of space.

89:20Let me load that in.

89:24It just makes me feel so good as a human being.

89:27To be the froth on the one in a 10 to the 120

89:31or something of, well.

89:33And also just humbling how,

89:37in this mathematical framework,

89:39how much work needs to be done

89:41on the infrastructure of our universe.

89:44Right, to maintain the infrastructure of our universe

89:46is a lot of work.

89:47We are merely writing a little tiny things

89:51on top of that infrastructure.

89:53But you were just starting to talk a little bit about,

89:57we talked about space,

89:59that represents all the stuff that's in the universe.

90:03The question is, what does that stuff do?

90:06And for that, we have to start talking about time

90:09and what is time and so on.

90:11And, you know, one of the basic idea of this model

90:15is time is the progression of computation.

90:18So in other words, we have a structure of space

90:21and there is a rule that says

90:23how that structure of space will change.

90:25And it's the application,

90:26the repeated application of that rule

90:28that defines the progress of time.

90:32And what does the rule look like

90:34in the space of hypergraphs?

90:36Right, so what the rule says is something like,

90:38if you have a little tiny piece of hypergraph

90:40that looks like this,

90:42then it will be transformed into a piece of hypergraph

90:44that looks like this.

90:46So that's all it says.

90:47It says you pick up these elements of space

90:51and you can think of these edges,

90:54these hyper edges as being relations

90:56between elements in space.

90:57You might pick up these two relations

91:01between elements in space.

91:03And we're not saying where those elements are

91:04or what they are,

91:05but every time there's a certain arrangement

91:07of elements in space,

91:09then arrangement in the sense of the way they're connected,

91:12then we transform it into some other arrangement.

91:14So there's a little tiny pattern

91:16and you transform it into another little pattern.

91:18That's right.

91:19And then because of this,

91:20I mean, again, it's kind of similar to cellular automata

91:23in that like on paper, the rule looks like super simple.

91:26It's like, yeah, okay.

91:30Yeah, right, from this, the universe can be born.

91:33But like once you start applying it,

91:36beautiful structure starts being,

91:39potentially can be created.

91:41And what you're doing is you're applying that rule

91:43to different parts,

91:45like anytime you match it within the hypergraph.

91:49And then one of the like incredibly beautiful

91:53and interesting things to think about

91:55is the order in which you apply that rule,

91:59because that pattern appears all over the place.

92:02Right, so this is a big complicated thing,

92:04very hard to wrap one's brain around, okay?

92:06So you say the rule is every time you see this little pattern

92:10transform it in this way.

92:12But yet, as you look around the space

92:15that represents the universe,

92:17there may be zillions of places

92:18where that little pattern occurs.

92:20So what it says is just do this,

92:24apply this rule wherever you feel like.

92:26And what is extremely non trivial is,

92:31well, okay, so this is happening sort of

92:33in computer science terms, sort of asynchronously,

92:35you're just doing it wherever you feel like doing it.

92:39And the only constraint is

§12Transcript · 1:32:41–1:41:06

92:41that if you're going to apply the rule somewhere,

92:43the things to which you apply the rule,

92:46the little elements to which you apply the rule,

92:50if they have to be,

92:54okay, well, you can think of each application of the rule

92:56as being kind of an event that happens in the universe.

92:59And the input to an event has to be ready

93:04for the event to occur.

93:06That is, if one event occurred,

93:08if one transformation occurred,

93:10and it produced a particular atom of space,

93:12then that atom of space has to already exist

93:17before another transformation that's going to apply

93:20to that atom of space can occur.

93:23So that's like the prerequisite for the event.

93:25That's right, that's right.

93:26So that defines a kind of,

93:30this sort of set of causal relationships between events.

93:33It says, this event has to have happened before this event.

93:38But that is...

93:40But that's not a very limiting constraint.

93:42No, it's not.

93:44And what's interesting...

93:44You still get the zillion,

93:47that's a technical term, options.

93:49That's correct.

93:50But, okay, so this is where things get a little bit more

93:53elaborate, but...

93:54But they're mind blowing, so...

93:56Right, but so what happens is,

93:59so the first thing you might say is,

94:01you know, let's...

94:02Well, okay, so this question about the freedom

94:04of which event you do when.

94:07Well, let me sort of state an answer and then explain it.

94:10Okay, the validity of special relativity

94:14is a consequence of the fact that in some sense,

94:17it doesn't matter in what order you do

94:19these underlying things, so long as they respect

94:22this kind of set of causal relationships.

94:25So...

94:26And that's the part that's in a certain sense

94:30is a really important one,

94:31but the fact that it sometimes doesn't matter,

94:35that's a...

94:37I don't know what to...

94:37That's another, like, beautiful thing.

94:38Well, okay, so there's this idea

94:40of what I call causal invariance.

94:42Causal invariance, exactly.

94:44So that's a...

94:44Really, really powerful idea.

94:46Right, it's a powerful idea,

94:47which has actually arisen in different forms

94:50many times in the history of mathematics,

94:52mathematical logic, even computer science,

94:54has many different names.

94:56I mean, our particular version of it

94:58is a little bit tighter than other versions,

95:00but it's basically the same idea.

95:01Here's how to think about that idea.

95:03So imagine that...

95:05Well, let's talk about it in terms of math for a second.

95:08Let's say you're doing algebra and you're told,

95:10you know, multiply out this series of polynomials

95:14that are multiplied together, okay?

95:16You say, well, which order should I do that in?

95:19Say, well, do I multiply the third one by the fourth one

95:21and then do it by the first one?

95:22Or do I do the fifth one by the sixth one and then do that?

95:25Well, it turns out it doesn't matter.

95:27You can multiply them out in any order,

95:29you'll always get the same answer.

95:31That's a property...

95:33If you think about kind of making a kind of network

95:36that represents in what order you do things,

95:38you'll get different orders

95:40for different ways of multiplying things out,

95:42but you'll always get the same answer.

95:44Same thing if you...

95:45Let's say you're sorting.

95:46You've got a bunch of A's and B's.

95:48They're in random, some random order,

95:50you know, BAA, BBBAA, whatever.

95:53And you have a little rule that says,

95:55every time you see BA, flip it around to AB, okay?

96:00Eventually you apply that rule enough times,

96:02you'll have sorted the string

96:03so that it's all the A's first and then all the B's.

96:07Again, there are many different orders

96:10in which you can do that to many different sort of places

96:13where you can apply that update.

96:15In the end, you'll always get the string sorted the same way.

96:18I know with sorting the string, it sounds obvious.

96:22That's to me surprising

96:24that there is in complicated systems,

96:28obviously with a string,

96:29but in a hypergraph that the application of the rule,

96:33asynchronous rule can lead to the same results sometimes.

96:36Yes, yes, that is not obvious.

96:39And it was something that, you know,

96:40I sort of discovered that idea for these kinds of systems

96:44and back in the 1990s.

96:45And for various reasons, I was not satisfied

96:50by how sort of fragile finding that particular property was.

96:54And let me just make another point,

96:56which is that it turns out that even if the underlying rule

97:01does not have this property of causal invariance,

97:03it can turn out that every observation

97:06made by observers of the rule can,

97:09they can impose what amounts to causal invariance

97:12on the rule.

97:13We can explain that.

97:14It's a little bit more complicated.

97:15I mean, technically that has to do with this idea

97:18of completions, which is something that comes up

97:20in term rewriting systems,

97:21automated theorem proving systems and so on.

97:24But let's ignore that for a second.

97:26We can come to that later.

97:27But is it useful to talk about observation?

97:29Not yet.

97:30Not yet.

97:31It's so great.

97:33So there's some concept of causal invariance

97:35as you apply these rules in an asynchronous way,

97:39you can think of those transformations as events.

97:42So there's this hypergraph that represents space

97:44and all of these events happening in the space

97:47and the graph grows in interesting complicated ways.

97:50And eventually the froth arises of what we experience

97:54as human existence.

97:56So that's it.

97:57That's some version of the picture,

97:58but let's explain a little bit more.

98:00Exactly.

98:01What's a little more detail like?

98:03Right.

98:04Well, so one thing that is sort of surprising

98:06in this theory is one of the sort of achievements

98:10of 20th century physics was kind of bringing

98:12space and time together.

98:13That was, you know, special relativity.

98:15People talk about space time, this sort of unified thing

98:19where space and time kind of a mixed

98:21and there's a nice mathematical formalism

98:24that in which, you know, space and time sort of appear

98:28as part of the space time continuum,

98:30the space time, you know, four vectors and things like this.

98:34You know, we talk about time as the fourth dimension

98:37and all these kinds of things.

98:38It's, you know, and it seems like the theory of relativity

98:42sort of says space and time are fundamentally

98:44the same kind of thing.

98:45So one of the things that took a while to understand

98:48in this approach of mine is that in my kind of approach,

98:54space and time are really not fundamentally

98:56the same kind of thing.

98:57Space is the extension of this hypergraph.

99:00Time is the kind of progress of this inexorable computation

99:04of these rules getting applied to the hypergraph.

99:07So it's, they seem like very different kinds of things.

99:10And so that at first seems like

99:12how can that possibly be right?

99:14How can that possibly be Lorentz invariant?

99:16That's the term for things being, you know,

99:18following the rules of special relativity.

99:21Well, it turns out that when you have causal invariants

99:26that, and let's see, we can, it's worth explaining

99:30a little bit how this works.

99:31It's a little bit elaborate,

99:32but the basic point is that even though space and time

99:38sort of come from very different places,

99:41it turns out that the rules of sort of space time

99:45that special relativity talks about come out of this model

99:51when you're looking at large enough systems.

99:53So a way to think about this, you know,

99:56in terms of when you're looking at large enough systems,

99:59the part of that story is when you look at some fluid

100:03like water, for example, there are equations

100:06that govern the flow of water.

100:08Those equations are things that apply on a large scale.

100:12If you look at the individual molecules,

100:14they don't know anything about those equations.

100:16It's just the sort of the large scale effect

100:19of those molecules turns out to follow those equations.

100:22And it's the same kind of thing happening in our models.

100:25I know this might be a small point,

100:27but it might be a very big one.

100:29We've been talking about space and time

100:32at the lowest level of the model, which is space.

100:35The hypergraph time is the evolution of this hypergraph.

100:39But there's also space time that we think about

100:43and general relativity for your special relativity.

100:47Like how do you go from the lowest source code

100:54of space and time as we're talking about

100:55to the more traditional terminology of space and time?

100:58So the key thing is this thing we call the causal graph.

101:01So the causal graph is the graph

101:03of causal relationships between events.

§13Transcript · 1:41:06–1:49:52

101:06So every one of these little updating events,

101:08every one of these little transformations

101:10of the hypergraph happens somewhere in the hypergraph,

101:13happens at some stage in the computation.

101:16That's an event.

101:18That event has a causal relationship to other events

101:22in the sense that if another event needs as its input,

101:27the output from the first event,

101:29there will be a causal relationship

101:31of the future event will depend on the past event.

101:35So you can say it has a causal connection.

101:37And so you can make this graph

101:39of causal relationships between events.

101:42That graph of causal relationships,

101:44causal invariance implies that that graph is unique.

101:47It doesn't matter even though you think,

101:51oh, I'm, let's say we were sorting a string, for example,

101:54I did that particular transposition of characters

101:57at this time, then I did that one, then I did this one.

102:00Turns out if you look at the network of connections

102:03between those updating events, that network is the same.

102:06It's the, if you were to, the structure.

102:11So in other words, if you were to draw that,

102:13if you were to put that network on a picture

102:15of where you're doing all the updating,

102:17the places where you put the nodes of the network

102:20will be different, but the way the nodes are connected

102:22will always be the same.

102:23So, but the causal graph is, I don't know,

102:27it's kind of an observation, it's not enforced,

102:31it's just emergent from a set of events.

102:33It's a feature of, okay, so what it is is.

102:36The characteristic, I guess, of the way events happen.

102:38Right, it's an event can't happen

102:40until its input is ready.

102:42And so that creates this network of causal relationships.

102:46And that's the causal graph.

102:48And the thing that the next thing to realize is,

102:51okay, we, when you're going to observe

102:54what happens in the universe,

102:56you have to sort of make sense of this causal graph.

102:59So, and you are an observer who yourself

103:02is part of this causal graph.

103:05And so that means, so let me give you an example

103:07of how that works.

103:08So imagine we have a really weird theory of physics

103:11of the world where it says this updating process,

103:15there's only gonna be one update at every moment in time.

103:18And there's just gonna be like a Turing machine.

103:19It has a little head that runs around

103:21and just is always just updating one thing at a time.

103:23So you say, I have a theory of physics

103:26and the theory of physics says,

103:27there's just this one little place where things get updated.

103:30You say, that's completely crazy because,

103:32it's plainly obvious that things are being updated

103:35sort of at the same time.

103:37Async obviously, yeah, at the same time, yeah.

103:39But the fact is that the thing is that if I'm talking to you

103:44and you seem to be being updated as I'm being updated,

103:47but if there's just this one little head

103:48that's running around updating things,

103:51I will not know whether you've been updated or not

103:53until I'm updated.

103:55So in other words, draw this causal graph

103:58of the causal relationship between the updatings in you

104:01and the updatings in me,

104:02it'll still be the same causal graph,

104:04whether even though the underlying sort of story

104:07of what happens is, oh, there's just this one little thing

104:10and it goes and updates in different places in the universe.

104:12So is that clear or is that a hypothesis?

104:18Is that clear that there's a unique causal graph?

104:21If there's causal invariance, there's unique causal graph.

104:24So it's okay to think of what we're talking about

104:28as a hypergraph and the operations on it

104:30as a kind of touring machine with a single head,

104:32like a single guy running around updating stuff.

104:37Is that safe to intuitively think of it this way?

104:40Let me think about that for a second.

104:41Yes, I think so.

104:42I think there's nothing, it doesn't matter.

104:44I mean, you can say, okay, there is one,

104:47the reason I'm pausing for a second is that I'm wondering,

104:52well, when you say running around,

104:55depends how far it jumps every time it runs.

104:57Yeah, yeah, that's right.

104:59But I mean like one operation at a time.

105:02Yeah, you can think of it as one operation at a time.

105:03It's easier for the human brain to think of it that way

105:06as opposed to simultaneous.

105:08Well, maybe it's not, okay, but the thing is

105:10that's not how we experience the world.

105:12What we experience is we look around,

105:15everything seems to be happening

105:17at successive moments in time everywhere in space.

105:21Yes.

105:21That is the, and that's partly a feature

105:23of our particular construction.

105:25I mean, that is the speed of light is really fast

105:28compared to, you know, we look around, you know,

105:30I can see maybe a hundred feet away right now.

105:33You know, it's the, my brain does not process very much

105:38in the time it takes light to go a hundred feet.

105:41The brain operates at a scale of hundreds of milliseconds

105:44or something like that, I don't know.

105:45Right.

105:46And speed of light is much faster.

105:47Right, you know, light goes,

105:49in a billionth of a second light has gone afoot.

105:51So it goes a billion feet every second.

105:53There's certain moments through this conversation

105:56where I imagine the absurdity of the fact

106:01that there's two descendants of apes modeled by a hypergraph

106:05that are communicating with each other

106:06and experiencing this whole thing

106:09as a real time simultaneous update with,

106:13I'm taking in photons from you right now,

106:15but there's something much, much deeper going on here.

106:19Right, it does have a.

106:20It's paralyzing sometimes to just.

106:22Yes.

106:23To remember that.

106:24Right, no, I mean, you know, it's a, you know.

106:26Sorry.

106:27Yes, yes, no.

106:28As a small little tangent, I just remembered

106:30that we're talking about,

106:32I mean, about the fabric of reality.

106:37Right, so we've got this causal graph

106:40that represents the sort of causal relationships

106:41between all these events in the universe.

106:43That causal graph kind of is a representation of space time,

106:47but our experience of it requires

106:50that we pick reference frames.

106:52This is kind of a key idea.

106:54Einstein had this idea that what that means is

106:57we have to say, what are we going to pick

107:01as being the sort of what we define

107:04as simultaneous moments in time?

107:07So for example, we can say, you know,

107:11how do we set our clocks?

107:13You know, if we've got a spacecraft landing on Mars,

107:16you know, do we say that, you know,

107:17what time is it landing at?

107:19Was it, you know, even though there's a 20 minute

107:21speed of light delay or something, you know,

107:23what time do we say it landed at?

107:25How do we set up sort of time coordinates for the world?

107:30And that turns out to be that there's kind of

107:32this arbitrariness to how we set these reference frames

107:35that defines sort of what counts as simultaneous.

107:39And what is the essence of special relativity

107:42is to think about reference frames going at different speeds

107:45and to think about sort of how they assign,

107:48what counts as space, what counts as time and so on.

107:52That's all a bit technical, but the basic bottom line is

107:55that this causal invariance property,

107:58that means that it's always the same causal graph,

108:01independent of how you slice it with these reference frames,

108:04you'll always sort of see the same physical processes go on.

108:07And that's basically why special relativity works.

108:10So there's something like special relativity,

108:14like everything around space and time

108:17that fits this idea of the causal graph.

108:22Right, well, you know, one way to think about it is

108:24given that you have a basic structure

108:27that just involves updating things in these,

108:31you know, connected updates and looking at

108:33the causal relationships between connected updates,

108:35that's enough when you unravel the consequences of that,

108:39that together with the fact that there are lots

108:41of these things and that you can take a continuum limit

108:43and so on implies special relativity.

108:46And so that, it's kind of not a big deal

108:51because it's kind of a, you know,

108:52it was completely unobvious when you started off

108:56with saying, we've got this graph,

108:57it's being updated in time, et cetera, et cetera, et cetera,

109:00that just looks like nothing to do with special relativity.

109:03And yet you get that.

109:05And what, I mean, then the thing,

109:08I mean, this was stuff that I figured out back in the 1990s.

109:11The next big thing you get is general relativity.

109:16And so in this hypergraph,

109:18the sort of limiting structure,

109:20when you have a very big hypergraph,

109:22you can think of as being just like, you know,

109:24water seems continuous on a large scale.

109:27So this hypergraph seems continuous on a large scale.

109:30One question is, you know,

109:31how many dimensions of space does it correspond to?

109:35So one question you can ask is,

109:36if you've just got a bunch of points

109:38and they're connected together,

109:39how do you deduce what effective dimension of space

109:43that bundle of points corresponds to?

109:46And that's pretty easy to explain.

109:47So basically if you say you've got a point

109:50and you look at how many neighbors does that point have?

§14Transcript · 1:49:52–1:58:16

109:52Okay, imagine it's on a square grid.

109:54Then it'll have four neighbors.

109:56Go another level out.

109:58How many neighbors do you get then?

110:00What you realize is as you go more and more levels out,

110:02as you go more and more distance on the graph out,

110:05you're capturing something which is essentially a circle

110:09in two dimensions so that, you know,

110:11the number of the area of a circle is pi R squared.

110:14So it's the number of points that you get to

110:18goes up like the distance you've gone squared.

110:21And in general, in D dimensional space,

110:24it's R to the power D.

110:25It's the number of points you get to

110:28if you go R steps on the graph grows like

110:32the number of steps you go to the power of the dimension.

110:35And that's a way that you can estimate

110:37the effective dimension of one of these graphs.

110:39So what does that grow to?

110:41So how does the dimension grow?

110:42There's a, I mean, obviously the visual aspect

110:45of these hypergraphs,

110:47they're often visualized in three dimensions.

110:50Right.

110:50So there's a certain kind of structure,

110:54like you said, there's, I mean, a circle, a sphere,

110:58there's a planar aspect to it,

111:02to this graph to where it kind of,

111:04it almost starts creating a surface,

111:06like a complicated surface, but a surface.

111:09So how does that connect to effective dimension?

111:11Okay, so if you can lay out the graph

111:14in such a way that the points in the graph that,

111:18you know, the points that are neighbors on the graph

111:21are neighbors as you lay them out,

111:23and you can do that in two dimensions,

111:25then it's gonna approximate a two dimensional thing.

111:28If you can't do that in two dimensions,

111:29if everything would have to fold over a lot

111:31in two dimensions,

111:32then it's not approximating a two dimensional thing.

111:34Maybe you can lay it out in three dimensions.

111:36Maybe you have to lay it out in five dimensions

111:38to have it be the case

111:39that it sort of smoothly lays out like that.

111:42Well, but okay, so I apologize

111:44for the different tangent questions,

111:46but you know, there's an infinity number of possible rules.

111:51So we have to look for rules

111:54that create the kind of structures

111:58that are reminiscent for,

112:01that have echoes of the different physics theories in them.

112:05So what kind of rules,

112:06is there something simple to be said

112:08about the kind of rules that you have found beautiful,

112:12that you have found powerful?

112:13Right, so I mean, what, you know,

112:15one of the features of computational irreducibility is,

112:18it's very, you can't say in advance,

112:21what's gonna happen with any particular,

112:23you can't say, I'm gonna pick these rules

112:26from this part of rule space, so to speak,

112:28because they're gonna be the ones that are gonna work.

112:30That's, you can make some statements along those lines,

112:33but you can't generally say that.

112:35Now, you know, the state of what we've been able to do

112:38is, you know, different properties of the universe,

112:40like dimensionality, you know, integer dimensionality,

112:44features of other features of quantum mechanics,

112:47things like that.

112:48At this point, what we've got is,

112:50we've got rules that any one of those features,

112:55we can get a rule that has that feature.

112:58Yeah, so the.

112:58We don't have the sort of, the final,

113:00here's a rule which has all of these features,

113:02we do not have that yet.

113:03So if I were to try to summarize

113:06the Wolfram physics project, which is, you know,

113:11something that's been in your brain for a long time,

113:13but really has just exploded in activity,

113:17you know, only just months ago.

113:19Yes.

113:20So it's an evolving thing, and next week,

113:23I'll try to publish this conversation

113:24as quickly as possible, because by the time it's published,

113:27already new things will probably have come out.

113:29So if I were to summarize it,

113:33we've talked about the basics of,

113:35there's a hypergraph that represents space,

113:38there is transformations in that hypergraph

113:42that represents time.

113:44The progress of time.

113:45The progress of time, there's a causal graph

113:47that's a characteristic of this,

113:49and the basic process of science,

113:53of, yeah, of science within the Wolfram physics model

113:58is to try different rules and see which properties

114:02of physics that we know of, known physical theories,

114:06are, appear within the graphs that emerge from that rule.

114:10That's what I thought it was going to be.

114:12Uh oh, okay.

114:13So what is it?

114:16It turns out we can do a lot better than that.

114:18It turns out that using kind of mathematical ideas,

114:21we can say, and computational ideas,

114:25we can make general statements,

114:28and those general statements turn out to correspond

114:31to things that we know from 20th century physics.

114:34In other words, the idea of you just try a bunch of rules

114:36and see what they do,

114:37that's what I thought we were gonna have to do.

114:40But in fact, we can say, given causal invariance

114:43and computational irreducibility, we can derive,

114:47and this is where it gets really pretty interesting,

114:49we can derive special relativity,

114:51we can derive general relativity,

114:52we can derive quantum mechanics.

114:55And that's where things really start to get exciting,

114:58is, you know, it wasn't at all obvious to me

115:01that even if we were completely correct,

115:03and even if we had, you know, this is the rule,

115:05you know, even if we found the rule,

115:06to be able to say, yes, it corresponds

115:08to things we already know,

115:10I did not expect that to be the case.

115:12And...

115:13So for somebody who is a simple mind

115:16and definitely not a physicist, not even close,

115:19what does derivation mean in this case?

115:22Okay, so let me, this is an interesting question.

115:26Okay, so there's, so one thing...

115:29In the context of computational irreducibility.

115:31Yeah, yeah, right, right.

115:32So what you have to do, let me go back to, again,

115:36the mundane example of fluids and water

115:39and things like that, right?

115:40So you have a bunch of molecules bouncing around.

115:44You can say, just as a piece of mathematics,

115:47I happen to do this from cellular automata

115:49back in the mid 1980s, you can say,

115:52just as a matter of mathematics,

115:54you can say the continuum limit

115:57of these little molecules bouncing around

115:59is the Navier Stokes equations.

116:01That's just a piece of mathematics.

116:03It's not, it doesn't rely on...

116:06You have to make certain assumptions

116:08that you have to say there's enough randomness

116:10in the way the molecules bounce around

116:12that certain statistical averages work,

116:14et cetera, et cetera, et cetera.

116:15Okay, it is a very similar derivation

116:18to derive, for example, the Einstein equations.

116:21Okay, so the way that works, roughly,

116:23the Einstein equations are about curvature of space.

116:26Curvature of space, I talked about sort of

116:29how you can figure out dimension of space.

116:31There's a similar kind of way of figuring out

116:34if you just sort of say, you know,

116:37you're making a larger and larger ball

116:39or larger and larger, if you draw a circle

116:40on the surface of the earth, for example,

116:42you might think the area of a circle is pi r squared,

116:45but on the surface of the earth,

116:47because it's a sphere, it's not flat,

116:50the area of a circle isn't precisely pi r squared.

116:53As the circle gets bigger, the area is slightly smaller

116:56than you would expect from the formula pi r squared

116:58as a little correction term that depends on the ratio

117:01of the size of the circle to the radius of the earth.

117:03Okay, so it's the same basic thing,

117:05allows you to measure from one of these hypergraphs

117:08what is its effective curvature.

117:11And that's...

117:12So the little piece of mathematics

117:15that explains special general relativity

117:20can map nicely to describe fundamental property

117:25of the hypergraphs, the curvature of the hypergraphs.

117:27So special relativity is about the relationship

117:31of time to space.

117:32General relativity is about curvature

117:35and this space represented by this hypergraph.

117:38So what is the curvature of a hypergraph?

117:40Okay, so first I have to explain,

117:43what we're explaining is,

117:44first thing you have to have is a notion of dimension.

117:47You don't get to talk about curvature of things.

117:49If you say, oh, it's a curved line,

117:51but I don't know what a line is yet.

117:53So...

117:54Yeah, what is the dimension of a hypergraph then?

117:56From where, we've talked about effective dimension, but...

118:00Right, that's what this is about.

118:03What this is about is, you have your hypergraph,

118:05it's got a trillion nodes in it.

118:07What is it roughly like?

118:08Is it roughly like a grid, a two dimensional grid?

118:11Is it roughly like all those nodes are arranged online?

118:15What's it roughly like?

§15Transcript · 1:58:16–2:07:28

118:16And there's a pretty simple mathematical way

118:19to estimate that by just looking at this thing

118:23I was describing, this sort of the size of a ball

118:26that you construct in the hypergraph.

118:28That's a, you just measure that,

118:29you can just compute it on a computer for a given hypergraph

118:33and you can say, oh, this thing is wiggling around,

118:35but it's roughly corresponds to two or something like that,

118:38or roughly corresponds to 2.6 or whatever.

118:41So that's how you have a notion of dimension

118:44in these hypergraphs.

118:45Curvature is something a little bit beyond that.

118:48If you look at how the size of this ball increases

118:52as you increase its radius,

118:53curvature is a correction

118:55to the size increase associated with dimension.

118:58It's a sort of a second order term

119:01in determining the size.

119:03Just like the area of a circle is roughly pi R squared.

119:07So it goes up like R squared.

119:08The two is because it's in two dimensions,

119:11but when that circle is drawn on a big sphere,

119:14the actual formula is pi R squared times one minus

119:19R squared over A squared and some coefficient.

119:22So in other words, there's a correction to,

119:25and that correction term, that gives you curvature.

119:28And that correction term

119:29is what makes this hypergraph correspond,

119:32have the potential to correspond to curved space.

119:35Now, the next question is, is that curvature,

119:38is the way that curvature works

119:40the way that Einstein's equations for general relativity,

119:43is it the way they say it should work?

119:46And the answer is yes.

119:49And so how does that work?

119:54The calculation of the curvature of this hypergraph

119:57for some set of rules?

119:59No, it doesn't matter what the rules are.

120:01So long as they have causal invariance

120:03and computational irreducibility,

120:05and they lead to finite dimensional space,

120:09noninfinite dimensional space.

120:11Noninfinite dimensional.

120:13It can grow infinitely,

120:14but it can't be infinite dimensional.

120:16So what is a infinitely dimensional hypergraph look like?

120:19So that means, for example, so in a tree,

120:22you start from one root of the tree,

120:25it doubles, doubles again, doubles again, doubles again.

120:28And that means if you ask the question,

120:30starting from a given point,

120:32how many points do you get to?

120:34Remember, in like a circle,

120:35you get to R squared, the two there.

120:37On a tree, you get to, for example, two to the R.

120:41It's exponential dimensional, so to speak,

120:43or infinite dimensional.

120:44Do you have a sense of, in the space of all possible rules,

120:48how many lead to infinitely dimensional hypergraphs?

120:53Is that? No.

120:55Okay.

120:56Is that an important thing to know?

120:57Yes, it's an important thing to know.

120:59I would love to know the answer to that.

121:01But it gets a little bit more complicated

121:03because, for example, it's very possibly the case

121:05that in our physical universe,

121:07that the universe started infinite dimensional.

121:10And it only, as the Big Bang,

121:13it was very likely infinite dimensional.

121:16And as the universe sort of expanded and cooled,

121:21its dimension gradually went down.

121:23And so one of the bizarre possibilities,

121:25which actually there are experiments you can do

121:27to try and look at this,

121:28the universe can have dimension fluctuations.

121:31So in other words,

121:31we think we live in a three dimensional universe,

121:33but actually there may be places

121:35where it's actually 3.01 dimensional,

121:37or where it's 2.99 dimensional.

121:40And it may be that in the very early universe,

121:43it was actually infinite dimensional,

121:45and it's only a late stage phenomenon

121:47that we end up getting three dimensional space.

121:49But from your perspective of the hypergraph,

121:51one of the underlying assumptions you kind of implied,

121:55but you have a sense, a hope set of assumptions

121:59that the rules that underlie our universe,

122:03or the rule that underlies our universe is static.

122:08Is that one of the assumptions

122:10you're currently operating under?

122:11Yes, but there's a footnote to that,

122:14which we should get to,

122:15because it requires a few more steps.

122:17Well, actually then, let's backtrack to the curvature,

122:19because we're talking about as long as it's finite dimensional.

122:25Finite dimensional computational irreducibility

122:28and causal invariance,

122:29then it follows that the large scale structure

122:35will follow Einstein's equations.

122:37And now let me again, qualify that a little bit more,

122:40there's a little bit more complexity to it.

122:43The, okay, so Einstein's equations in their simplest form

122:48apply to the vacuum, no matter, just the vacuum.

122:51And they say, in particular, what they say is,

122:54if you have, so there's this term GD6,

122:58that's a term that means shortest path,

123:00comes from measuring the shortest paths on the Earth.

123:03So you look at a bunch of, a bundle of GD6,

123:07a bunch of shortest paths,

123:09it's like the paths that photons

123:11would take between two points.

123:13Then the statement of Einstein's equations,

123:14it's basically a statement about a certain the,

123:18that as you look at a bundle of GD6,

123:20the structure of space has to be such that,

123:22although the cross sectional area of this bundle may,

123:27although the actual shape of the cross section may change,

123:30the cross sectional area does not.

123:31That's a version, that's the most simple minded version

123:35of R mu nu minus a half R G mu nu equals zero,

123:38which is the more mathematical version

123:41of Einstein's equations.

123:42It's a statement of the thing called the Ritchie tensor

123:45is equal to zero.

123:46That's Einstein's equations for the vacuum.

123:50Okay, so we get that as a result of this model,

123:54but footnote, big footnote,

123:57because all the matter in the universe

124:00is the stuff we actually care about.

124:01The vacuum is not stuff we care about.

124:03So the question is, how does matter come into this?

124:06And for that, you have to understand what energy is

124:09in these models.

124:11And one of the things that we realized, you know,

124:15late last year was that there's a very simple interpretation

124:20of energy in these models, okay?

124:22And energy is basically, well, intuitively,

124:28it's the amount of activity in these hypergraphs

124:32and the way that that remains over time.

124:36So a little bit more formally,

124:38you can think about this causal graph

124:41as having these edges that represent causal relationships.

124:44You can think about, oh boy,

124:46there's one more concept that we didn't get to.

124:47It's the notion of space like hypersurfaces.

124:51So this is not as scary as it sounds.

124:55It's a common notion in general activity.

124:59The notion is you are defining what is a possibly,

125:04where in space time might be a particular moment in time.

125:13So in other words, what is a consistent set of places

125:18where you can say, this is happening now, so to speak.

125:21And you make the series of sort of slices

125:25through the space time, through this causal graph

125:29to represent sort of what we consider

125:32to be successive moments in time.

125:34It's somewhat arbitrary because you can deform that

125:37if you're going at a different speed in a special activity,

125:39you tip those things, there are different kinds

125:44of deformations, but only certain deformations

125:46are allowed by the structure of the causal graph.

125:48Anyway, be that as it may, the basic point is

125:52there is a way of figuring out,

125:54you say, what is the energy associated

125:57with what's going on in this hypergraph?

126:00And the answer is there is a precise definition of that.

126:04And it is the formal way to say it is,

126:06it's the flux of causal edges

126:08through space like hypersurfaces.

126:10The slightly less formal way to say it,

126:12it's basically the amount of activity.

126:14See, the reason it gets tricky is you might say

126:18it's the amount of activity per unit volume

126:21in this hypergraph, but you haven't defined what volume is.

126:25So it's a little bit, you have to be a little more careful.

126:27But this hypersurface gives some more formalism to that.

126:30Yeah, yeah, it gives a way to connect that.

126:32But intuitive, we should think about as the just activity.

126:36Right, so the amount of activity that kind of remains

126:39in one place in the hypergraph corresponds to energy.

126:42The amount of activity that is kind of where an activity here

126:45affects an activity somewhere else,

126:48corresponds to momentum.

126:50And so one of the things that's kind of cool

126:53is that I'm trying to think about

126:55how to say this intuitively.

126:56The mathematics is easy,

126:57but the intuitive version, I'm not sure.

126:59But basically the way that things sort of stay

127:01in the same place and have activity

127:03is associated with rest mass.

127:05And so one of the things that you get to derive

127:08is E equals MC squared.

127:10That is a consequence of this interpretation of energy

127:14in terms of the way the causal graph works,

127:18which is the whole thing is sort of a consequence

127:20of this whole story about updates and hypergraphs and so on.

127:23So can you linger on that a little bit?

127:26How do we get E equals MC squared?

§16Transcript · 2:07:28–2:15:46

127:28So where does the mass come from?

127:31Okay, okay.

127:32I mean, is there an intuitive, it's okay.

127:35First of all, you're pretty deep

127:37in the mathematical explorations of this thing right now.

127:41We're in a very, we're in a flux currently.

127:45So maybe you haven't even had time

127:47to think about intuitive explanations, but.

127:51Yeah, I mean, this one is, look, roughly what's happening,

127:56that derivation is actually rather easy.

127:58And everybody, and I've been saying

127:59we should pay more attention to this derivation

128:01because it's such, you know,

128:02cause people care about this one.

128:04But everybody says, it's just easy.

128:05It's easy.

128:07So there's some concept of energy

128:09that can be intuitively thought of as the activity,

128:12the flux, the level of changes that are occurring

128:16based on the transformations within a certain volume,

128:19however the heck do you find the volume.

128:21Okay, so, and then mass.

128:23Well, mass is associated with kind of the energy

128:28that does not cause you to,

128:30that does not somehow propagate through time.

128:34Yeah, I mean, one of the things that was not obvious

128:35in the usual formulation of special relativity

128:38is that space and time are connected in a certain way.

128:42Energy and momentum are also connected in a certain way.

128:46The fact that the connection of energy to momentum

128:49is analogous to the connection to space

128:50between space and time

128:52is not self evident in ordinary relativity.

128:54It is a consequence of this, of the way this model works.

128:58It's an intrinsic consequence of the way this model works.

129:00And it's all to do with that,

129:02with unraveling that connection

129:05that ends up giving you this relationship

129:07between energy and, well, it's energy, momentum, mass,

129:12they're all connected.

129:13And so like, that's hence the general relativity.

129:19You have a sense that it appears to be baked in

129:24to the fundamental properties

129:27of the way these hypergraphs are evolved.

129:29Well, I didn't yet get to,

129:30so I got as far as special relativity and equals MC squared.

129:33The one last step is, in general relativity,

129:37the final connection is energy and mass

129:41cause curvature in space.

129:44And that's something that when you understand

129:47this interpretation of energy,

129:49and you kind of understand the correspondence

129:52to curvature and hypergraphs,

129:54then you can finally sort of, the big final answer is,

129:57you derive the full version of Einstein's equations

130:00for space, time and matter.

130:03And that's some.

130:04Is that, have you, that last piece with curvature,

130:09have, is that, have you arrived there yet?

130:12Oh yeah, we're there, yes.

130:13And here's the way that we,

130:15here's how we're really, really going to know

130:17we've arrived, okay?

130:18So, you know, we have the mathematical derivation,

130:20it's all fine, but, you know,

130:22mathematical derivations, okay.

130:25So one thing that's sort of a,

130:27you know, we're taking this limit

130:29of what happens when you, the limit,

130:31you have to look at things which are large

130:32compared to the size of an elementary length,

130:35small compared to the whole size of the universe,

130:37large compared to certain kinds of fluctuations,

130:40blah, blah, blah.

130:41There's a, there's a, there's a tower

130:43of many, many of these mathematical limits

130:45that have to be taken.

130:46So if you're a pure mathematician saying,

130:48where's the precise proof?

130:50It's like, well, there are all these limits,

130:52we can, you know, we can try each one of them

130:54computationally and we could say, yeah, it really works,

130:57but the formal mathematics is really hard to do.

131:00I mean, for example, in the case of deriving

131:03the equations of fluid dynamics from molecular dynamics,

131:06that derivation has never been done.

131:09There is no rigorous version of that derivation.

131:11So, so that could be.

131:12Because you can't do the limits?

131:13Yeah, because you can't do the limits.

131:15But so the limits allow you to try to describe

131:18something general about the system

131:20and very, very particular kinds of limits that you need

131:22to take with these very.

131:23Right, and the limits will definitely work

131:26the way we think they work.

131:27And we can do all kinds of computer experiments.

131:28It's just a hard derivation.

131:29Yeah, it's just, it's just the mathematical structure

131:32kind of, you know, ends up running right into

131:35computational irreducibility.

131:37And you end up with a bunch of, a bunch of difficulty there.

131:39But here's the way that we're getting really confident

131:42that we know completely what we're talking about,

131:43which is when people study things like black hole mergers,

131:47using Einstein's equations, what do they actually do?

131:51Well, they actually use Mathematica or a whole bunch

131:52to analyze the equations and so on.

131:54But in the end, they do numerical relativity,

131:57which means they take these nice mathematical equations

132:01and they break them down so that they can run them

132:03on a computer.

132:04And they break them down into something

132:05which is actually a discrete approximation

132:07to these equations.

132:08Then they run them on a computer, they get results.

132:11Then you look at the gravitational waves

132:12and you see if they match, okay?

132:14It turns out that our model gives you a direct way

132:18to do numerical relativity.

132:19So in other words, instead of saying,

132:21you start from these continuum equations from Einstein,

132:23you break them down into these discrete things,

132:26you run them on a computer,

132:27you say, we're doing it the other way around.

132:28We're starting from these discrete things

132:30that come from our model.

132:31And we're just running big versions on the computer.

132:34And, you know, what we're saying is,

132:37and this is how things will work.

132:39So the way I'm calling this is proof by compilation,

132:43so to speak, that is, in other words,

132:46you're taking something where, you know,

132:49we've got this description of a black hole system.

132:52And what we're doing is we're showing that the, you know,

132:56what we get by just running our model agrees

132:59with what you would get by doing the computation

133:02from the Einstein equations.

133:04As a small tangent or actually a very big tangent,

133:08but proof by compilation is a beautiful concept.

133:15In a sense, the way of doing physics with this model

133:21is by running it or compiling it.

133:26And have you thought about,

133:29and these things can be very large,

133:32is there a totally new possibilities of computing hardware

133:37and computing software,

133:38which allows you to perform this kind of compilation?

133:42Well, algorithms, software, hardware.

133:44So first comment is these models seem to give one

133:49a lot of intuition about distributed computing,

133:52a lot of different intuition about how to think

133:54about parallel computation.

133:56And that particularly comes from the quantum mechanics

133:58side of things, which we didn't talk about much yet.

134:01But the question of what, you know,

134:04given our current computer hardware,

134:07how can we most efficiently simulate things?

134:10That's actually partly a story of the model itself,

134:12because the model itself has deep parallelism in it.

134:16The ways that we are simulating it,

134:17we're just starting to be able to use that deep parallelism

134:21to be able to be more efficient

134:22in the way that we simulate things.

134:24But in fact, the structure of the model itself

134:27allows us to think about parallel computation

134:30in different ways.

134:31And one of my realizations is that, you know,

134:34so it's very hard to get in your brain

134:37how you deal with parallel computation.

134:38And you're always worrying about, you know,

134:40if multiple things can happen on different computers

134:42at different times, oh, what happens

134:44if this thing happens before that thing?

134:46And we've really got, you know,

134:47we have these race conditions where something can race

134:49to get to the answer before another thing.

134:51And you get all tangled up because you don't know

134:54which thing is gonna come in first.

134:55And usually when you do parallel computing,

134:58there's a big obsession to lock things down

135:00to the point where you've had locks and mutexes

135:03and God knows what else,

135:05where you've arranged it so that there can only be

135:09one sequence of things that can happen.

135:11So you don't have to think about

135:12all the different kinds of things that can happen.

135:14Well, in these models, physics is throwing us into,

135:18forcing us to think about all these possible things

135:20that can happen.

135:21But these models together with what we know from physics

135:24is giving us new ways to think about

135:26all possible things happening,

135:28about all these different things happening in parallel.

135:30And so I'm guessing...

135:31They have built in protection for some of the parallelism.

135:34Well, causal invariance is the built in protection.

135:37Causal invariance is what means that

135:39even though things happen in different orders,

135:41it doesn't matter in the end.

135:43As a person who struggled with concurrent programming

§17Transcript · 2:15:46–2:23:06

135:46in like Java,

135:50with all the basic concepts of concurrent programming,

135:53that if there could be built up

135:55a strong mathematical framework for causal invariance,

136:00that's so liberating.

136:01And that could be not just liberating,

136:03but really powerful for massively distributed computation.

136:08Absolutely.

136:09No, I mean, what's eventual consistency

136:11in distributed databases

136:14is essentially the causal invariance idea.

136:16Yeah. Okay.

136:17So that's...

136:17But have you thought about,

136:22like really large simulations?

136:26Yeah. I mean, I'm also thinking about,

136:28look, the fact is I've spent much of my life

136:30as a language designer, right?

136:31So I can't possibly not think about,

136:34what does this mean for designing languages

136:37for parallel computation?

136:38In fact, another thing that's one of these...

136:41I'm always embarrassed at how long it's taken me

136:44to figure stuff out.

136:45But back in the 1980s,

136:47I worked on trying to make up languages

136:49for parallel computation.

136:50I thought about doing graph rewriting.

136:53I thought about doing these kinds of things,

136:54but I couldn't see how to actually make the connections

136:57to actually do something useful.

136:59I think now physics is kind of showing us

137:02how to make those things useful.

137:04And so my guess is that in time,

137:06we'll be talking about, we do parallel programming.

137:09We'll be talking about programming

137:10in a certain reference frame,

137:12just as we think about thinking about physics

137:14in a certain reference frame.

137:15It's a certain coordination of what's going on.

137:17We say, we're gonna program in this reference frame.

137:19Oh, let's change the reference frame

137:21to this reference frame.

137:22And then our program will seem different

137:25and we'll have a different way to think about it.

137:27But it's still the same program underneath.

137:28So let me ask on this topic,

137:30cause I put out that I'm talking to you.

137:32I got way more questions than I can deal with,

137:34but what pops to mind is a question somebody asked

137:37on Reddit I think is, please ask Dr. Wolfram,

137:42what are the specs of the computer running the universe?

137:46So we're talking about specs of hardware and software

137:51for simulations of a large scale thing.

137:54What about a scale that is comparative

137:57to something that eventually leads

137:59to the two of us talking and about?

138:01Right, right, right.

138:02So actually I did try to estimate that.

138:05And we actually have to go a couple more stages

138:07before we can really get to that answer

138:08because we're talking about this thing.

138:14This is what happens when you build these abstract systems

138:16and you're trying to explain the universe,

138:19they're quite a number of levels deep, so to speak.

138:23But the...

138:25You mean conceptually or like literally?

138:27Cause you're talking about small objects

138:28and there's 10 to the 120 something.

138:31Yeah, right.

138:33It is conceptually deep.

138:35And one of the things that's happening sort of structurally

138:37in this project is, you know, there were ideas,

138:40there's another layer of ideas,

138:41there's another layer of ideas

138:43to get to the different things that correspond to physics.

138:46They're just different layers of ideas.

138:49And they are, you know, it's actually probably,

138:52if anything, getting harder to explain this project

138:54cause I'm realizing that the fraction of way through

138:56that I am so far and explaining this to you is less than,

138:59than, you know, it might be because we know more now,

139:02you know, every week basically we know a little bit more.

139:06And like...

139:07Those are just layers on the initial fundamental structure.

139:10Yes, but the layers are, you know,

139:12you might be asking me, you know,

139:14how do we get the difference between fermions and bosons,

139:18the difference between particles

139:19that can be all in the same state

139:21and particles that exclude each other, okay.

139:24Last three days, we've kind of figured that out.

139:26Okay.

139:27But, and it's very interesting.

139:29It's very cool.

139:31And it's very...

139:32And those are some kind of properties at a certain level,

139:35layer of abstraction on the graph.

139:37Yes, yes.

139:38And there's, but the layers of abstraction are kind of,

139:41they're compounding.

139:42Stacking up.

139:43So it's difficult, but...

139:45But okay.

139:46But the specs nevertheless remain the same.

139:47Okay, the specs underneath.

139:49So I have an estimate.

139:50So the question is, what are the units?

139:52So we've got these different fundamental constants

139:54about the world.

139:56So one of them is the speed of light, which is the...

139:58So the thing that's always the same

140:00in all these different ways of thinking about the universe

140:02is the notion of time, because time is computation.

140:06And so there's an elementary time,

140:08which is sort of the amount of time that we ascribe

140:12to elapsing in a single computational step.

140:16Yeah.

140:17Okay.

140:17So that's the elementary time.

140:18So then there's an elementary...

140:19That's a parameter or whatever.

140:20That's a constant.

140:21It's whatever we define it to be,

140:23because I mean, we don't, you know...

140:25I mean, it's all relative, right?

140:26It doesn't matter.

140:27Yes, it doesn't matter what it is,

140:28because we could be, it could be slower.

140:30It's just a number which we use to convert that

140:33to seconds, so to speak,

140:35because we are experiencing things

140:37and we say this amount of time has elapsed, so to speak.

140:39But we're within this thing.

140:41Absolutely.

140:42So it doesn't matter, right?

140:43But what does matter is the ratio,

140:46what we can, the ratio of the spatial distance

140:49and this hypergraph to this moment of time.

140:54Again, that's an arbitrary thing,

140:55but we measure that in meters per second, for example,

140:58and that ratio is the speed of light.

141:00So the ratio of the elementary distance

141:03to the elementary time is the speed of light, okay?

141:06Perfect.

141:07And so there's another,

141:08there are two other levels of this, okay?

141:11So there is a thing which we can talk about,

141:13which is the maximum entanglement speed,

141:16which is a thing that happens at another level

141:19in this whole sort of story

141:20of how these things get constructed.

141:22That's a sort of maximum speed in quantum,

141:24in the space of quantum states.

141:26Just as the speed of light

141:28is a maximum speed in physical space,

141:30this is a maximum speed in the space of quantum states.

141:32There's another level which is associated

141:35with what we call ruleal space,

141:36which is another one of these maximum speeds.

141:39We'll get to this.

141:40So these are limitations on the system

141:42that are able to capture the kind of physical universe

141:45which we live in.

141:46The quantum mechanical.

141:47There are inevitable features of having a rule

141:51that has only a finite amount of information in the rule.

141:54So long as you have a rule that only involves

141:57a bounded amount, a limited amount of,

142:01only involving a limited number of elements,

142:03limited number of relations,

142:04it is inevitable that there are these speed constraints.

142:07We knew about the one for speed of light.

142:08We didn't know about the one for maximum entanglement speed,

142:11which is actually something that is possibly measurable,

142:14particularly in black hole systems and things like this.

142:17Anyway, this is long, long story short.

142:19You're asking what the processing specs of the universe,

142:23of the sort of computation of the universe.

142:25There's a question of even what are the units

142:27of some of these measurements, okay?

142:29So the units I'm using are Wolfram language instructions

142:31per second, okay?

142:33Because you gotta have some,

142:34what computation are you doing?

142:37There gotta be some kind of frame of reference.

142:38Right, right.

142:39So, because it turns out in the end,

142:41there will be, there's sort of an arbitrariness

142:44in the language that you use to describe the universe.

142:46So in those terms, I think it's like 10 to the 500,

142:51Wolfram language operations per second, I think,

142:54is the, I think it's of that order.

142:56You know, basically.

142:57So that's the scale of the computation.

142:58What about memory?

142:59If there's an interesting thing to say

143:01about storage and memory.

143:02Well, there's a question of how many sort of atoms

143:04of space might there be?

§18Transcript · 2:23:06–2:31:05

143:06You know, maybe 10 to the 400.

143:08We don't know exactly how to estimate these numbers.

143:11I mean, this is based on some, I would say,

143:14somewhat rickety way of estimating things.

143:17You know, when there start to be able to be experiments done,

143:20if we're lucky, there will be experiments

143:21that can actually nail down some of these numbers.

143:24And because of computation reducibility,

143:27there's not much hope for very efficient compression,

143:31like very efficient representation

143:34of this atom space? Good question.

143:35I mean, there's probably certain things, you know,

143:37the fact that we can deduce anything,

143:40okay, the question is how deep does the reducibility go?

143:44Right. Okay.

143:45And I keep on being surprised

143:46that it's a lot deeper than I thought.

143:48Okay, and so one of the things is that,

143:52that there's a question of sort of how much

143:53of the whole of physics do we have to be able to get

143:57in order to explain certain kinds of phenomena?

143:59Like for example, if we want to study quantum interference,

144:02do we have to know what an electron is?

144:05Turns out I thought we did, turns out we don't.

144:08I thought to know what energy is,

144:10we would have to know what electrons were.

144:12We don't.

144:13So you get a lot of really powerful shortcuts.

144:15Right.

144:16There's a bunch of sort of bulk information about the world.

144:19The thing that I'm excited about last few days, okay,

144:22is the idea of fermions versus bosons, fundamental idea

144:27that I mean, it's the reason we have matter

144:29that doesn't just self destruct,

144:31is because of the exclusion principle

144:33that means that two electrons can never be

144:36in the same quantum state.

144:38Is it useful for us to maybe first talk

144:41about how quantum mechanics fits

144:44into the Wolfram physics model?

144:46Yes.

144:47Let's go there.

144:48So we talked about general relativity.

144:49Now, what have you found from quantum mechanics

144:56within and outside of the Wolfram physics?

144:59Right, so I mean, the key idea of quantum mechanics

145:04that sort of the typical interpretation

145:06is classical physics says a definite thing happens.

145:09Quantum physics says there's this whole set of paths

145:12of things that might happen.

145:14And we are just observing some overall probability

145:17of how those paths work.

145:19Okay, so when you think about our hypergraphs

145:22and all these little updates that are going on,

145:24there's a very remarkable thing to realize,

145:27which is if you say, well,

145:29which particular sequence of updates should you do?

145:32Say, well, it's not really defined.

145:33You can do any of a whole collection

145:35of possible sequences of updates.

145:37Okay, that set of possible sequences of updates

145:42defines yet another kind of graph

145:44that we call a multiway graph.

145:46And a multiway graph just is a graph

145:48where at every node, there is a choice

145:52of several different possible things that could happen.

145:55So for example, you go this way, you go that way.

145:57Those are two different edges in the multiway graph.

146:00And you're building up the set of possibilities.

146:02So actually, like, for example, I just made the one,

146:04the multiway graph for tic tac toe, okay?

146:07So tic tac toe, you start off with some board

146:11that, you know, is everything is blank,

146:12and then somebody can put down an X somewhere,

146:15an O somewhere, and then there are different possibilities.

146:18At each stage, there are different possibilities.

146:20And so you build up this multiway graph

146:22of all those possibilities.

146:23Now notice that even in tic tac toe,

146:25you have the feature that there can be something

146:28where you have two different things that happen

146:31and then those branches merge

146:33because you end up with the same shape,

146:35you know, the same configuration of the board,

146:37even though you got there in two different ways.

146:40So the thing that's sort of an inevitable feature

146:42of our models is that just like quantum mechanics suggests,

146:47definite things don't happen.

146:48Instead, you get this whole multiway graph

146:50of all these possibilities.

146:52Okay, so then the question is, so, okay,

146:55so that's sort of a picture of what's going on.

146:58Now you say, okay, well, quantum mechanics

147:00has all these features of, you know,

147:02all this mathematical structure and so on.

147:04How do you get that mathematical structure?

147:07Okay, a couple of things to say.

147:08So quantum mechanics is actually, in a sense,

147:11two different theories glued together.

147:13Quantum mechanics is the theory

147:15of how quantum amplitudes work

147:18that more or less give you the probabilities

147:19of things happening.

147:20And it's the theory of quantum measurement,

147:22which is the theory of how we actually

147:25conclude definite things.

147:27Because the mathematics just gives you

147:29these quantum amplitudes, which are more or less

147:30probabilities of things happening,

147:32but yet we actually observe definite things in the world.

147:36Quantum measurement has always been a bit mysterious.

147:39It's always been something where people just say,

147:41well, the mathematics says this,

147:42but then you do a measurement,

147:43and there are philosophical arguments

147:45about what the measurement is.

147:46But it's not something where there's a theory

147:48of the measurement.

147:49Somebody on Reddit also asked,

147:53please ask Stephen to tell his story

147:56of the double slit experiment.

147:59Okay, yeah, I can.

148:01Is that, does that make sense?

148:02Oh yeah, it makes sense.

148:03Absolutely makes sense.

148:05Why, is this like a good way to discuss?

148:07A little bit.

148:08Let me go, let me explain a couple of things first.

148:10So the structure of quantum mechanics

148:13is mathematically quite complicated.

148:16One of the features, let's see,

148:18well, how to describe this.

148:20Okay, so first point is there's this multiway graph

148:23of all these different paths of things

148:26that can happen in the world.

148:28And the important point is that these,

148:32you can have branchings and you can have mergings.

148:35Okay, so this property turns out causal invariance

148:39is the statement that the number of mergings

148:43is equal to the number of branchings.

148:45Yeah.

148:46So in other words, every time there's a branch,

148:48eventually there will also be a merge.

148:50In other words, every time there were two possibilities

148:52for what might've happened, eventually those will merge.

148:55Beautiful concept by the way, but yeah, yeah, yeah.

148:57So that idea, okay, so then, so that's one thing

149:03and that's closely related to the sort of objectivity

149:07in quantum mechanics.

149:08The fact that we believe definite things happen,

149:10it's because although there are all these different paths,

149:13in some sense, because of causal invariance,

149:15they all imply the same thing.

149:17I'm cheating a little bit in saying that,

149:19but that's roughly the essence of what's going on.

149:22Okay, next thing to think about

149:24is you have this multiway graph,

149:27it has all these different possible things

149:28that are happening.

149:30Now we ask, this multiway graph

149:32is sort of evolving with time.

149:34Over time, it's branching, it's merging,

149:36it's doing all these things, okay?

149:39Question we can ask is if we slice it at a particular time,

149:44what do we see?

149:46And that slice represents in a sense,

149:48something to do with the state of the universe

149:51at a particular time.

149:53So in other words, we've got this multiway graph

149:55of all these possibilities,

149:56and then we're asking, okay, we take the slice,

150:01this slice represents, okay,

150:04each of these different paths

150:05corresponds to a different quantum possibility

150:07for what's happening.

150:09When we take the slice, we're saying,

150:11what are the set of quantum possibilities

150:13that exist at a particular time?

150:14And when you say slice, you slice the graph

150:17and then there's a bunch of leaves.

150:19A bunch of leaves.

150:20Those represent the state of things.

150:23Right, but then, okay, so the important thing

150:26that you are quickly picking up on

150:29is that what matters is kind of

150:31how these leaves are related to each other.

150:34So a good way to tell how leaves are related

150:37is just to say on the step before

150:39do they have a common ancestor?

150:42So two leaves might be,

150:43they might have just branched from one thing

150:45or they might be far away,

150:47way far apart in this graph

150:50where to get to a common ancestor,

150:52maybe you have to go all the way back

150:53to the beginning of the graph,

150:54all the way back to the beginning.

150:55So there's some kind of measure of distance.

150:57Right, but what you get is by making the slice,

151:02we call it branchial space, the space of branches.

§19Transcript · 2:31:05–2:39:58

151:05And in this branchial space,

151:08you have a graph that represents the relationships

151:11between these quantum states in branchial space.

151:14You have this notion of distance in branchial space.

151:18Okay, so.

151:18It's connected to quantum entanglement.

151:20Yes, yes, it's basically,

151:23the distance in branchial space

151:25is kind of an entanglement distance.

151:27So this.

151:28That's a very nice model.

151:29Right, it is very nice, it's very beautiful.

151:33I mean, it's so clean.

151:35I mean, it's really, and it tells one,

151:38okay, so anyway, so then this branchial space

151:42has this sort of map of the entanglements

151:46between quantum states.

151:47So in physical space, we have,

151:50so you can say, take, let's say the causal graph,

151:54and we can slice that at a particular time,

151:57and then we get this map

151:58of how things are laid out in physical space.

152:01When we do the same kind of thing,

152:02there's a thing called the multiway causal graph,

152:04which is the analog of a causal graph

152:06for the multiway system.

152:07We slice that, we get essentially the relationships

152:11between things, not in physical space,

152:13but in the space of quantum states.

152:15It's like which quantum state

152:17is similar to which other quantum state.

152:19Okay, so now I think next thing to say

152:22is just to mention how quantum measurement works.

152:24So quantum measurement has to do with reference frames

152:27in branchial space.

152:29So, okay, so measurement in physical space,

152:33it matters whether how we assign spatial position

152:38and how we define coordinates in space and time.

152:42And that's how we make measurements in ordinary space.

152:45Are we making a measurement based on us sitting still here?

152:48Are we traveling at half the speed of light

152:49and making measurements that way?

152:51These are different reference frames

152:53in which we're making our measurements.

152:54And the relationship between different events

152:57and different points in space and time

153:00will be different depending on what reference frame we're in.

153:04Okay, so then we have this idea

153:06of quantum observation frames,

153:08which are the analog of reference frames,

153:11but in branchial space.

153:13And so what happens is what we realize

153:15is that a quantum measurement is the observer

153:19is sort of arbitrarily determining this reference frame.

153:23The observer is saying, I'm going to understand the world

153:26by saying that space and time are coordinated this way.

153:30I'm gonna understand the world by saying

153:32that quantum states and time are coordinated in this way.

153:36And essentially what happens is

153:38that the process of quantum measurement

153:40is a process of deciding how you slice up

153:44this multiway system in these quantum observation frames.

153:48So in a sense, the observer, the way the observer enters

153:51is by their choice of these quantum observation frames.

153:55And what happens is that the observer,

153:58because, okay, this is again,

154:00another stack of other concepts, but anyway,

154:03because the observer is computationally bounded,

154:06there is a limit to the type of quantum observation frames

154:08that they can construct.

154:09Interesting, okay, so there's some constraints,

154:12some limit on the choice of observation frames.

154:17Right, and by the way, I just want to mention

154:19that there's a, I mean, it's bizarre,

154:21but there's a hierarchy of these things.

154:23So in thermodynamics,

154:27the fact that we believe entropy increases,

154:29we believe things get more disordered,

154:31is a consequence of the fact

154:32that we can't track each individual molecule.

154:34If we could track every single molecule,

154:36we could run every movie in reverse, so to speak,

154:38and we would not see that things are getting more disordered.

154:42But it's because we are computationally bounded,

154:44we can only look at these big blobs

154:46of what all these molecules collectively do,

154:49that we think that things are,

154:52that we describe it in terms of entropy increasing

154:54and so on.

154:55And it's the same phenomenon, basically,

154:58and also a consequence of computational irreducibility

155:01that causes us to basically be forced to conclude

155:04that definite things happen in the world,

155:06even though there's this quantum,

155:08this set of all these different quantum processes

155:10that are going on.

155:11So, I mean, I'm skipping a little bit,

155:15but that's a rough picture.

155:18And in the evolution of the Wolfram Physics Project,

155:21where do you feel we stand on some of the puzzles

155:24that are along the way?

155:25See, you're skipping along a bunch of stuff.

155:28It's amazing how much these things are unraveling.

155:30I mean, you know, these things, look,

155:32it used to be the case that I would agree with Dick Feynman,

155:35nobody understands quantum mechanics, including me, okay?

155:38I'm getting to the point where I think

155:40I actually understand quantum mechanics.

155:41My exercise, okay, is can I explain quantum mechanics

155:45for real at the level of kind of middle school

155:48type explanation?

155:50And I'm getting closer, it's getting there.

155:52I'm not quite there, I've tried it a few times,

155:54and I realized that there are things

155:57where I have to start talking about

155:59elaborate mathematical concepts and so on.

156:00But I think, and you've got to realize

156:03that it's not self evident that we can explain

156:06at an intuitively graspable level,

156:09something which, about the way the universe works,

156:12the universe wasn't built for our understanding,

156:14so to speak.

156:16But I think then, okay, so another important idea

156:21is this idea of branchial space, which I mentioned,

156:25this sort of space of quantum states.

156:27It is, okay, so I mentioned Einstein's equations

156:31describing the effect of mass and energy

156:37on trajectories of particles, on GD6.

156:40The curvature of physical space is associated

156:44with the presence of energy,

156:47according to Einstein's equations, okay?

156:49So it turns out that, rather amazingly,

156:51the same thing is true in branchial space.

156:54So it turns out the presence of energy

156:57or more accurately Lagrangian density,

156:59which is a kind of relativistic invariant version of energy,

157:03the presence of that causes essentially deflection of GD6

157:08in this branchial space, okay?

157:11So you might say, so what?

157:12Well, it turns out that the sort of the best formulation

157:17we have of quantum mechanics,

157:18this Feynman path integral,

157:21is a thing that describes quantum processes

157:26in terms of mathematics that can be interpreted as,

157:31well, in quantum mechanics, the big thing

157:33is you get these quantum amplitudes,

157:35which are complex numbers that represent,

157:38when you combine them together,

157:39represent probabilities of things happening.

157:41And so the big story has been,

157:42how do you derive these quantum amplitudes?

157:45And people think these quantum amplitudes,

157:47they have a complex number,

157:49has a real part and an imaginary part.

157:51You can also think of it as a magnitude and a phase.

157:53And people have sort of thought these quantum amplitudes

157:57have magnitude and phase, and you compute those together.

158:00Turns out that the magnitude and the phase

158:03come from completely different places.

158:06The magnitude comes, okay, so how do you compute things

158:10in quantum mechanics?

158:10Roughly, I'm telling you, I'm getting there

158:13to be able to do this at a middle school level,

158:15but I'm not there yet.

158:17Roughly what happens is you're asking,

158:20does this state in quantum mechanics

158:24evolve to this other state in quantum mechanics?

158:27And you can think about that like a particle traveling

158:30or something traveling through physical space,

158:33but instead it's traveling through branchial space.

158:36And so what's happening is, does this quantum state evolve

158:38to this other quantum state?

158:39It's like saying, does this object move

158:42from this place in space to this other place in space?

158:45Okay, now the way that these quantum amplitudes

158:49characterize kind of to what extent the thing

158:54will successfully reach some particular point

158:56in branchial space, just like in physical space,

158:58you could say, oh, it had a certain velocity

159:00and it went in this direction.

159:02In branchial space, there's a similar kind of concept.

159:05Is there a nice way to visualize for me now

159:08mentally branchial space?

159:10It's just, you have this hypergraph,

159:13sorry, you have this multiway graph.

159:15It's this big branching thing, branching and merging thing.

159:18But I mean, like moving through that space,

159:21I'm just trying to understand what that looks like.

159:25You know, that space is probably exponential dimensional,

159:29which makes it again, another can of worms

159:32in understanding what's going on.

159:33That space as in an ordinary space,

159:36this hypergraph, the spatial hypergraph

159:39limits to something which is like a manifold,

159:42like something like three dimensional space.

159:45Almost certainly the multiway graph limits

159:48to a Hilbert space, which is something that,

159:52I mean, it's just a weird exponential dimensional space.

159:55And by the way, you can ask, I mean,

159:57there are much weirder things that go on.

§20Transcript · 2:39:58–2:48:10

159:58For example, one of the things I've been interested in

160:00is the expansion of the universe in branchial space.

160:03So we know the universe is expanding in physical space,

160:07but the universe is probably also expanding

160:09in branchial space.

160:10So that means the number of quantum states

160:13of the universe is increasing with time.

160:15The diameter of the thing is growing.

160:17Right, so that means that the,

160:19and by the way, this is related

160:22to whether quantum computing can ever work.

160:28Why?

160:29Okay, so let me explain why.

160:30So let's talk about, okay, so first of all,

160:32just to finish the thought about quantum amplitudes,

160:35that the incredibly beautiful thing,

160:37but I'm just very excited about this.

160:40The fine path integral is this formula.

160:44It says that the amplitude, the quantum amplitude

160:47is E to the I S over H bar,

160:49where S is the thing called the action.

160:51And it, okay, so that can be thought of

160:55as representing a deflection of the angle

160:59of this path in the multiway graph.

161:02So it's a deflection of a geodesic in the multiway path

161:05that is caused by this thing called the action,

161:06which is essentially associated with energy, okay?

161:10And so this is a deflection of a path in branchial space

161:13that is described by this path integral,

161:15which is the thing that is the mathematical essence

161:17of quantum mechanics.

161:19Turns out that deflection is,

161:22the deflection of geodesics in branchial space

161:25follows the exact same mathematical setup

161:28as the deflection of geodesics in physical space,

161:31except the deflection of geodesics in physical space

161:34is described with Einstein's equations.

161:36The deflection of geodesics in branchial space

161:38is defined by the Feynman path integral,

161:40and they are the same.

161:42In other words, they are mathematically the same.

161:45So that means that general relativity

161:48is a story of essentially motion in physical space.

161:53Quantum mechanics is a story of essentially motion

161:55in branchial space.

161:57And the underlying equation for those two things,

162:01although it's presented differently

162:02because one's interested in different things

162:04in branchial space than physical space,

162:06but the underlying equation is the same.

162:08So in other words, it's just these two theories,

162:13which are those two sort of pillars

162:14of 20th century physics,

162:16which have seemed to be off in different directions,

162:19are actually facets of the exact same theory.

162:24That's exciting to see where that evolves

162:26and exciting that that just is there.

162:29Right, I mean, to me,

162:31look, having spent some part of my early life

162:34working in the context of these theories

162:37of 20th century physics,

162:39it's, they just, they seem so different.

162:41And the fact that they're really the same

162:44is just really amazing.

162:46Actually, you mentioned double slit experiment, okay?

162:49So the double slit experiment

162:50is an interference phenomenon where you say there are,

162:54you can have a photon or an electron,

162:56and you say there are these two slits

162:58that could have gone through either one,

163:00but there is this interference pattern

163:02where there's destructive interference,

163:05where you might've said in classical physics,

163:07oh, well, if there are two slits,

163:09then there's a better chance

163:10that it gets through one or the other of them.

163:12But in quantum mechanics,

163:13there's this phenomenon of destructive interference

163:15that means that even though there are two slits,

163:18two can lead to nothing,

163:20as opposed to two leading to more

163:22than, for example, one slit.

163:25And what happens in this model,

163:27and we've just been understanding this

163:29in the last few weeks, actually,

163:30is that what essentially happens

163:34is that the double slit experiment

163:38is a story of the interface

163:39between branchial space and physical space.

163:41And what's essentially happening

163:43is that the destructive interference

163:45is the result of the two possible paths

163:48associated with photons going through those two slits

163:51winding up at opposite ends of branchial space.

163:53And so that's why there's sort of nothing there

163:57when you look at it,

163:58is because these two different sort of branches

164:02couldn't get merged together

164:03to produce something that you can measure

164:06in physical space.

164:07Is there a lot to be understood about branchial space?

164:10I guess, mathematically speaking.

164:13Yes, it's a very beautiful mathematical thing.

164:16And it's very, I mean, by the way,

164:18this whole theory is just amazingly rich

164:22in terms of the mathematics that it says should exist.

164:24Okay, so for example,

164:26calculus is a story of infinitesimal change

164:30in integer dimensional space,

164:32one dimensional, two dimensional, three dimensional space.

164:34We need a theory of infinitesimal change

164:37in fractional dimensional and dynamic dimensional space.

164:41No such theory exists.

164:42So there's tools of mathematics that are needed here.

164:45Right.

164:46And this is a motivation for that actually.

164:47Right, and there are indications

164:50and we can do computer experiments

164:51and we can see how it's gonna come out,

164:53but we need to, the actual mathematics doesn't exist.

164:58And in branchial space, it's actually even worse.

165:00There's even more sort of layers of mathematics that are,

165:04we can see how it works roughly

165:06by doing computer experiments,

165:07but to really understand it,

165:10we need more sort of mathematical sophistication.

165:13So quantum computers.

165:14Okay, so the basic idea of quantum computers,

165:17the promise of quantum computers

165:19is quantum mechanics does things in parallel.

165:23And so you can sort of intrinsically do computations

165:26in parallel.

165:27And somehow that can be much more efficient

165:30than just doing them one after another.

165:33And I actually worked on quantum computing a bit

165:36with Dick Feynman back in 1981, two, three,

165:40that kind of timeframe.

165:41And we...

165:42It's a fascinating image.

165:43You and Feynman working on quantum computers.

165:46Well, we tried to work,

165:47the big thing we tried to do was invent a randomness chip

165:51that would generate randomness at a high speed

165:53using quantum mechanics.

165:55And the discovery that that wasn't really possible

165:58was part of the story of,

166:01we never really wrote anything about it.

166:03I think maybe he wrote some stuff,

166:04but we didn't write stuff about what we figured out

166:07about sort of the fact that it really seemed like

166:10the measurement process in quantum mechanics

166:12was a serious damper on what was possible to do

166:15in sort of the possible advantages of quantum mechanics

166:19for computing.

166:20But anyway, so the sort of the promise of quantum computing

166:24is let's say you're trying to factor an integer.

166:28Well, you can, instead of,

166:30when you factor an integer, you might say,

166:31well, does this factor work?

166:32Does this factor work?

166:33Does this factor work?

166:35In ordinary computing,

166:37it seems like we pretty much just have to try

166:39all these different factors,

166:41kind of one after another.

166:43But in quantum mechanics, you might have the idea,

166:45oh, you can just sort of have the physics,

166:48try all of them in parallel, okay?

166:51And there's this algorithm, Shor's algorithm,

166:56which allows you,

166:58according to the formalism of quantum mechanics,

167:01to do everything in parallel

167:02and to do it much faster than you can on a classical computer.

167:05Okay, the only little footnote is

167:08you have to figure out what the answer is.

167:09You have to measure the result.

167:12So the quantum mechanics internally has figured out

167:13all these different branches,

167:15but then you have to pull all these branches together

167:17to say, and the classical answer is this, okay?

167:21The standard theory of quantum mechanics

167:22does not tell you how to do that.

167:24It tells you how the branching works,

167:26but it doesn't tell you the process

167:27of corralling all these things together.

167:30And that process, which intuitively you can see

167:32is gonna be kind of tricky,

167:34but our model actually does tell you

167:37how that process of pulling things together works.

167:40And the answer seems to be, we're not absolutely sure.

167:42We've only got to two times three so far

167:46which is kind of in this factorization

167:50in quantum computers.

167:51But we can, what seems to be the case

167:55is that the advantage you get from the parallelization

167:58from quantum mechanics is lost

168:01from the amount that you have to spend

168:03pulling together all those parallel threads

168:05to get to a classical answer at the end.

168:07Now, that phenomenon is not unrelated

§21Transcript · 2:48:10–2:56:23

168:10to various decoherence phenomena

168:11that are seen in practical quantum computers and so on.

168:14I mean, I should say as a very practical point,

168:16I mean, it's like, should people stop bothering

168:19to do quantum computing research?

168:20No, because what they're really doing

168:23is they're trying to use physics

168:25to get to a new level of what's possible in computing.

168:28And that's a completely valid activity.

168:30Whether you can really put, you know,

168:33whether you can say,

168:34oh, you can solve an NP complete problem.

168:36You can reduce exponential time to polynomial time.

168:39You know, we're not sure.

168:40And I'm suspecting the answer is no,

168:43but that's not relevant to the practical speed ups

168:46you can get by using different kinds of technologies,

168:48different kinds of physics to do basic computing.

168:52But you're saying, I mean,

168:53some of the models you're playing with,

168:55the indication is that to get all the sheep back together

169:02and, you know, to corral everything together,

169:05to get the actual solution to the algorithm is...

169:10You lose all the...

169:10You lose all of the...

169:12By the way, I mean, so again, this question,

169:14do we actually know what we're talking about

169:16about quantum computing and so on?

169:18So again, we're doing proof by compilation.

169:22So we have a quantum computing framework

169:24in Wolfram language,

169:26and which is, you know,

169:26a standard quantum computing framework

169:28that represents things in terms of the standard,

169:31you know, formalism of quantum mechanics.

169:32And we have a compiler that simply compiles

169:36the representation of quantum gates into multiway systems.

169:41So, and in fact, the message that I got

169:43was from somebody who's working on the project

169:46who has managed to compile one of the sort of

169:50a core formalism based on category theory

169:53and core quantum formalism into multiway systems.

169:57So this is...

169:58When you say multiway system, these multiway graphs?

170:00Yes.

170:01So you're compiling...

170:02Yeah, okay, that's awesome.

170:03And then you can do all kinds of experiments

170:05on that multiway graph.

170:06Right, but the point is that what we're saying is

170:08the thing we've got this representation

170:10of let's say Shor's algorithm

170:12in terms of standard quantum gates.

170:14And it's just a pure matter of sort of computation

170:17to just say that is equivalent.

170:19We will get the same result as running this multiway system.

170:23Can you do complexity analysis on that multiway system?

170:26Well, that's what we've been trying to do, yes.

170:28We're getting there.

170:29We haven't done that yet.

170:30I mean, there's a pretty good indication

170:32of how that's gonna work out.

170:33We've done, as I say, our computer experiments.

170:36We've unimpressively gotten to about two times three

170:39in terms of factorization,

170:41which is kind of about how far people have got

170:43with physical quantum computers as well.

170:45But yes, we will be able to do...

170:48We definitely will be able to do complexity analysis

170:50and we will be able to know.

170:51So the one remaining hope for quantum computing

170:55really, really working at this formal level

170:58of quantum brand exponential stuff being done

171:01in polynomial time and so on.

171:03The one hope, which is very bizarre,

171:05is that you can kind of piggyback

171:09on the expansion of branchial space.

171:11So here's how that might work.

171:13So you think, you know, energy conservation,

171:17standard thing in high school physics,

171:18energy is conserved, right?

171:20But now you imagine, you think about energy

171:23in the context of cosmology

171:25and the context of the whole universe.

171:26It's a much more complicated story.

171:28The expansion of the universe kind of violates

171:30energy conservation.

171:32And so for example, if you imagine you've got two galaxies,

171:35they're receding from each other very quickly.

171:37They've got two big central black holes.

171:39You connect a spring between these two central black holes.

171:43Not easy to do in practice,

171:44but let's imagine you could do it.

171:46Now that spring is being pulled apart.

171:49It's getting more potential energy in the spring

171:52as a result of the expansion of the universe.

171:55So in a sense, you are piggybacking on the expansion

171:59that exists in the universe

172:00and the sort of violation of energy conservation

172:03that's associated with that cosmological expansion

172:05to essentially get energy.

172:07You're essentially building a perpetual motion machine

172:09by using the expansion of the universe.

172:12And that is a physical version of that.

172:15It is conceivable that the same thing can be done

172:17in branchial space to essentially mine the expansion

172:22of the universe in branchial space

172:24as a way to get sort of quantum computing for free,

172:29so to speak, just from the expansion of the universe

172:32in branchial space.

172:33Now, the physical space version is kind of absurd

172:35and involves springs between black holes and so on.

172:39It's conceivable that the branchial space version

172:42is not as absurd

172:43and that it's actually something you can reach

172:45with physical things you can build in labs and so on.

172:48We don't know yet.

172:49Okay, so like you were saying,

172:51the branch of space might be expanding

172:54and there might be something that could be exploited.

172:57Right, in the same kind of way

172:59that you can exploit that expansion of the universe

173:03in principle, in physical space.

173:06You just have like a glimmer of hope.

173:08Right, I think that the,

173:09look, I think the real answer is going to be

173:11that for practical purposes,

173:13the official brand that says you can do exponential things

173:18in polynomial time is probably not gonna work.

173:20For people curious to kind of learn more,

173:22so this is more like, it's not middle school,

173:24we're gonna go to elementary school for a second.

173:27Maybe middle school, let's go to middle school.

173:31So if I were to try to maybe write a pamphlet

173:38of like Wolfram physics project for dummies,

173:42AKA for me, or maybe make a video on the basics,

173:47but not just the basics of the physics project,

173:51but the basics plus the most beautiful central ideas.

173:59How would you go about doing that?

174:01Could you help me out a little bit?

174:02Yeah, yeah, I mean, as a really practical matter,

174:05we have this kind of visual summary picture that we made,

174:10which I think is a pretty good,

174:12when I've tried to explain this to people

174:14and it's a pretty good place to start.

174:17As you got this rule, you apply the rule,

174:19you're building up this big hypergraph,

174:22you've got all these possibilities,

174:24you're kind of thinking about that

174:25in terms of quantum mechanics.

174:27I mean, that's a decent place to start.

174:30So basically the things we've talked about,

174:33which is space represented as a hypergraph,

174:37transformation of that space is kind of time.

174:40Yes.

174:41And then...

174:43Structure of that space,

174:45the curvature of that space has gravity.

174:47That can be explained without going anywhere

174:49near quantum mechanics.

174:51I would say that's actually easier to explain

174:53than special relativity.

174:55Oh, so going into general, so go into curvature.

174:58Yeah, I mean, special relativity,

174:59I think it's a little bit elaborate to explain.

175:03And honestly, you only care about it

175:05if you know about special relativity,

175:06if you know how special relativity

175:08is ordinarily derived and so on.

175:09So general relativity is easier.

175:11Is easier, yes.

175:12And then what about quantum?

175:13What's the easiest way to reveal...

175:16I think the basic point is just this.

175:19This fact that there are all these different branches,

175:22that there's this kind of map of how the branches work.

175:25And that, I mean, I think actually the recent things

175:30that we have about the double slit experiment

175:32are pretty good, because you can actually see this.

175:34You can see how the double slit phenomenon arises

175:39from just features of these graphs.

175:41Now, having said that,

175:43there is a little bit of sleight of hand there

175:47because the true story of the way

175:49that double slit thing works

175:51depends on the coordination of branchial space

175:55that, for example, in our internal team,

175:57there is still a vigorous battle going on

176:00about how that works.

176:01And what's becoming clear is...

176:04I mean, what's becoming clear

176:05is that it's mathematically really quite interesting.

176:08I mean, that is that there's a...

176:10It involves essentially putting space filling curves.

176:13You'll basically have a thing

176:14which is naturally two dimensional,

176:15and you're sort of mapping it into one dimension

176:18with a space filling curve.

176:20And it's like, why is it this space filling curve

176:21and another space filling curve?

§22Transcript · 2:56:23–3:04:25

176:23And that becomes a story about Riemann surfaces and things,

176:26and it's quite elaborate.

176:29But there's a more, a little bit sleight of hand way

176:32of doing it where it's surprisingly direct.

176:36It's...

176:37So a question that might be difficult to answer,

176:42but for several levels of people,

176:46could you give me advice on how we can learn more?

176:50Specifically, there is people that are completely outside

176:54and just curious and are captivated

176:57by the beauty of hypergraphs, actually.

177:00So people that just wanna explore, play around with this.

177:04Second level is people from, say, people like me

177:09who somehow got a PhD in computer science,

177:12but are not physicists.

177:14But fundamentally, the work you're doing

177:16is of computational nature.

177:18So it feels very accessible.

177:20So what can a person like that do to learn enough physics

177:27or not to be able to, one, explore the beauty of it,

177:31and two, the final level of contribute something

177:36of a level of even publishable,

177:40like strong, interesting ideas.

177:43So at all those layers, complete beginner,

177:46a CS person, and the CS person that wants to publish.

177:49I mean, I think that, I've written a bunch of stuff,

177:53a person called Jonathan Gorod,

177:54who's been a key person working on this project,

177:56has also written a bunch of stuff.

177:58And some other people started writing things too.

178:00And he's a physicist.

178:02Physicist.

178:02Well, he's, I would say, a mathematical physicist.

178:05Mathematical.

178:06Mathematical physicist.

178:06He's pretty mathematically sophisticated.

178:08He regularly outmathematicizes me.

178:11Yeah, strong mathematical physicist.

178:14Yeah, I looked at some of the papers.

178:16Right, but so, I mean,

178:19I wrote this kind of original announcement blog post

178:22about this project, which people seem to have found.

178:25I've been really happy, actually, that people who,

178:30people seem to have grokked key points from that,

178:34much deeper key points, people seem to have grokked

178:37than I thought they would grokk.

178:39And that's a kind of a long blog post

178:41that explains some of the things we talked about,

178:43like the hypergraph and the basic rules.

178:45And I don't, does it, I forget,

178:47it doesn't have any quantum mechanics in here.

178:49It does. It does.

178:51But we know a little bit more since that blog post

178:54that probably clarifies,

178:56but that blog post does a pretty decent job.

178:59And, you know, talking about things like, again,

179:02something we didn't mention,

179:03the fact that the uncertainty principle

179:04is a consequence of curvature in branchial space.

179:07How much physics should a person know

179:10to be able to understand the beauty of this framework

179:14and to contribute something novel?

179:16Okay, so I think that those are different questions.

179:20So, I mean, I think that the, why does this work?

179:23Why does this make any sense?

179:27To really know that,

179:28you have to know a fair amount of physics, okay?

179:32And for example, have a decent understanding.

179:33When you say, why does this work?

179:35You're referring to the connection between this model

179:38and general relativity, for example.

179:40You have to understand something about general relativity.

179:43There's also a side of this where just

179:45as the pure mathematical framework is fascinating.

179:47Yes.

179:48If you throw the physics out completely.

179:50Then it's quite accessible to, I mean, you know,

179:52I wrote this sort of long technical introduction

179:55to the project, which seems to have been very accessible

179:58to people who are, you know, who understand computation

180:01and formal abstract ideas, but are not specialists

180:04in physics or other kinds of things.

180:07I mean, the thing with the physics part of it is,

180:10you know, there's both a way of thinking

180:14and literally a mathematical formalism.

180:16I mean, it's like, you know,

180:18to know that we get the Einstein equations,

180:19to know we get the energy momentum tensor,

180:22you kind of have to know what the energy momentum tensor is.

180:24And that's physics.

180:25I mean, that's kind of graduate level physics basically.

180:29And so that, you know, making that final connection

180:33is requires some depth of physics knowledge.

180:37I mean, that's the unfortunate thing,

180:38the difference in machine learning and physics

180:40in the 21st century.

180:42Is it really out of reach of a year or two worth of study?

180:47No, you could get it in a year or two,

180:49but you can't get it in a month.

180:51Right.

180:52I mean.

180:53So, but it doesn't require necessarily like 15 years.

180:56No, it does not.

180:57And in fact, a lot of what has happened with this project

181:00makes a lot of this stuff much more accessible.

181:02There are things where it has been quite difficult

181:04to explain what's going on.

181:06And it requires much more, you know,

181:09having the concreteness of being able to do simulations,

181:11knowing that this thing that you might've thought

181:15was just an analogy is really actually what's going on,

181:19makes one feel much more secure

181:21about just sort of saying, this is how this works.

181:24And I think it will be, you know,

181:26the, I'm hoping the textbooks of the future,

181:28the physics textbooks of the future,

181:30there will be a certain compression.

181:32There will be things that used to be

181:33very much more elaborate because for example,

181:35even doing continuous mathematics

181:36versus this discrete mathematics,

181:38that, you know, to know how things work

181:40in continuous mathematics,

181:41you have to be talking about stuff

181:43and waving your hands about things.

181:44Whereas with discrete, the discrete version,

181:47it's just like, here is a picture.

181:49This is how it works.

181:50And there's no, oh, do we get the limit right?

181:53Did this, you know, did this thing that is of,

181:55you know, zero, you know, measure zero object,

181:59you know, interact with this thing in the right way.

182:01You don't have to have that whole discussion.

182:03It's just like, here's a picture, you know,

182:05this is what it does.

182:07And, you know, you can, then it takes more effort to say,

182:09what does it do in the limit when the picture gets very big?

182:12But you can do experiments

182:13to build up an intuition actually.

182:14Yes, right.

182:15And you can get sort of core intuition for what's going on.

182:17Now, in terms of contributing to this, the, you know,

182:20I would say that the study of the computational universe

182:23and how all these programs work

182:24in the computational universe,

182:26there's just an unbelievable amount to do there.

182:28And it is very close to the surface.

182:31That is, you know, high school kids,

182:34you can do experiments.

182:36It's not, you know, and you can discover things.

182:38I mean, you know, we, you can discover stuff about,

182:42I don't know, like this thing about expansion

182:44of branchial space.

182:45That's an absolutely accessible thing to look at.

182:47Now, you know, the main issue with doing these things

182:50is not, there isn't a lot of technical depth difficulty

182:55there.

182:56The actual doing of the experiments, you know,

182:58all the code is all on our website to do all these things.

183:01The real thing is sort of the judgment

183:03of what's the right experiment to do.

183:05How do you interpret what you see?

183:07That's the part that, you know,

183:09people will do amazing things with.

183:11And that's the part that, but,

183:13but it isn't like you have to have done 10 years of study

183:17to get to the point where you can do the experiments.

183:18You don't.

183:19That's a cool thing you can do experiments day one,

183:21basically.

183:22That's the amazing thing about,

183:25and you've actually put the tools out there.

183:27It's beautiful.

183:28It's mysterious.

183:29There's still, I would say, maybe you can correct me.

183:32It feels like there's a huge number of log hanging fruit

183:36on the mathematical side, at least not the physics side,

183:39perhaps.

183:40No, there's, look on the, on the, okay.

183:42On the physics side, we are,

183:45we're definitely in harvesting mode, you know.

183:48Of which, which fruit, the low hanging ones or?

183:50The low hanging ones, yeah, right.

183:52I mean, basically here's the thing.

183:54There's a certain list of, you know,

183:56here are the effects in quantum mechanics.

183:57Here are the effects in general activity.

183:59It's just like industrial harvesting.

184:02It's like, can we get this one, this one, this one,

184:04this one, this one?

184:05And the thing that's really, you know,

184:07interesting and satisfying, and it's like, you know,

184:10is one climbing the right mountain?

184:11Does one have the right model?

184:12The thing that's just amazing is, you know,

184:15we keep on like, are we going to get this one?

184:18How hard is this one?

184:19It's like, oh, you know, it looks really hard.

184:22It looks really hard.

184:23Oh, actually we can get it.

§23Transcript · 3:04:26–3:12:41

184:26And.

184:27And you're, you're continually surprised.

184:29I mean, it seems like I've been following your progress.

184:31It's kind of exciting.

184:32All the, in harvesting mode,

184:34all the things you're picking up along the way.

184:35Right, right.

184:36No, I mean, it's, it's the thing that is,

184:38I keep on thinking it's going to be more difficult

184:40than it is.

184:41Now that's a, you know, that's a, who knows what,

184:43I mean, the one thing, so the, the, the,

184:45the thing that's been a, was a big thing

184:48that I think we're, we're pretty close to.

184:50I mean, I can give you a little bit of the roadmap.

184:52It's sort of interesting to see, it's like,

184:54what are particles?

184:55What are things like electrons?

184:56How do they really work?

184:58Are you close to get like, what, what's a,

185:01are you close to trying to understand like the atom,

185:03the electrons, neutrons, protons?

185:06Okay, so this is, this is the stack.

185:08So the first thing we want to understand is

185:11the quantization of spin.

185:13So particles, they, they kind of spin,

185:15they have a certain angular momentum,

185:18that angular momentum,

185:19even though the masses of particles are all over the place,

185:22you know, the electron has a mass of 0.511 MeV,

185:25but you know, the proton is 938 MeV, et cetera, et cetera,

185:28et cetera, they're all kind of random numbers.

185:30The, the spins of all these particles

185:32are either integers or half integers.

185:34And that's a fact that was discovered in the 1920s, I guess.

185:38The, I think that we are close to understanding

185:44why spin is quantized.

185:45And that's a, and it, it appears to be

185:48a quite elaborate mathematical story

185:50about homotopic groups in twister space

185:53and all kinds of things.

185:54But bottom line is that seems within reach.

185:58And that's, that's a big deal

185:59because that's a very core feature of understanding

186:01how particles work in quantum mechanics.

186:04Another core feature is this difference between particles

186:07that obey the exclusion principle and sort of stay apart,

186:10that leads to the stability of matter and things like that,

186:13and particles that love to get together

186:15and be in the same state, things like photons,

186:18that, and that's what leads to phenomena like lasers,

186:22where you can get sort of coherently

186:23everything in the same state.

186:25That difference is the particles of integer spin

186:29are bosons like to get together in the same state,

186:31the particles of half integer spin are fermions,

186:34like electrons that they tend to stay apart.

186:37And so the question is, can we get that in our models?

186:41And, oh, just the last few days, I think we made,

186:45I mean, I think the story of,

186:47I mean, it's one of these things where we're really close.

186:51Is this connected fermions and bosons?

186:53Yeah, yeah.

186:54So this was what happens is what seems to happen, okay?

186:57It's, you know, subject to revision in the next few days.

187:01But what seems to be the case is that

187:04bosons are associated with essentially

187:06merging in multiway graphs,

187:08and fermions are associated with branching

187:10in multiway graphs.

187:11And that essentially the exclusion principle

187:15is the fact that in branchial space,

187:18things have a certain extent in branchial space

187:21that in which things are being sort of forced apart

187:24in branchial space, whereas the case of bosons,

187:26they get, they come together in branchial space.

187:29And the real question is, can we explain the relationship

187:32between that and these things called spinners,

187:34which are the representation of half integer spin particles

187:37that have this weird feature that usually when you go

187:39around 360 degree rotation,

187:41you get back to where you started from.

187:43But for a spinner, you don't get back

187:44to where you started from.

187:46It takes 720 degrees of rotation to get back

187:48to where you started from.

187:50And we are just, it feels like we are,

187:53we're just incredibly close to actually having that,

187:55understanding how that works.

187:57And it turns out, it looks like,

187:59my current speculation is that it's as simple

188:01as the directed hypergraphs versus undirected hypergraphs,

188:07the relationship between spinners and vectors.

188:10So, which is just interesting.

188:11Yeah, that would be interesting if these are all these kind

188:13of nice properties of this multi way graphs of branching

188:18and rejoining.

188:19Spinners have been very mysterious.

188:21And if that's what they turn out to be,

188:23there's going to be an easy explanation

188:25of what's going on.

188:26Directive versus undirective.

188:27It's just, and that's why there's only two different cases.

188:30It's why are spinners important in quantum mechanics?

188:34Can you just give a...

188:35Yeah, so spinners are important because they are,

188:39they're the representation of electrons

188:41which have half an inch of spin.

188:43They are, the wave functions of electrons are spinners.

188:48Just like the wave functions of photons are vectors,

188:51the wave functions of electrons are spinners.

188:54And they have this property that when you rotate

188:58by 360 degrees, they come back to minus one of themselves

189:02and take 720 degrees to get back to the original value.

189:06And they are a consequence of,

189:10we usually think of rotation in space as being,

189:15when you have this notion of rotational invariance

189:18and rotational invariance, as we ordinarily experience it,

189:22doesn't have the feature.

189:23If you go through 360 degrees,

189:24you go back to where you started from,

189:26but that's not true for electrons.

189:28And so that's why understanding how that works is important.

189:32Yeah, I've been playing with Mobius Strip

189:34quite a bit lately, just for fun.

189:37Yes, yes.

189:37It adds some funk, it has the same kind of funky properties.

189:41Yes, right, exactly.

189:41You can have this so called belt trick,

189:43which is this way of taking an extended object

189:45and you can see properties like spinners

189:47with that kind of extended object that...

189:50Yeah, it would be very cool if there's,

189:51it somehow connects the directive versus undirective.

189:53I think that's what it's gonna be.

189:54I think it's gonna be as simple as that, but we'll see.

189:57I mean, this is the thing that,

189:59this is the big sort of bizarre surprise is that,

190:03because I learned physics as probably, let's say,

190:07let's say a fifth generation in the sense that,

190:10if you go back to the 1920s and so on,

190:11there were the people who were originating

190:13quantum mechanics and so on.

190:15Maybe it's a little less than that.

190:16Maybe I was like a third generation or something.

190:19I don't know, but the people from whom I learned physics

190:23were the people who had been students of the students

190:26of the people who originated

190:28the current understanding of physics.

190:31And we're now at probably the seventh generation

190:33of physicists or something

190:35from the early days of 20th century physics.

190:38And whenever a field gets that many generations deep,

190:43it seems the foundations seem quite inaccessible.

190:46And they seem, it seems like

190:48you can't possibly understand that.

190:49We've gone through seven academic generations

190:52and that's been, you know, that's been this thing

190:55that's been difficult to understand for that long.

190:58It just can't be that simple.

191:01But in a sense, maybe that journey takes you

191:03to a simple explanation that was there all along.

191:07That's the whole. Right, right, right.

191:08I mean, you know, and the thing for me personally,

191:10the thing that's been quite interesting is, you know,

191:13I didn't expect this project to work in this way.

191:16And I, you know, but I had this sort of weird piece

191:19of personal history that I used to be a physicist

191:21and I used to do all this stuff.

191:23And I know, you know, the standard canon of physics,

191:26I knew it very well.

191:28And, you know, but then I'd been working

191:31on this kind of computational paradigm

191:33for basically 40 years.

191:35And the fact that, you know, I'm sort of now coming back

191:38to, you know, trying to apply that in physics,

191:42it kind of felt like that journey was necessary.

191:44Was this, when did you first try to play with a hypergraph?

191:49So what happened is,

191:50yeah, so what I had was, okay, so this is again,

191:53you know, one always feels dumb after the fact.

191:56It's obvious after the fact.

191:58But so back in the early 1990s,

192:02I realized that using graphs

192:05as a sort of underlying thing underneath space and time

192:07was going to be a useful thing to do.

192:09I figured out about multiway systems.

192:12I figured out the things about general relativity

192:14I'd figured out by the end of the 1990s.

192:17But I always felt there was a certain inelegance

192:20because I was using these graphs

192:21and there were certain constraints on these graphs

192:23that seemed like they were kind of awkward.

192:26It was kind of like, you can pick,

192:28it's like you couldn't pick any rule.

192:30It was like pick any number, but the number has to be prime.

192:33It was kind of like you couldn't,

192:34it was kind of an awkward special constraint.

192:36I had these trivalent graphs,

192:38graphs with just three connections from every node.

§24Transcript · 3:12:41–3:20:27

192:41Okay, so, but I discovered a bunch of stuff with that.

192:44And I thought it was kind of inelegant.

192:46And, you know, the other piece of sort of personal history

192:48is obviously I spent my life

192:50as a computational language designer.

192:52And so the story of computational language design

192:55is a story of how do you take all these random ideas

192:58in the world and kind of grind them down

193:00into something that is computationally

193:02as simple as possible.

193:04And so, you know, I've been very interested

193:06in kind of simple computational frameworks

193:09for representing things and have, you know,

193:12ridiculous amounts of experience in trying to do that.

193:15And actually all of those trajectories of your life

193:18kind of came together.

193:19So you make it sound like you could have come up

193:21with everything you're working on now decades ago,

193:24but in reality.

193:26Look, two things slowed me down.

193:28I mean, one thing that slowed me down was

193:30I couldn't figure out how to make it elegant.

193:32And that turns out hypergraphs were the key to that.

193:35And that I figured out about less than two years ago now.

193:40And the other, I mean, I think,

193:43so that was sort of a key thing.

193:46Well, okay, so the real embarrassment of this project, okay,

193:49is that the final structure that we have

193:52that is the foundation for this project

193:55is basically a kind of an idealized version,

194:00a formalized version of the exact same structure

194:03that I've used to build computational languages

194:05for more than 40 years.

194:07But it took me, but I didn't realize that.

194:09And, you know.

194:11And there yet may be others.

194:12So we're focused on physics now,

194:14but I mean, that's what the new kind of science was about.

194:17Same kind of stuff.

194:19And this, in terms of mathematically,

194:21well, the beauty of it.

194:22So there could be entire other kind of objects

194:26that are useful for,

194:27like we're not talking about, you know,

194:29machine learning, for example.

194:31Maybe there's other variants of the hypergraph

194:33that are very useful for reasoning.

194:35Well, we'll see whether the multiway graph

194:37or machine learning system is interesting.

194:40Okay.

194:41Let's leave it at that.

194:42That's conversation number three.

194:43That's, we're not gonna go there right now, but.

194:47One of the things you've mentioned

194:49is the space of all possible rules

194:52that we kind of discussed a little bit.

194:55That, you know, that could be, I guess,

194:58the set of possible rules is infinite.

195:00Right.

195:01Well, so here's the big sort of one of the conundrums

195:04that I'm kind of trying to deal with is,

195:07let's say we think we found the rule for the universe

195:11and we say, here it is.

195:13You know, write it down.

195:14It's a little tiny thing.

195:15And then we say, gosh, that's really weird.

195:18Why did we get that one?

195:20Right.

195:21And then we're in this whole situation

195:23because let's say it's fairly simple.

195:25How did we come up the winners

195:27getting one of the simple possible universe rules?

195:30Why didn't we get what some incredibly complicated rule?

195:33Why do we get one of the simpler ones?

195:34And that's a thing which, you know,

195:36in the history of science, you know,

195:38the whole sort of story of Copernicus and so on was,

195:42you know, we used to think the earth

195:43was the center of the universe,

195:44but now we find out it's not.

195:46And we're actually just in some, you know,

195:47random corner of some random galaxy

195:50out in this big universe, there's nothing special about us.

195:53So if we get, you know, universe number 317

195:58out of all the infinite number of possibilities,

196:00how do we get something that small and simple?

196:02Right, so I was very confused by this.

196:05And it's like, what are we going to say about this?

196:06How are we going to explain this?

196:08And I thought it was, might be one of these things

196:10where you just, you know, you can get it to the threshold,

196:13and then you find out its rule number, such and such,

196:15and you just have no idea why it's like that.

196:17Okay, so then I realized

196:20it's actually more bizarre than that, okay?

196:22So we talked about multiway graphs.

196:25We talked about this idea that

196:26you take these underlying transformation rules

196:29on these hypergraphs, and you apply them

196:31wherever the rule can apply, you apply it.

196:34And that makes this whole multiway graph of possibilities.

196:37Okay, so let's go a little bit weirder.

196:39Let's say that at every place,

196:42not only do you apply a particular rule

196:45in all possible ways it can apply,

196:47but you apply all possible rules

196:49in all possible ways they can apply.

196:51As you say, that's just crazy.

196:53That's way too complicated.

196:54You're never going to be able to conclude anything.

196:57Okay, however, turns out that...

197:00Don't tell me there's some kind of invariance.

197:02Yeah, yeah.

197:04So what happens is...

197:06And that would be amazing.

197:08Right, so this thing that you get

197:11is this kind of ruleal multiway graph,

197:13this multiway graph that is a branching of rules

197:15as well as a branching of possible applications of rules.

197:19This thing has causal invariance.

197:22It's an inevitable feature that it shows causal invariance.

197:25And that means that you can take different reference frames,

197:28different ways of slicing this thing,

197:30and they will all in some sense be equivalent.

197:33If you make the right translation, they will be equivalent.

197:37So, okay, so the basic point here is...

197:40If that's true, that would be beautiful.

197:43It is true, and it is beautiful.

197:45It's not just an intuition, there is some...

197:47No, no, no, there's real mathematics behind this,

197:50and it is...

197:53Okay, so here's where it comes in.

197:55Yeah, that's amazing.

197:57Right, so by the way, I mean,

197:58the mathematics it's connected to

198:00is the mathematics of higher category theory

198:02and group voids and things like this,

198:04which I've always been afraid of,

198:05but now I'm finally wrapping my arms around it.

198:09But it's also related to...

198:13It also relates to computational complexity theory.

198:16It's also deeply related to the P versus NP problem

198:19and other things like this.

198:20Again, it seems completely bizarre

198:21that these things are connected,

198:22but here's why it's connected.

198:25This space of all possible...

198:28Okay, so a Turing machine, very simple model of computation.

198:32You know, you just got this tape

198:34where you write down, you know, ones and zeros

198:36or something on the tape,

198:37and you have this rule that says, you know,

198:40you change the number,

198:41you move the head on the tape, et cetera.

198:44You have a definite rule for doing that.

198:46A deterministic Turing machine

198:47just does that deterministically.

198:50Given the configuration of the tape,

198:51it will always do the same thing.

198:53A non deterministic Turing machine

198:55can have different choices that it makes at every step.

198:58And so, you know, you know this stuff,

199:01you probably teach this stuff.

199:04It, you know, so a non deterministic Turing machine

199:09has the set of branching possibilities,

199:11which is in fact, one of these multiway graphs.

199:14And in fact, if you say,

199:16imagine the extremely non deterministic Turing machine,

199:19the Turing machine that can just do,

199:22that takes any possible rule at each step,

199:25that is this real multiway graph.

199:27The set of possible histories

199:31of that extreme non deterministic Turing machine

199:33is a Rulio multiway graph.

199:35And you're, what term are you using?

199:37Rulio?

199:38Rulio.

199:39Rulio, I like it.

199:40It's a weird word.

199:41Yeah, it's a weird word, right?

199:41Rulio multiway graph.

199:44Okay, so this, so that.

199:45I'm trying to think of,

199:48I'm trying to think of the space of rules.

199:51So these are basic transformations.

199:54So in a Turing machine,

199:55it's like it says, move left, move, you know,

199:58if it's a one, if it's a black square under the head,

200:02move left and right to green square.

200:04That's a rule.

200:05That's a very basic rule,

200:06but I'm trying to see the rules on the hypergraphs,

200:09how rich of the programs can they be?

200:12Or do they all ultimately just map into something simple?

200:15Yeah, they're all, I mean, hypergraphs,

200:18that's another layer of complexity on this whole thing.

200:20You can think about these in transformations of hypergraphs,

200:23but Turing machines are a little bit simpler.

200:24You just think of it Turing machines, okay.

200:25Right, they're a little bit simpler.

§25Transcript · 3:20:27–3:29:11

200:27So if you look at these extreme

200:29non deterministic Turing machines,

200:30you're mapping out all the possible non deterministic paths

200:35that the Turing machine can follow.

200:37And if you ask the question, can you reach, okay,

200:41so a deterministic Turing machine follows a single path.

200:44The non deterministic Turing machine fills out

200:46this whole sort of ball of possibilities.

200:50And so then the P versus MP problem

200:53ends up being questions about,

200:55and we haven't completely figured out

200:56all the details of this,

200:57but it's basically has to do with questions

200:59about the growth of that ball relative

201:03to what happens with individual paths and so on.

201:05So essentially there's a geometrization

201:07of the P versus MP problem that comes out of this.

201:10That's a sideshow, okay.

201:12The main event here is the statement

201:14that you can look at this multiway graph

201:19where the branches correspond

201:21not just to different applications of a single rule,

201:24but to different applications of different rules, okay.

201:28And that then that when you say,

201:31I'm going to be an observer embedded in that system

201:35and I'm going to try and make sense

201:36of what's going on in the system.

201:38And to do that, I essentially am picking a reference frame

201:43and that turns out to be, well, okay.

201:46So the way this comes out essentially

201:48is the reference frame you pick

201:50is the rule that you infer is what's going on

201:53in the universe, even though all possible rules

201:57are being run, although all those possible rules

202:01are in a sense giving the same answer

202:02because of causal invariance.

202:04But what you see could be completely different.

202:08If you pick different reference frames,

202:10you essentially have a different description language

202:12for describing the universe.

202:14Okay, so what does this really mean in practice?

202:17So imagine there's us.

202:19We think about the universe in terms of space and time

202:22and we have various kinds of description models and so on.

202:25Now let's imagine the friendly aliens, for example, right?

202:29How do they describe their universe?

202:31Well, you know, our description of the universe

202:33probably is affected by the fact that, you know,

202:36we are about the size we are, you know,

202:37a meter ish tall, so to speak.

202:40We have brain processing speeds,

202:41we're about the speeds we have.

202:43We're not the size of planets, for example,

202:46where the speed of light really would matter.

202:48You know, in our everyday life,

202:50the speed of light doesn't really matter.

202:51Everything can be, you know,

202:52the fact that the speed of light is finite is irrelevant.

202:55It could as well be infinite.

202:56We wouldn't make any difference.

202:58You know, it affects the ping times on the internet.

203:01That's about the level of how we notice the speed of light.

203:06In our sort of everyday existence,

203:07we don't really notice it.

203:09And so we have a way of describing the universe

203:12that's based on our sensory, you know, our senses,

203:17these days also on the mathematics we've constructed

203:19and so on, but the realization is

203:22it's not the only way to do it.

203:24There will be completely, utterly incoherent descriptions

203:28of the universe, which correspond

203:30to different reference frames in this sort of ruleal space.

203:34In the ruleal space, that's fascinating.

203:36So we have some kind of reference frame

203:38in this ruleal space, and from that.

203:41That's why we are attributing this rule to the universe.

203:45So in other words, when we say,

203:47why is it this rule and not another,

203:49the answer is just, you know,

203:52shine the light back on us, so to speak.

203:54It's because of the reference frame that we've picked

203:57in our way of understanding what's happening

203:58in this sort of space of all possible rules and so on.

204:02But also in the space from this reference frame,

204:06because of the ruleal, the invariance,

204:12that simple, that the rule on which the universe,

204:17with which you can run the universe,

204:19might as well be simple.

204:21Yes, yes, but okay, so here's another point.

204:23So this is, again, these are a little bit mind twisting

204:26in some ways, but the, okay, another thing that's sort of,

204:31we know from computation is this idea

204:34of computation universality.

204:36The fact that given that we have a program

204:38that runs on one kind of computer, we can as well,

204:42you know, we can convert it to run

204:44on any other kind of computer.

204:45We can emulate one kind of computer with another.

204:47So that might lead you to say, well,

204:50you think you have the rule for the universe,

204:52but you might as well be running it on a Turing machine

204:54because we know we can emulate any computational rule

204:59on any kind of machine.

205:00And that's essentially the same thing

205:02that's being said here.

205:03That is that what we're doing is we're saying

205:07these different interpretations of physics correspond

205:11to essentially running physics

205:13on different underlying, you know,

205:16thinking about the physics as running in different

205:18with different underlying rules

205:19as if different underlying computers were running them.

205:22And, but because of computation universality

205:26or more accurately, because of this principle

205:27of computational equivalence thing of mine,

205:30there's that they are,

205:33these things are ultimately equivalent.

205:35So the only thing that is the ultimate fact

205:38about the universe, the ultimate fact that doesn't depend

205:40on any of these, you know, we don't have to talk

205:42about specific rules, et cetera, et cetera, et cetera.

205:44The ultimate fact is the universe is computational

205:48and it is the things that happen in the universe

205:52are the kinds of computations that the principle

205:54of computational equivalence says should happen.

205:57Now that might sound like you're not really saying

206:00anything there, but you are because you can,

206:03you could in principle have a hyper computer

206:06that things that take an ordinary computer

206:09an infinite time to do the hyper computer can just say,

206:12oh, I know the answer.

206:13It's this immediately.

206:15What this is saying is the universe is not a hyper computer.

206:19It's not simpler than a,

206:21an ordinary Turing machine type computer.

206:24It's exactly like an ordinary Turing machine type computer.

206:28And so that's the, that's in the end,

206:30the sort of net net conclusion is that's the thing

206:34that is the sort of the hard immovable fact

206:36about the universe.

206:38That's sort of the fundamental principle of the universe

206:41is that it is computational and not hyper computational

206:45and not sort of infra computational.

206:47It is this level of computational ability

206:50and it's, it kind of has,

206:53and that's sort of the, the, the core fact, but now,

206:57you know, this, this idea that you can have these different

206:59kind of a rule reference frames,

207:02these different description languages for the universe.

207:05It makes me, you know, I used to think, okay, you know,

207:08imagine the aliens,

207:09imagine the extraterrestrial intelligence thing, you know,

207:12at least they experienced the same physics.

207:15And now I've realized it isn't true.

207:17They could have a different rule frame.

207:19That's fascinating.

207:20That they can end up with a, a, a,

207:23a description of the universe that is utterly,

207:26utterly incoherent with ours.

207:28And that's also interesting in terms of how we think about,

207:31well, intelligence, the nature of intelligence and so on.

207:33You know, I'm, I'm fond of the quote, you know,

207:35the weather has a mind of its own because these are,

207:38you know, these are sort of computationally that,

207:41that system is computationally equivalent to the system

207:44that is our brains and so on.

207:46And what's different is we don't have a way to understand,

207:49you know, what the weather is trying to do, so to speak.

207:52We have a story about what's happening in our brains.

207:54We don't have a sort of connection

207:56to what's happening there.

207:57So we actually, it's funny,

207:59last time we talked maybe over a year ago,

208:04we talked about how it was more based on your work

208:08with Arrival.

208:09We talked about how would we communicate

208:11with alien intelligences.

208:14Can you maybe comment on how we might,

208:18how the Wolfram Physics Project changed your view,

208:20how we might be able to communicate

208:22with alien intelligence?

208:23Like if they showed up,

208:25is it possible that because of our comprehension

208:30of the physics of the world might be completely different,

208:33we would just not be able to communicate at all?

208:36Here's the thing, you know, intelligence is everywhere.

208:41The fact this idea that there's this notion of,

208:43oh, there's gonna be this amazing

208:45extraterrestrial intelligence

208:46and it's gonna be this unique thing.

208:48It's just not true.

208:50It's the same thing.

208:51You know, I think people will realize this

208:53about the time when people decide

208:54that artificial intelligences are kind of

208:57just natural things that are like human intelligences.

209:01They'll realize that extraterrestrial intelligences

209:04or intelligences associated with physical systems

209:07and so on, it's all the same kind of thing.

209:09It's ultimately computation.

§26Transcript · 3:29:11–3:37:13

209:11It's all the same.

209:12It's all just computation.

209:13And the issue is, can you, are you sort of inside it?

209:17Are you thinking about it?

209:19Do you have sort of a story you're telling yourself

209:22about it?

209:23And you know, the weather could have a story

209:25it's telling itself about what it's doing.

209:27We just, it's utterly incoherent with the stories

209:30that we tell ourselves based on how our brains work.

209:33I mean, ultimately it must be a question

209:37whether we can align.

209:39Exactly.

209:40Align with the kind of intelligence.

209:41Right, right, right.

209:42So there's a systematic way of doing it.

209:44Right, so the question is in the space

209:45of all possible intelligences,

209:47what's the, how do you think about the distance

209:50between description languages

209:52for one intelligence versus another?

209:54And needless to say, I have thought about this

209:57and you know, I don't have a great answer yet,

210:00but I think that's a thing

210:02where there will be things that can be said

210:04and there'll be things that where you can sort of

210:06start to characterize, you know,

210:08what is the translation distance between this,

210:12you know, version of the universe

210:15or this kind of set of computational rules

210:17and this other one.

210:18In fact, okay, so this is a, you know,

210:21there's this idea of algorithmic information theory.

210:23There's this question of sort of what is the,

210:25when you have something,

210:28what is the sort of shortest description you can make of it

210:31where that description could be saying,

210:33run this program to get the thing, right?

210:36So I'm pretty sure that there will be a physicalization

210:45of the idea of algorithmic information

210:47and that, okay, this is again, a little bit bizarre,

210:51but so I mentioned that there's the speed of light,

210:54maximum speed of information transmission in physical space.

210:57There's a maximum speed of information transmission

210:59in branchial space, which is a maximum entanglement speed.

211:02There's a maximum speed of information transmission

211:05in ruleal space, which is,

211:07has to do with a maximum speed of translation

211:10between different description languages.

211:14And again, I'm not fully wrapped my brain around this one.

211:17Yeah, that one just blows my mind to think about that,

211:20but that starts getting closer to the, yeah,

211:22the intelligence. It's kind of a physicalization.

211:25Right, and it's also a physicalization

211:27of algorithmic information.

211:29And I think there's probably a connection between,

211:32I mean, there's probably a connection

211:33between the notion of energy and some of these things,

211:36which again, I hadn't seen all this coming.

211:39I've always been a little bit resistant

211:41to the idea of connecting physical energy

211:43to things in computation theory,

211:45but I think that's probably coming.

211:47And that's what essentially at the core

211:48with the physics project is

211:50that you're connecting information theory with physics.

211:55Yeah, it's computation.

211:56Computation with our physical universe.

211:59Yeah, right.

212:00I mean, the fact that our physical universe is,

212:03right, that we can think of it as a computation

212:05and that we can have discussions like,

212:08the theory of the physical universe

212:11is the same kind of a theory as the P versus MP problem

212:14and so on is really, I think that's really interesting.

212:18And the fact that, well, okay,

212:21so this kind of brings me to one more thing

212:24that I have to in terms of this sort of unification

212:26of different ideas, which is metamathematics.

212:29Yeah, let's talk about that.

212:30You mentioned that earlier.

212:31What the heck is metamathematics and...

212:34Okay, so here's what, okay.

212:36So what is mathematics?

212:38Mathematics, sort of at a lowest level,

212:43one thinks of mathematics as you have certain axioms.

212:47You say things like X plus Y is the same as Y plus X.

212:51That's an axiom about addition.

212:55And then you say, we've got these axioms

212:57and from these axioms, we derive all these theorems

213:00that fill up the literature of mathematics.

213:02The activity of mathematicians

213:04is to derive all these theorems.

213:06Actually, the axioms of mathematics are very small.

213:10You can fit, when I did my new kind of science book,

213:13I fit all of the standard axioms of mathematics

213:16on basically a page and a half.

213:18Not much stuff.

213:19It's like a very simple rule

213:21from which all of mathematics arises.

213:24The way it works though is a little different

213:26from the way things work in sort of a computation

213:31because in mathematics, what you're interested in

213:33is a proof and the proof says,

213:36from here, you can use, from this expression, for example,

213:40you can use these axioms to get to this other expression.

213:43So that proves these two things are equal.

213:45Okay, so we can begin to see how this has been going to work.

213:49What's gonna happen is there are paths

213:51in metamathematical space.

213:53So what happens is each, two different ways to look at it.

213:57You can just look at it as mathematical expressions

213:59or you can look at it as mathematical statements,

214:02postulates or something.

214:04But either way, you think of these things

214:06and they are connected by these axioms.

214:11So in other words, you have some fact

214:14or you have some expression, you apply this axiom,

214:16you get some other expression.

214:18And in general, given some expression,

214:21there may be many possible different expressions

214:23you can get.

214:24You basically build up a multiway graph

214:27and a proof is a path through the multiway graph

214:31that goes from one thing to another thing.

214:34The path tells you how did you get from one thing

214:36to the other thing.

214:37It's the story of how you got from this to that.

214:40The theorem is the thing at one end

214:42is equal to the thing at the other end.

214:44The proof is the path you go down

214:46to get from one thing to the other.

214:48You mentioned that Gödel's incompleteness theorem

214:52fits naturally there.

214:53How does it fit?

214:54Yeah, so what happens there is that the Gödel's theorem

214:57is basically saying that there are paths of infinite length.

215:01That is that there's no upper bound.

215:03If you know these two things,

215:04you say, I'm trying to get from here to here,

215:06how long do I have to go?

215:07You say, well, I've looked at all the paths of length 10.

215:10Somebody says, that's not good enough.

215:12That path might be of length a billion.

215:14And there's no upper bound on how long that path is.

215:17And that's what leads to the incompleteness theorem.

215:19So I mean, the thing that is kind of an emerging idea

215:24is you can start asking,

215:26what's the analog of Einstein's equations

215:27in metamathematical space?

215:29What's the analog of a black hole

215:31in metamathematical space?

215:33What's the hope of this?

215:33So yeah, it's fascinating to model all the mathematics

215:36in this way.

215:37So here's what it is.

215:38This is mathematics in bulk.

215:40So human mathematicians have made a few million theorems.

215:44They've published a few million theorems.

215:45But imagine the infinite future of mathematics.

215:48Apply something to mathematics

215:50that mathematics likes to apply to other things.

215:52Take a limit.

215:53What is the limit of the infinite future of mathematics?

215:56What does it look like?

215:57What is the continuum limit of mathematics?

215:59What is the, as you just fill in

216:01more and more and more theorems,

216:03what does it look like?

216:04What does it do?

216:05How does, what kinds of conclusions can you make?

216:07So for example, one thing I've just been doing

216:09is taking Euclid.

216:10So Euclid, very impressive.

216:12He had 10 axioms, he derived 465 theorems, okay?

216:17His book, you know,

216:19that was the sort of defining book of mathematics

216:21for 2000 years.

216:24So you can actually map out,

216:25and I actually did this 20 years ago,

216:28but I've done it more seriously now.

216:30You can map out the theorem dependency

216:32of those 465 theorems.

216:34So from the axioms, you grow this graph,

216:37it's actually a multiway graph,

216:39of how all these theorems get proved from other theorems.

216:42And so you can ask questions about, you know,

216:45well, you can ask things like,

216:46what's the hardest theorem in Euclid?

216:47The answer is, the hardest theorem

216:48is that there are five platonic solids.

216:50That turns out to be the hardest theorem in Euclid.

216:52That's actually his last theorem in all his books.

216:55That's the final.

216:56What's the hardness, the distance you have to travel?

216:58Yeah, let's say it's 33 steps from the,

217:01the longest path in the graph is 33 steps.

217:03So that's the, there's a 33 step path you have to follow

217:07to go from the axioms, according to Euclid's proofs,

217:10to the statement there are five platonic solids.

§27Transcript · 3:37:13–3:45:19

217:13So, okay, so then the question is,

217:17in, what does it mean if you have this map?

217:22Okay, so in a sense, this metamathematical space

217:26is the infrastructural space of all possible theorems

217:29that you could prove in mathematics.

217:31That's the geometry of metamathematics.

217:34There's also the geography of mathematics.

217:37That is, where did people choose to live in space?

217:40And that's what, for example,

217:42exploring the sort of empirical metamathematics

217:44that Euclid is doing.

217:45You could put each individual, like, human mathematician,

217:48you can embed them into that space.

217:49I mean, they kind of live.

217:51They represent a path in the space.

217:52The little path.

217:53The things they do.

217:54Maybe a set of paths.

217:54Right.

217:55So like a set of axioms that are chosen.

217:58Right, so for example,

217:59here's an example of a thing that I realized.

218:01So one of the surprising things about,

218:03well, there are two surprising facts about math.

218:06One is that it's hard,

218:07and the other is that it's doable, okay?

218:10So first question is, why is math hard?

218:12You know, you've got these axioms.

218:13They're very small.

218:14Why can't you just solve every problem in math easily?

218:17Yeah, it's just logic.

218:19Right, yeah.

218:19Well, logic happens to be a particular special case

218:22that does have certain simplicity to it.

218:25But general mathematics, even arithmetic,

218:27already doesn't have the simplicity that logic has.

218:30So why is it hard?

218:31Because of computational irreducibility.

218:33Right.

218:35Because what happens is, to know what's true,

218:38and this is this whole story about the path

218:40you have to follow and how long is the path,

218:43and Gödel's theorem is the statement

218:44that the path is not a bounded length,

218:47but the fact that the path is not always compressible

218:50to something tiny is a story of computational irreducibility.

218:54So that's why math is hard.

218:56Now, the next question is, why is math doable?

218:59Because it might be the case that most things you care about

219:02don't have finite length paths.

219:04Most things you care about might be things

219:06where you get lost in the sea of computational irreducibility

219:10and worse, undecidability.

219:12That is, there's just no finite length path

219:14that gets you there.

219:17Why is mathematics doable?

219:19Gödel proved his incompleteness theorem in 1931.

219:22Most working mathematicians don't really care about it.

219:25They just go ahead and do mathematics,

219:27even though it could be that the questions they're asking

219:29are undecidable.

219:31It could have been that Fermat's last theorem

219:32is undecidable.

219:33It turned out it had a proof.

219:35It's a long, complicated proof.

219:36The twin prime conjecture might be undecidable.

219:40The Riemann hypothesis might be undecidable.

219:43These things might be, the axioms of mathematics

219:45might not be strong enough to reach those statements.

219:49It might be the case that depending on what axioms

219:51you choose, you can either say that's true

219:53or that's not true.

219:54So...

219:55And by the way, from Fermat's last theorem,

219:57there could be a shorter path.

219:59Absolutely.

220:00Yeah, so the notion of geodesics in metamathematical space

220:03is the notion of shortest proofs in metamathematical space.

220:07And that's a, you know, human mathematicians

220:09do not find shortest paths,

220:11nor do automated theorem provers.

220:13But the fact, and by the way, the, I mean,

220:16this stuff is so bizarrely connected.

220:18I mean, if you're into automated theorem proving,

220:21there are these so called critical pair lemmas

220:23and automated theorem proving.

220:24Those are precisely the branch pairs in our,

220:28that in multiway graphs.

220:30Let me just finish on the why mathematics is doable.

220:32Oh yes, the second part.

220:34So you know why it's hard, why is it doable?

220:36Right, why do we not just get lost

220:38in undecidability all the time?

220:39Yeah.

220:40So, and here's another fact,

220:43is in doing computer experiments

220:45and doing experimental mathematics,

220:47you do get lost in that way.

220:49When you just say, I'm picking a random integer equation.

220:53How do I, does it have a solution or not?

220:56And you just pick it at random

220:57without any human sort of path getting there.

221:00Often, it's really, really hard.

221:03It's really hard to answer those questions.

221:04We just pick them at random from the space of possibilities.

221:07But what I think is happening is,

221:10and that's a case where you just fell off

221:12into this ocean of sort of irreducibility and so on.

221:15What's happening is human mathematics

221:18is a story of building a path.

221:19You started off, you're always building out

221:23on this path where you are proving things.

221:25You've got this proof trajectory

221:28and you're basically, the human mathematics

221:30is the sort of the exploration of the world

221:34along this proof trajectory, so to speak.

221:36You're not just parachuting in from anywhere.

221:42You're following Lewis and Clark or whatever.

221:44You're actually going, doing the path.

221:48And the fact that you are constrained to go along that path

221:52is the reason you don't end up with,

221:53every so often you'll see a little piece of undecidability

221:55and you'll avoid that part of the path.

221:57But that's basically the story of why human mathematics

222:00has seemed to be doable.

222:02It's a story of exploring these paths

222:05that are by their nature,

222:07they have been constructed to be paths that can be followed.

222:10And so you can follow them further.

222:12Now, why is this relevant to anything?

222:14So, okay, so here's my belief.

222:19The fact that human mathematics works that way

222:22is I think there's some sort of connections

222:26between the way that observers work in physics

222:29and the way that the axiom systems of mathematics are set up

222:32to make mathematics be doable in that kind of way.

222:36And so, in other words, in particular,

222:38I think there is an analog of causal invariance,

222:41which I think is, and this is again,

222:44it's sort of the upper reaches of mathematics

222:46and stuff that it's a thing,

222:50there's this thing called homotopy type theory,

222:52which is an abstract, it's came out of category theory,

222:56and it's sort of an abstraction of mathematics.

222:58Mathematics itself is an abstraction,

223:00but it's an abstraction of the abstraction of mathematics.

223:03And there is the thing called the univalence axiom,

223:06which is a sort of a key axiom in that set of ideas.

223:12And I'm pretty sure the univalence axiom

223:14is equivalent to causal invariance.

223:16What was the term you used again?

223:18Univalence.

223:19Is that something for somebody like me accessible?

223:21Or is this?

223:23There's a statement of it that's fairly accessible.

223:25I mean, the statement of it is,

223:29basically it says things which are equivalent

223:32can be considered to be identical.

223:35In which space?

223:38Yeah, it's in higher category.

223:40In category.

223:41Okay, so it's a, but I mean,

223:43the thing just to give a sketch of how that works.

223:46So category theory is an attempt to idealize,

223:49it's an attempt to sort of have a formal theory

223:52of mathematics that is at a sort of higher level

223:54than mathematics.

223:55It's where you just think about these mathematical objects

223:59and these categories of objects and these morphisms,

224:03these connections between categories.

224:05Okay, so it turns out the morphisms and categories,

224:08at least weak categories,

224:10are very much like the paths in our hypergraphs and things.

224:14And it turns out, again, this is where it all gets crazy.

224:18I mean, the fact that these things are connected

224:20is just bizarre.

224:22So category theory, our causal graphs

224:27are like second order category theory.

224:29And it turns out you can take the limits

224:32of infinite order category theory.

224:34So just give roughly the idea.

224:36This is a roughly explainable idea.

224:39So a mathematical proof will be a path

224:43that says you can get from this thing to this other thing.

224:45And here's the path that you get from this thing

224:47to this other thing.

224:48But in general, there may be many paths,

224:51many proofs that get you many different paths

224:53that all successfully go from this thing

224:55to this other thing, okay?

224:57Now you can define a higher order proof,

225:00which is a proof of the equivalence of those proofs.

225:03Okay, so you're saying there's a...

225:05A path between those proofs essentially.

225:07Yes, a path between the paths, okay?

225:09And so you do that.

225:10That's the sort of second order thing.

225:12That path between the paths is essentially related

225:16to our causal graphs.

225:18Then you can take the limit.

§28Transcript · 3:45:19–3:53:30

225:19Wow, okay.

225:20The path between path, between path, between path.

225:23The infinite limit.

225:24That infinite limit turns out to be

225:26our Rulial Multiway System.

225:28Yeah, the Rulial Multiway System,

225:31that's a fascinating, both in the physics world

225:33and as you're saying now, that's fast.

225:36I'm not sure I've loaded it in completely, but...

225:39Well, I'm not sure I have either.

225:40And it may be one of these things where,

225:42in another five years or something, it's like,

225:45it was obvious, but I didn't see it.

225:47No, but the thing which is sort of interesting to me

225:49is that there's sort of an upper reach of mathematics,

225:53of the abstraction of mathematics.

225:55This thing, there's this mathematician called Grothendieck

225:59who's generally viewed as being sort of one

226:00of the most abstract,

226:02sort of creator of the most abstract mathematics

226:04of 1970s ish timeframe.

226:09And one of the things that he constructed was this thing

226:11he called the Infinity Grupoid.

226:13And he has this sort of hypothesis

226:15about the inevitable appearance of geometry

226:18from essentially logic in the structure of this thing.

226:22Well, it turns out this Rulial Multiway System

226:24is the Infinity Grupoid.

226:26So it's this limiting object.

226:29And this is an instance of that limiting object.

226:33So what to me is, I mean, again,

226:35I've been always afraid of this kind of mathematics

226:37because it seemed incomprehensibly abstract to me.

226:42But what I'm sort of excited about with this

226:45is that we've sort of concretified the way

226:49that you can reach this kind of mathematics,

226:51which makes it, well, both seem more relevant

226:55and also the fact that I don't yet know exactly

226:58what mileage we're gonna get from using

227:01the sort of the apparatus that's been built

227:03in those areas of mathematics to analyze what we're doing.

227:06But the thing that's.

227:07So both ways.

227:08So using mathematics to understand what you're doing

227:10and using what you're doing computationally

227:12to understand that.

227:13Right, so for example,

227:14the understanding of metamathematical space,

227:17one of the reasons I really want to do that

227:19is because I want to understand quantum mechanics better.

227:22And that, what you see,

227:25we live that kind of the multiway graph of mathematics

227:30because we actually know this is a theorem we've heard of.

227:32This is another one we've heard of.

227:34We can actually say these are actual things in the world

227:36that we relate to,

227:38which we can't really do as readily for the physics case.

227:43And so it's kind of a way to help my intuition.

227:45It's also, there are bizarre things

227:47like what's the analog of Einstein's equations

227:50in metamathematical space?

227:51What's the analog of a black hole?

227:53It turns out it looks like not completely sure yet,

227:57but there's this notion of nonconstructive proofs

228:00in mathematics.

228:01And I think those relate to,

228:03well, actually they relate to things

228:07related to event horizons.

228:10So the fact that you can take ideas from physics

228:13like event horizons.

228:14And map them into the same kind of space, metamath.

228:17It's really.

228:17So do you think there'll be,

228:19do you think you might stumble upon

228:22some breakthrough ideas in theorem proving?

228:25Like for, from the other direction?

228:28Yeah, yeah, yeah.

228:29No, I mean, what's really nice is that we are using,

228:32so this absolutely directly maps to theorem proving.

228:35So pods and multiway graphs,

228:37that's what a theorem prover is trying to do.

228:38But I also mean like automated theorem.

228:40Yeah, yeah, yeah.

228:41That's what, right.

228:42So the finding of pods, the finding of shortest pods

228:45or finding of pods at all

228:46is what automated theorem provers do.

228:48And actually what we've been doing.

228:51So we've actually been using automated theorem proving

228:53both in the physics project to prove things

228:56and using that as a way to understand multiway graphs.

229:00And because what an automated theorem prover is doing

229:04is it's trying to find a path through a multiway graph

229:07and its critical pair lemmas

229:09are precisely little stubs of branch pairs

229:12going off into branchial space.

229:15And that's, I mean, it's really weird.

229:16You know, we have these visualizations in Wolfram language

229:19of proof graphs from our automated theorem proving system.

229:24And they look reminiscent of.

229:25Well, it's just bizarre

229:26because we made these up a few years ago

229:28and they have these little triangle things

229:30and they are, we didn't quite get it right.

229:33We didn't quite get the analogy perfectly right,

229:35but it's very close.

229:36You know, just to say,

229:37in terms of how these things are connected.

229:39So there's another bizarre connection

229:41that I have to mention because which is,

229:46which again, we don't fully know,

229:47but it's a connection to something else

229:51you might not have thought was in the slightest

229:52but connected, which is distributed blockchain like things.

229:56Now you might figure out that that's,

229:58you would figure out that that's connected

229:59because it's a story of distributed computing.

230:02And the issue, you know, with the blockchain,

230:04you're saying there's going to be this one ledger

230:07that globally says, this is what happened in the world.

230:11But that's a bad deal.

230:14If you've got all these different transactions

230:15that are happening and you know,

230:17this transaction in country A

230:20doesn't have to be reconciled with the transaction

230:23in country B, at least not for a while.

230:26And that story is just like what happens

230:29with our causal graphs.

230:31That whole reconciliation thing is just like

230:33what happens with light cones and all this kind of thing.

230:35That's where the causal awareness comes into play.

230:37I mean, that's, you know,

230:39most of your conversations are about physics,

230:41but it's kind of funny that this probably

230:46and possibly might have even bigger impact

230:49and revolutionary ideas and totally other disciplines.

230:53Right, well, you see, yeah, right.

230:55So the question is, why is that happening, right?

230:57And the reason it's happening,

230:59I've thought about this obviously,

231:00because I like to think about these meta questions of,

231:03you know, what's happening is this model that we have

231:06is an incredibly minimal model.

231:08And once you have an incredibly minimal model,

231:11and this happened with cellular automata as well,

231:13cellular automata are an incredibly minimal model.

231:16And so it's inevitable that it gets you,

231:19it's sort of an upstream thing

231:20that gets used in lots of different places.

231:22And it's like, you know, the fact that it gets used,

231:25you know, cellular automata is sort of a minimal model

231:27of let's say road traffic flow or something.

231:29And they're also a minimal model of something in,

231:31you know, chemistry,

231:32and they're also a minimal model of something

231:33in epidemiology, right?

231:35It's because they're such a simple model that they can,

231:38that they apply to all these different things.

231:40Similarly, this model that we have with the physics project

231:43is another, cellular automata are a minimal model

231:47of parallel, of basically of parallel computation

231:50where you've defined space and time.

231:52These models are minimal models

231:54where you have not defined space and time.

231:57And they have been very hard to understand in the past,

232:00but the, I think the,

232:01perhaps the most important breakthrough there

232:04is the realization that these are models of physics.

232:07And therefore that you can use everything

232:09that's been developed in physics

232:11to get intuition about how things like that work.

232:13And that's why you can potentially use ideas from physics

232:17to get intuition about how to do parallel computing.

232:20And because the underlying model is the same.

232:24But we have all of this achievement in physics.

232:27I mean, you know, you might say,

232:28oh, you've come up with the fundamental theory of physics

232:30that throws out what people have done in physics before.

232:32Well, it doesn't, but also the real power

232:35is to use what's been done before in physics

232:37to apply it in these other places.

232:39Yes, absolutely.

232:41This kind of brings up,

232:43I know you probably don't particularly love commenting

232:47on the work of others,

232:48but let me bring up a couple of personalities

232:51just because it's fun and people are curious about it.

232:53So there's Sabine Hassenfelder.

232:58I don't know if you're familiar with her.

233:00She wrote this book that I need to read,

233:04but I forget what the title is,

233:06but it's Beauty Leads Us Astray in Physics

233:10is a subtitle or something like that.

233:12Which so much about what we're talking about now,

233:15like this simplification,

233:17to us humans seems to be beautiful.

233:20Like there's a certain intuition with physicists,

233:23with people that a simple theory,

233:26like this reducibility,

233:28pockets of reducibility is the ultimate goal.

§29Transcript · 3:53:30–4:01:50

233:30And I think what she tries to argue is no,

233:34we just need to come up with theories

233:37that are just really good at predicting physical phenomena.

233:40It's okay to have a bunch of disparate theories

233:44as opposed to trying to chase this beautiful theory

233:48of everything is the ultimate beautiful theory,

233:51a simple one.

233:52What's your response to that?

233:54Well, so what you're quoting,

233:56I don't know the Sabine Hassenfelder's,

233:59exactly what she said,

234:00but I mean that you're quoting the title of her book.

234:03Okay.

234:04Let me respond to what you were describing,

234:07which may or may not have nothing to do with

234:09what Sabine Hassenfelder says or thinks.

234:14Sorry, Sabine.

234:16Right.

234:17Sorry for misquoting.

234:18But I mean, the question is,

234:23is beauty a guide to whether something is correct?

234:26Which is kind of also the story of Occam's razor.

234:29If you've got a bunch of different explanations of things,

234:32is the thing that is the simplest explanation

234:34likely to be the correct explanation?

234:36And there are situations where that's true

234:38and there are situations where it isn't true.

234:39Sometimes in human systems, it is true

234:41because people have kind of,

234:43in evolutionary systems, sometimes it's true

234:45because it's sort of been kicked

234:46to the point where it's minimized.

234:49But in physics, does Occam's razor work?

234:53Is there a simple, quotes, beautiful explanation for things

234:57or is it a big mess?

234:59We don't intrinsically know.

235:01I think that the, I wouldn't,

235:03before I worked on the project in recent times,

235:07I would have said,

235:08we do not know how complicated

235:09the rule for the universe will be.

235:12And I would have said, the one thing we know,

235:15which is a fundamental fact about science,

235:17that's the thing that makes science possible,

235:19is that there is order in the universe.

235:21I mean, early theologians would have used that

235:24as an argument for the existence of God

235:27because it's like, why is there order in the universe?

235:29Why doesn't every single particle in the universe

235:31just do its own thing?

235:33Something must be making there be order in the universe.

235:37We, in the sort of early theology point of view,

235:41that's the role of God is to do that, so to speak.

235:45In our, we might say,

235:47it's the role of a formal theory to do that.

235:50And then the question is,

235:51but how simple should that theory be?

235:53And should that theory be one that,

235:57where I think the point is, if it's simple,

236:00it's almost inevitably somewhat beautiful

236:03in the sense that, because all the stuff that we see

236:06has to fit into this little tiny theory.

236:08And the way it does that has to be,

236:11it depends on your notion of beauty,

236:13but I mean, for me, the sort of the surprising

236:17connectivity of it is, at least in my aesthetic,

236:21that's something that responds to my aesthetic.

236:25But the question is, I mean,

236:27you're a fascinating person in the sense that

236:31you're at once talking about computational,

236:34the fundamental computational reducibility of the universe,

236:37and on the other hand,

236:40trying to come up with a theory of everything,

236:42which simply describes the,

236:47the simple origins of that computational reducibility.

236:51I mean, both of those things are kind of,

236:53it's paralyzing to think that we can't make any sense

236:56of the universe in the general case,

236:58but it's hopeful to think like,

237:01one, we can think of a rule

237:03and that generates this whole complexity,

237:05and two, we can find pockets of reducibility

237:10that are powerful for everyday life

237:13to do different kinds of predictions.

237:15I suppose Sabine wants to find,

237:19focus on the finding of small pockets of reducibility

237:22versus the theory of everything.

237:26You know, it's a funny thing because,

237:29you know, a bunch of people have started working

237:30on this physics project,

237:32people who are physicists, basically,

237:36and it is really a fascinating sociological phenomenon

237:39because what, you know,

237:41when I was working on this before in the 1990s,

237:45you know, wrote it up, put it,

237:47it's 100 pages of this 1200 page book

237:50that I wrote, New Kind of Science,

237:51is, you know, 100 pages of that is about physics,

237:54but I saw it at that time,

237:57not as a pinnacle achievement,

237:59but rather as a use case, so to speak.

238:01I mean, my main point was this new kind of science,

238:04and it's like, you can apply it to biology,

238:05you can apply it to, you know, other kinds of physics,

238:08you can apply it to fundamental physics,

238:09it's just an application, so to speak,

238:12it's not the core thing.

238:14But then, you know, one of the things that was interesting

238:18with that book was, you know,

238:21book comes out, lots of people think it's pretty interesting

238:24and lots of people start using what it has

238:26in different kinds of fields.

238:28The one field where there was sort of a heavy pitchforking

238:32was from my friends, the fundamental physics people,

238:35which was, it's like, no,

238:37this can't possibly be right.

238:38And, you know, it's like, you know,

238:40if what you're doing is right,

238:41it'll overturn 50 years of what we've been doing.

238:44And it's like, no, it won't, was what I was saying.

238:46And it's like, but, you know, for a while,

238:50when I started, you know, I was going to go on back in 2002,

238:54well, 2004, actually, I was going to go on

238:57working on this project.

238:58And I actually stopped,

238:59partly because it's like, why am I, you know,

239:03this is like, I've been in business a long time, right?

239:05I'm building a product for a target market

239:08that doesn't want the product.

239:09And it's like.

239:10Why work, yeah, yeah, why work against the,

239:13swim against the current or whatever.

239:14Right, but you see what's happened,

239:16which is sort of interesting is that,

239:18so a couple of things happened and it was like,

239:22you know, it was like, I don't want to do this project

239:25because I can do so many other things,

239:28which I'm really interested in where, you know,

239:31people say, great, thanks for those tools.

239:34Thanks for those ideas, et cetera.

239:36Whereas, you know, if you're dealing with kind of a,

239:40you know, a sort of a structure where people are saying,

239:42no, no, we don't want this new stuff.

239:44We don't need any new stuff.

239:45We're really fine with what we're doing.

239:46Yeah, there's like literally like, I don't know,

239:48millions of people who are thankful for Wolfram Alpha.

239:51A bunch of people wrote to me, how thankful,

239:53they are a different crowd

239:55than the theoretical physics community, perhaps.

239:57Yeah, well, but you know,

239:58the theoretical physics community

240:00pretty much uniformly uses Wolfram language

240:03and Mathematica, right?

240:04And so it's kind of like, you know, and that's,

240:08but the thing is what happens, you know,

240:11this is what happens, mature fields do not, you know,

240:14it's like, we're doing what we're doing.

240:16We have the methods that we have

240:18and we're just fine here.

240:20Now what's happened in the last 18 years or so,

240:23I think there's a couple of things have happened.

240:25First of all, the hope that, you know,

240:29string theory or whatever would deliver

240:31the fundamental theory of physics,

240:32that hope has disappeared.

240:34That the, another thing that's happened

240:36is the sort of the interest in computation around physics

240:41has been greatly enhanced

240:42by the whole quantum information,

240:44quantum computing story.

240:46People, you know, the idea there might be something

240:47sort of computational related to physics

240:51has somehow grown.

240:53And I think, you know, it's sort of interesting.

240:55I mean, right now, if we say, you know,

240:58it's like, if you're like,

240:59who else is trying to come up

241:00with the fundamental theory of physics?

241:02It's like, there aren't professional,

241:04no professional physicists, no professional physicists.

241:07What are your, I mean, you've talked with him,

241:10but just as a matter of personalities,

241:12cause it's a beautiful story.

241:13What are your thoughts about Eric Weinstein's work?

241:17You know, I think his, I mean,

241:20he did a PhD thesis in mathematical physics at Harvard.

241:23He's a mathematical physicist.

241:24And, you know, it seems like it's kind of,

241:28you know, it's in that framework.

241:30And it's kind of like,

241:32I'm not sure how much further it's got than his PhD thesis,

241:35which was 20 years ago or something.

241:37And I think that, you know, the, you know,

241:40it's a fairly specific piece of mathematical physics.

241:43That's quite nice.

241:44And...

241:45What trajectory do you hope it takes?

241:47I mean...

241:48Well, I think in his particular case,

§30Transcript · 4:01:50–4:09:35

241:50I mean, from what I understand,

241:51which is not everything at all,

241:52but, you know, I think I know the rough tradition,

241:54at least what he's operating in is sort of theory of gauge theories.

241:58Gauge theories, yeah.

241:59Local gauge invariants and so on.

242:01Okay, we are very close to understanding

242:04how local gauge invariants works in our models.

242:06And it's very beautiful.

242:07And it's very...

242:09And, you know, does some of the mathematical structure

242:12that he's enthusiastic about fit?

242:14Quite possibly, yes.

242:15So there might be a possibility of trying to understand

242:17how those things fit, how gauge theory fits.

242:19Yeah, very well.

242:20I mean, the question is, you know,

242:21so there are a couple of things

242:22one might try to get in the world.

242:24So for example, it's like,

242:25can we get three dimensions of space?

242:27We haven't managed to get that yet.

242:28Gauge theory, the standard model of particle physics says,

242:32but it's SU3 cross SU2 cross U1.

242:35Those are the designations of these Lie groups.

242:39It doesn't, but anyway,

242:41so those are sort of representations

242:43of symmetries of the theory.

242:46And so, you know, it is conceivable

242:50that it is generically true.

242:52Okay, so all those are subgroups of a group called E8,

242:55which is a weird, exceptional Lie group, okay?

242:59It is conceivable, I don't know whether it's the case,

243:02that that will be generic in these models,

243:05that it will be generic,

243:06that the gauge invariance of the model has this property,

243:12just as things like general relativity,

243:15which corresponds to the thing called general covariance,

243:20which is another gauge like invariance.

243:23It could conceivably be the case

243:25that the kind of local gauge invariance

243:27that we see in particle physics is somehow generic.

243:30And that would be a, you know,

243:32the thing that's really cool, I think, you know,

243:35sociologically, although this hasn't really hit yet,

243:38is that all of these different things,

243:40all these different things people have been working on

243:41in these, in some cases,

243:43quite abstruse areas of mathematical physics,

243:46an awful lot of them seem to tie into what we're doing.

243:49And, you know, it might not be that way.

243:51Yeah, absolutely.

243:52That's a beautiful thing, I think.

243:53I mean, but the reason Eric Weinstein is important

243:58is to the point that you mentioned before,

244:00which is, it's strange that the theory of everything

244:04is not at the core of the passion, the dream,

244:09the focus, the funding of the physics community.

244:14It's too hard.

244:16It's too hard and people gave up.

244:17I mean, basically what happened is ancient Greece,

244:21people thought we're nearly there.

244:23You know, the world is made of platonic solids.

244:25It's, you know, water is a tetrahedron or something.

244:27We're almost there, okay?

244:29Long period of time where people were like,

244:32no, we don't know how it works.

244:34You know, time of Newton, you know, we're almost there.

244:36Everything is gravitation.

244:38You know, time of Faraday and Maxwell, we're almost there.

244:42Everything is fields, everything is the ether, you know?

244:45Then...

244:46And the whole time we're making big progress though.

244:48Oh yes, absolutely.

244:50But the fundamental theory of physics is almost a footnote

244:53because it's like, it's the machine code.

244:56It's like we're operating in the high level languages.

244:59Yeah.

245:00You know, that's what we really care about.

245:01That's what's relevant for our everyday physics.

245:03You talked about different centuries

245:05and the 21st century will be everything is computation.

245:08Yes.

245:09If that takes us all the way, we don't know,

245:11but it might take us pretty far.

245:13Yes, right, that's right.

245:14And I, but I think the point is that it's like, you know,

245:17if you're doing biology, you might say,

245:18how can you not be really interested in the origin of life

245:21and the definition of life?

245:22Well, it's irrelevant.

245:23You know, you're studying the properties of some virus.

245:26It doesn't matter, you know, where, you know,

245:28you're operating at some much higher level.

245:30And it's the same, what's happening with physics is,

245:34I was sort of surprised actually.

245:35I was sort of mapping out this history of people's efforts

245:38to understand the fundamental theory of physics.

245:41And it's remarkable how little has been done on this question.

245:45And it's, you know, because, you know,

245:47there've been times when there's been bursts of enthusiasm.

245:49Oh, we're almost there.

245:50And then it decays and people just say,

245:54oh, it's too hard, but it's not relevant anyway.

245:57And I think that the thing that, you know,

246:01so the question of, you know, one question is,

246:04why does anybody, why should anybody care, right?

246:07Why should anybody care

246:08what the fundamental theory of physics is?

246:10I think it's intellectually interesting,

246:13but what will be the sort of,

246:14what will be the impact of this?

246:16What, I mean, this is the key question.

246:18What do you think will happen

246:20if we figure out the fundamental theory of physics?

246:25Right.

246:26Outside of the intellectual curiosity of us.

246:28Okay, so here's my best guess, okay?

246:31So if you look at the history of science,

246:33I think a very interesting analogy is Copernicus.

246:37Okay, so what did Copernicus do?

246:39There'd been this Ptolemaic system

246:41for working out the motion of planets.

246:43It did pretty well.

246:44It used epicycles, et cetera, et cetera, et cetera.

246:47It had all this computational ways

246:49of working out where planets will be.

246:51When we work out where planets are today,

246:52we're basically using epicycles.

246:54But Copernicus had this different way of formulating things

246:58in which he said, you know,

247:00and the earth is going around the sun,

247:02and that had a consequence.

247:04The consequence was you can use this mathematical theory

247:07to conclude something which is absolutely not

247:10what we can tell from common sense, right?

247:14So it's like, trust the mathematics, trust the science, okay?

247:18Now fast forward 400 years,

247:21and now we're in this pandemic,

247:23and it's kind of like everybody thinks the science

247:26will figure out everything.

247:28It's like from the science,

247:30we can just figure out what to do.

247:31We can figure out everything.

247:32That was before Copernicus.

247:34Nobody would have thought if the science says something

247:37that doesn't agree with our everyday experience,

247:40where we just have to compute the science

247:43and then figure out what to do,

247:44people would say that's completely crazy.

247:46And so your sense is,

247:47once we figure out the framework of computation

247:49that can basically do any,

247:51understand the fabric of reality,

247:53we'll be able to derive totally counterintuitive things.

247:58No, the point I think is the following.

248:01That right now, you know,

248:03I talk about computational irreducibility.

248:05People, you know, I was very proud

248:07that I managed to get the term computational irreducibility

248:10into the congressional record last year.

248:13That's right, by the way,

248:13that's a whole nother topic we could talk about.

248:15Fascinating. Different topic.

248:17Different topic.

248:18But Tim, in any case, you know,

248:20but so computational irreducibility

248:22is one of these sort of concepts

248:23that I think is important in understanding

248:25lots of things in the world.

248:26But the question is, it's only important

248:29if you believe the world is fundamentally computational.

248:32Right?

248:33But if you know the fundamental theory of physics

248:35and it's fundamentally computational,

248:38then you've rooted the whole thing.

248:40That is, you know the world is computational.

248:43And while you can discuss whether, you know,

248:47it's not the case that people would say,

248:48well, you have this whole computational irreducibility,

248:50all these features of computation.

248:52We don't care about those

248:54because after all the world isn't computational,

248:56you might say.

248:57But if you know, you know, base, base, base thing,

249:01physics is computational,

249:03then you know that that stuff is, you know,

249:05that that's kind of the grounding for that stuff.

249:07Just as in a sense Copernicus was the grounding

249:10for the idea that you could figure out something

249:12with math and science

249:14that was not what you would intuitively think

249:18from your senses.

249:20So now we've got to this point where, for example,

249:22we say, you know, once we have the idea

249:25that computation is the foundational thing

249:27that explains our whole universe,

249:30then we have to say, well, what does it mean

249:32for other things?

249:32Like it means there's computational irreducibility.

§31Transcript · 4:09:35–4:17:50

249:35That means science is limited in certain ways.

249:37That means this, that means that.

249:39But the fact that we have that grounding means that,

249:43you know, and I think, for example, for Copernicus,

249:45for instance, the implications of his work

249:49on the set of mathematics of astronomy were cool,

249:52but they involved a very small number of people.

249:54The implications of his work for sort of the philosophy

249:56of how you think about things were vast

249:59and involved, you know, everybody more or less.

250:02But do you think, so that's actually the way scientists

250:05and people see the world around us.

250:08So it has a huge impact in that sense.

250:10Do you think it might have an impact more directly

250:14to engineering derivations from physics,

250:18like propulsion systems, our ability to colonize the world?

250:21Like, for example, okay, this is like sci fi,

250:24but if you understand the computational nature, say,

250:30of the different forces of physics, you know,

250:34there's a notion of being able to warp gravity,

250:38things like this.

250:39Yeah, can we make warp drive?

250:40Warp drive, yeah.

250:41So like, would we be able to, will, you know,

250:45will like Elon Musk start paying attention?

250:47Like it's awfully costly to launch these rockets.

250:50Do you think we'll be able to, yeah, create warp drive?

250:52And, you know, I set myself some homework.

250:55I agreed to give a talk at some NASA workshop

250:57in a few weeks about faster than light travel.

250:59So I haven't figured it out yet, but no, but.

251:02You got two weeks.

251:03Yeah, right.

251:04But do you think that kind of understanding

251:06of fundamental theory of physics can lead

251:07to those engineering breakthroughs?

251:09Okay, I think it's far away, but I'm not certain.

251:12I mean, you know, this is the thing that,

251:14I set myself an exercise when gravity waves,

251:16gravitational waves were discovered, right?

251:19I set myself the exercise of what would black hole

251:22technology look like?

251:23In other words, right now, you know,

251:25black holes are far away.

251:26They're, you know, how on earth can we do things with them?

251:28But just imagine that we could get, you know,

251:30pet black holes right in our backyard.

251:32You know, what kind of technology could we build with them?

251:34I got a certain distance, not that far,

251:36but I think in, you know, so there are ideas, you know,

251:40I have this, one of the weirder ideas is things

251:42I'm calling space tunnels,

251:44which are higher dimensional pieces of space time,

251:47where basically you can, you know,

251:50in our three dimensional space,

251:51there might be a five dimensional, you know,

251:54region, which actually will appear as a white hole

251:57at one end and a black hole at the other end,

251:59you know, who knows whether they exist.

252:01And then the questions, another one,

252:02okay, this is another crazy one,

252:04is the thing that I'm calling a vacuum cleaner, okay?

252:07So, I mentioned that, you know,

252:10there's all this activity in the universe,

252:12which is maintaining the structure of space.

252:14And that leads to a certain energy density

252:18effectively in space.

252:20And so the question, in fact, dark energy

252:23is a story of essentially negative mass

252:26produced by the absence of energy

252:30you thought would be there, so to speak.

252:33And we don't know exactly how it works

252:34in either our model or the physical universe,

252:37but this notion of a vacuum cleaner is a thing where,

252:41you know, you have all these things

252:43that are maintaining the structure of space,

252:44but what if you could clean out some of that stuff

252:47that's maintaining the structure of space

252:49and make a simpler vacuum somewhere?

252:51You know, what would that do?

252:52A totally different kind of vacuum.

252:54Right, and that would lead to negative energy density,

252:57which would need to, so gravity is usually

252:59a purely attractive force, but negative mass

253:02would lead to repulsive gravity

253:06and lead to all kinds of weird things.

253:08Now, can it be done in our universe?

253:11You know, my immediate thought is no,

253:14but you know, the fact is that, okay, so here's the thing.

253:18Well, once you understand the fact,

253:19because you're saying like, at this level of abstraction,

253:21can we reach to the lower levels and mess with it?

253:25Yes.

253:26Once you understand the levels, I think you can start to.

253:27I know, and I'm, you know, I have to say

253:30that this reminds me of people telling one years ago

253:34that, you know, you'll never transmit data

253:36over a copper wire at more than 1,000,

253:38you know, 1,000 board or something, right?

253:41And this is, why did that not happen?

253:43You know, why do we have this much,

253:45much faster data transmission?

253:46Because we've understood many more of the details

253:48of what's actually going on.

253:50And it's the same exact story here.

253:52And it's the same, you know, I think that this,

253:54as I say, I think one of the features of sort of,

253:58one of the things about our time

254:00that will seem incredibly naive in the future

254:03is the belief that, you know, things like heat

254:06is just random motion of molecules,

254:08that it's just throw up your hands, it's just random.

254:12We can't say anything about it.

254:14That will seem naive.

254:15Yeah, at the heat death of the universe,

254:18those particles would be laughing at us humans thinking.

254:20Yes, right.

254:22That life is not beautiful.

254:23I'll have a whole civilization, you know.

254:25Humans used to think they're special

254:27with their little brains.

254:28Well, right, but also, and they used to think

254:31that this would just be random and uninteresting.

254:33But that's, but so this question about whether you can,

254:37you know, mess with the underlying structure

254:39and how you find a way to mess with the underlying structure,

254:42that's a, you know, I have to say, you know,

254:45my immediate thing is, boy, that seems really hard,

254:48but then, and you know,

254:50possibly computational irreducibility will bite you,

254:54but then there's always some path

254:55of computational reducibility.

254:57And that path of computational reducibility

254:59is the engineering invention that has to be made.

255:02Those little pockets can have huge engineering impact.

255:05Right, and I think that that's right.

255:07And I mean, we live in, you know, we make use of so many

255:10of those pockets.

255:11And the fact is, you know, I, you know, this is, yes,

255:16it's a, you know, it's one of these things where,

255:20where, you know, I'm a person who likes to figure out ideas

255:24and so on, and the sort of tests of my level of imagination,

255:28so to speak.

255:29And so a couple of places where there's sort of serious

255:32humility in terms of my level of imagination,

255:35one is this thing about different reference frames

255:38for understanding the universe,

255:39where like, imagine the physics of the aliens,

255:42what will it be like?

255:43And I'm like, that's really hard.

255:45I don't know, you know?

255:47And I mean, I think that...

255:48But once you have the framework in place,

255:49you can at least reason about the things you don't know,

255:53maybe can't know, or like, it's too hard for you to know,

255:57but then the mathematics can, that's exactly it,

256:01allow you to reach beyond where you can reason about.

256:05So I'm, you know, I'm trying to not have, you know,

256:09if you think back to Alan Turing, for example,

256:11and, you know, when he invented Turing machines, you know,

256:14and imagining what computers would end up doing,

256:16so to speak.

256:17Yeah.

256:18You know, and it's...

256:19It's very difficult.

256:20It's difficult, right.

256:21And it's, and I mean, this thing...

256:22Made a few reasonable predictions,

256:23but most of it, he couldn't predict, possibly.

256:25By the time, by 1950, he was making reasonable predictions

256:28about some things.

256:29But not the 30s, yeah.

256:30Right, not when he first, you know, conceptualized,

256:34you know, and he conceptualized universal computing

256:37for a very specific mathematical reason

256:39that wasn't as general.

256:41But yes, it's a good sort of exercise in humility

256:44to realize that it's kind of like,

256:46it's really hard to figure these things out.

256:49The engineering of the universe,

256:52if we know how the universe works, how can we engineer it?

256:55That's such a beautiful vision.

256:57That's such a beautiful vision.

256:58By the way, I have to mention one more thing,

256:59which is the ultimate question from physics is,

257:04okay, so we have this abstract model of the universe.

257:07Why does the universe exist at all, right?

257:11So, you know, we might say there is a formal model

257:15that if you run this model, you get the universe,

257:18or the model gives you, you know, a model of the universe,

257:21right, you run this mathematical thing

257:25and the mathematics unfolds in the way

257:27that corresponds to the universe.

257:29But the question is, why was that actualized?

257:32Why does the actual universe actually exist?

257:35And so this is another one of these humility

257:39and it's like, can you figure this out?

257:41I have a guess, okay, about the answer to that.

257:44And my guess is somewhat unsatisfying,

257:47but my guess is that it's a little bit similar

§32Transcript · 4:17:50–4:23:38

257:50to Gödel's second incompleteness theorem,

257:52which is the statement that from within,

257:55as an axiomatic theory like piano arithmetic,

257:58you cannot from within that theory

257:59prove the consistency of the theory.

258:02So my guess is that for entities within the universe,

258:08there is no finite determination that can be made

258:11of the statement the universe exists

258:15is essentially undecidable to any entity

258:18that is embedded in the universe.

258:19Within that universe, how does that make you feel?

258:22Does that put you at peace that it's impossible,

258:27or is it really ultimately frustrating?

258:30Well, I think it just says that it's not a kind of question

258:35that, you know, there are things that it is reasonable.

258:40I mean, there's kinds of, you know,

258:42you can talk about hyper computation as well.

258:44You can say, imagine there was a hyper computer,

258:46here's what it would do.

258:47So okay, great, it would be lovely to have a hyper computer,

258:49but unfortunately we can't make it in the universe.

258:52Like it would be lovely to answer this,

258:53but unfortunately we can't do it in the universe.

258:56And you know, this is all we have, so to speak.

258:59And I think it's really just a statement.

259:02It's sort of, in the end, it'll be a kind of a logical,

259:06logically inevitable statement, I think.

259:08I think it will be something where it is,

259:10as you understand what it means to have,

259:13what it means to have a sort of predicate of existence

259:16and what it means to have these kinds of things,

259:17it will sort of be inevitable that this has to be the case,

259:20that from within that universe, you can't establish

259:23the reason for its existence, so to speak.

259:25You can't prove that it exists and so on.

259:26And nevertheless, because of computational reducibility,

259:29the future is ultimately not predictable, full of mystery,

259:34and that's what makes life worth living.

259:36Right, I mean, right.

259:37And you know, it's funny for me,

259:39because as a pure sort of human being doing what I do,

259:43it's, you know, like I'm interested in people,

259:46I like sort of the whole human experience, so to speak.

259:51And yet, it's a little bit weird when I'm thinking,

259:53you know, it's all hypergraphs down there,

259:56and it's all just.

259:57Hypergraphs all the way down.

259:59Right.

260:00It's like turtles all the way down.

260:01Yeah, yeah, right.

260:02And it's kind of, you know, to me, it is a funny thing,

260:06because every so often I get this, you know,

260:08as I'm thinking about, I think we've really gotten,

260:10you know, we've really figured out kind of the essence

260:12of how physics works, and I'm like thinking to myself,

260:14you know, here's this physical thing,

260:16and I'm like, you know,

260:17this feels like a very definite thing.

260:19How can it be the case that this is just

260:21some rule or reference frame of, you know,

260:23this infinite creature that is so abstract and so on?

260:28And I kind of, it is a, it's a funny sort of feeling

260:32that, you know, we are, we're sort of, it's like,

260:37in the end, it's just sort of,

260:39we're just happy we're just humans type thing.

260:42And it's kind of like, but we're making,

260:44we make things as, it's not like we're just a tiny speck.

260:50We are, in a sense, the, we are more important

260:54by virtue of the fact that, in a sense,

260:58it's not like there's, there is no ultimate, you know,

261:02it's like, we're important because,

261:06because, you know, we're here, so to speak,

261:08and we're not, it's not like there's a thing

261:10where we're saying, you know, we are just but one

261:15sort of intelligence out of all these other intelligences.

261:18And so, you know, ultimately there'll be

261:20the super intelligence, which is all of these put together

261:23and they'll be very different from us.

261:25No, it's actually going to be equivalent to us.

261:27And the thing that makes us a sort of special

261:31is just the details of us, so to speak.

261:34It's not something where we can say,

261:36oh, there's this other thing, you know,

261:38just, you think humans are cool,

261:40just wait until you've seen this.

261:43You know, it's going to be much more impressive.

261:45Well, no, it's all going to be

261:47kind of computationally equivalent.

261:48And the thing that, you know, it's not going to be,

261:51oh, this thing is amazingly much more impressive

261:53and amazingly much more meaningful, let's say.

261:56No, we're it.

261:58I mean, that's the...

262:01And the symbolism of this particular moment.

262:04So this has been one of the,

262:07one of the favorite conversations I've ever had, Stephen.

262:10It's a huge honor to talk to you,

262:12to talk about a topic like this for four plus hours

262:16on the fundamental theory of physics.

262:18And yet we're just two finite descendants of apes

262:22that have to end this conversation

262:24because darkness have come upon us.

262:28Right, and we're going to get bitten by mosquitoes

262:29and all kinds of terrible things.

262:30The symbolism of that,

262:32we're talking about the most basic fabric of reality

262:36and having to end because of the fact that things end.

262:40It's tragic and beautiful, Stephen.

262:42Thank you so much.

262:43Huge honor.

262:44I can't wait to see what you do in the next couple of days

262:47and next week, a month.

262:48We're all watching with excitement.

262:50Thank you so much.

262:51Thanks.

262:53Thanks for listening to this conversation

262:54with Stephen Wolfram.

262:55And thank you to our sponsors,

262:57SimplySafe, Sun Basket, and Masterclass.

263:00Please check out our sponsors in the description

263:03to get a discount and to support this podcast.

263:06If you enjoy this thing, subscribe on YouTube,

263:08review it with five stars on Apple Podcasts,

263:10follow on Spotify, support on Patreon,

263:12or connect with me on Twitter at Lex Friedman.

263:16And now let me leave you with some words

263:19from Richard Feynman.

263:21Physics isn't the most important thing, love is.

263:25Thank you for listening and hope to see you next time.

— 读到这里,多懂一点。 —