Kevin Mitchell Pic Paul Sharp/SHARPPIXErik, Kevin, and I discuss… well a lot of things.
Erik’s recent novel The Revelations is a story about a group of neuroscientists trying to develop a good theory of consciousness (with a murder mystery plot).
Kevin’s book Innate – How the Wiring of Our Brains Shapes Who We Are describes the messy process of getting from DNA, traversing epigenetics and development, to our personalities.
We talk about both books, then dive deeper into topics like whether brains evolved for moving our bodies vs. consciousness, how information theory is lending insights to emergent phenomena, and the role of agency with respect to what counts as intelligence.
Timestamps
0:00 – Intro
3:28 – The Revelations – Erik’s novel
15:15 – Innate – Kevin’s book
22:56 – Cycle of progress
29:05 – Brains for movement or consciousness?
46:46 – Freud’s influence
59:18 – Theories of consciousness
1:02:02 – Meaning and emergence
1:05:50 – Reduction in neuroscience
1:23:03 – Micro and macro – emergence
1:29:35 – Agency and intelligence
Eric, a fresh congratulations to you and Kevin, a stale, I suppose if two years to three years to innate was written in 2018, right. Or published, I don’t know when it was written and Eric a fresh congratulations to you. Although I know that the revelations, your book has been a long time coming and has, uh, you know, this is your first novel, correct.
Erik H 00:03:50 It’s my first novel and yeah, about 10 years is probably the, it’s probably the lower end of the estimate. Although of course the bulk of the writing was done in graduate school,
Paul M 00:04:04 Which is crazy. This is not 10 years.
Paul M 00:04:08 Well, I know people, um, and there’s nothing wrong with that. Nothing wrong with 10 years in graduate school, everybody. Um, but so this is the, this is the first on, on the podcast, I believe where, uh, we’re going to talk a little bit about a fiction book. And so we’ll, we’ll spend some time talking about the revelations. I want to talk about innate a little bit, Kevin, and then we’ll come together and you guys will really butt heads about some of your, uh, some fundamental core concepts and ideas that you hold dearly. Um, so, so
Erik H 00:04:36 I’ve been listening to more of Kevin’s like talks and so on. And my suspicion is actually that we agree on basically everything. So, uh, it may, it may be more of a, kind of more of a head shake. Exactly.
Paul M 00:04:53 So this, this is, to me, this is the conversations I aim for. I actually find debates mostly utterly on useful, but, but anyway, uh, we don’t need to get into my thoughts on, on debates. So Eric, among other things in, in the revelations, um, it’s just really impressive the, the scope of the philosophy and the science that you cover throughout the novel. And it’s a, it’s a long novel. So you do have some time and space to do that, but, but it’s also just filled with these really vivid descriptions of the science, um, and this, so this is maybe I should back up and say that the novel revolves around characters, uh, pursuing a theory of consciousness and then things happen in the background. Um, like there’s a murder mystery involved as well. But like I said, there’s lots of vivid descriptions of the science, but also the characters that what they’re going through emotionally and their thoughts and the scenes and, and the writing is, is generally, uh, just fantastic. And so congratulations on writing. Thank you
Erik H 00:05:55 So much. That’s awesome to hear on,
Paul M 00:05:57 On the other hand, I’ll say I felt almost like an old curmudgeon, partly because I am these days, but I kept wondering why these, uh, these immature, you know, children, uh, and the novel that of the characters were so like pretentious, you know, in self-absorbed in their quest to, uh, to understand. And I found myself grateful that I didn’t know many people who, who, uh, held that held their own, um, held their own ideas in such high regard throughout my own, uh, academic work. So, um, so I am,
Erik H 00:06:32 I think that that’s a very viable take, right? Um,
Paul M 00:06:37 From a combat curmudgeon, especially the youth energy.
Erik H 00:06:42 Yeah. So a lot of the novel is about, um, you know, when there are dominant kind of modes of thought, particularly within academia, oftentimes there are people who really, you know, chafe chafe against that. And in some sense, it’s kind of necessary. It’s very similar to the fact that, you know, no one who is a billionaire didn’t think when they were a kid, I’m going to be a billionaire, but there are a lot of people who you don’t hear about who thought that the same thing, and they’re not billionaires. Right? And so every billionaire has this, you know, self-reinforcing narrative of like, well, I just believed it from when I was very young and look, it all worked out and the same is probably true for scientific theories, particularly sort of grand sweeping scientific theories. You know, one of the, the main characters or the main character, Kirk is looking for a scientific theory of consciousness, which he thinks there needs to be a scientific theory of even that is in itself debatable.
Erik H 00:07:49 Some people disagree, but, but he thinks this and he, you know, is kind of mano maniacally throwing himself against the problem. And, you know, I want it to draw similarities between the sort of anxiety that drives. I think probably a lot of those discoveries and things like, you know, creative endeavors, like writing a novel or becoming a painter, or, you know, any of these other things that we think of as involving, you know, almost an artistic, romantic level of obsession. And I do think that probably, you know, at the upper levels of science, there is a lot more ego and humanness going on, then it would be apparent from the outside. And my goal wasn’t to say that the character Kirk, who is very strident in his opinions so much so that he can sometimes be off-putting, uh, is correct about everything, but I, I’m also not of the opinion that, that he is kind of irredeemable or that this is actually a very bad thing. I think in some cases it can be a very good thing to be like that.
Paul M 00:09:03 Yeah. I mean, the other striking thing, reading the novel, and of course I’m coming at it from a neuro neuroscientist perspective, and I also knew, uh, your background or, or at least some, some there in just looking through your publications. And so there’s a lot of overlap and I found myself, so I actually thought, um, I learned through another interview that you gave that the, that Kirk K I E R K is Kirk as in Kierkegaard. But I thought early on, I thought, oh, that’s an anagram of Eric with an extra letter. And because there are these parallels, a lot of overlap between the nonfiction of your life and the fiction of what happens in the story. Um, and so I’m kind of wondering, because there are such great descriptions. I think I even, uh, tweeted, uh, early on when I was reading the book, it’s like, you, you like captured the world of non-human primate research. Like so, well, you, you couldn’t have done that, had you not experienced those things. And, and, you know, a lot of like the social aspects and stuff. So it makes me wonder where their fiction ends in the, or where the nonfiction ends and where the fiction begins in the novel.
Erik H 00:10:09 Well, it’s, it’s a good question. And I’m not even sure that as an author, I have a definitive answer that can partition out that boundary, you know, appropriately. I think all authors draw a lot from their own experience and lives. Mine just kind of happens to be in this, um, you know, world of like high performance science, where there is a lot of, you know, stress. And there’s also a lot of really interesting things going on. I mean, you, all those descriptions, you know, in the novel, they, these young scientists are coming to New York to study consciousness at New York university. They’re in a building, which is called the center for neuroscience or CNS, which is very maze, like, so they’re always getting lost in the CNS. And, you know, there are primate labs in the building and even the dynamics between, you know, young people meeting each other for the first time can often be primate ask.
Erik H 00:11:08 So there’s kind of a mirror between the monkeys, you know, and the people and how they interact. And, you know, that’s all based off of, there is a real primate research facility at the CNS at New York university. Um, and it is a realistic depiction of the sort of animal research. And I didn’t want to spare, you know, some people have, have said some, some reviewers have said this, this is a really dark, well, very interesting, very dark descriptions of what’s actually going on. And I didn’t want to spare that because I do think that science alone is thematically interesting enough and dark enough to, uh, to get the sort of literary treatment. I mean, it is an absolutely insane thing to drill open a monkey’s brain lower in a gigantic microscope, into it, having, you know, possibly reprogram the cells in the brain to respond to light and then flash light, you know, over the dark cortex and cause various, you know, uh, effects.
Erik H 00:12:19 And that is a, um, that kind of mechanism and work is so, uh, thematically dense to me that I felt I could only capture it if I drew from real life and real experiences. You know, I, I do think that there’s, there’s no way to cleanly separate it, but I would also say just to quickly beg off like the, the, the, the quick Kirk to Eric comparison that, you know, a lot of other characters also have a lot of me in them. So like, Carmen, for example, yes. Kirk and I went to the same graduate school. Uh, so one might say, well, isn’t it kind of obvious then, but like Carmen went to Columbia university and I worked at Columbia for years. So, you know, th th th her experiences at Columbia are, you know, me observing things that go on at Columbia, right. So, you know, a lot of, you know, a part of me ends up in all the characters and I, and I, and I, I wouldn’t say that there’s some sort of like immensely director obvious mapping.
Paul M 00:13:22 I want to bring Kevin in a little bit, because I have a bunch of questions about just the process of writing and, and what jumped into my head while you were talking about, I didn’t think about this before, but I’m curious Eric about writing the, how, how the process of writing, the more non-fiction like the descriptions of monkey facilities and things of that nature that you’re, uh, ha have a lot of experience with it. Was that faster? Was that harder or easier or faster or slower than the parts that you were more you had to generate in your head?
Erik H 00:13:58 Yeah, I would say probably somewhat similar. I mean, you know, in terms of speed, the speed aspect, I mean, I’m sure Kevin can speak to this in the sense that I do think that nonfiction feels a very particular way. And when you’re writing fiction, you know, the, the goal is, is almost to somehow like transcend the subject in a particular way. Like in the end, the literary eye has to have a final say when you’re talking about fiction, like art is like the laughter, like after everything is done, right, like the universe gets run out. It’s just after heat death, and it’s cold and it’s dark, but art kind of gets this last, like chuckle, like at the end. And I think that that’s true, like in general, like when you’re trying to describe anything that art kind of has to make, maintain superiority, but it’s very dangerous to go into nonfiction thinking about that sort of like romantic, poetic angle. Um, and you kind of have to go in very dry and very, um, very skeptical and like non-romantic at all. So really it’s much more about turning on and off, like the more romantic parts of my brain when I write either, or,
Paul M 00:15:15 But, but you still have to go in, you know, trying to write a readable book in non-fiction. And I realized too, you know, there’s different types of non-fiction because writing a book about the history of dog shows, for instance, uh, you’re not really writing about the unknown and much of the nonfiction that you guys both write, uh, in Kevin and in innate, for instance, is all about, it’s partly about what is known, but it’s vastly about what is unknown and how we might be able to start knowing what is unknown and making connections. And I mean, so, so innate, uh, is a lot of people will have already read it, I’m sure, but it’s kind of about the connection between genetics and development and him psychology. So from like the really low level, uh, code DNA code to our psychological traits. Um, and so in, in a sense that’s hard to pull off writing a readable non-fiction. Yeah,
Kevin M 00:16:10 Yeah. I mean, and, and, and the goal, I guess, I mean, I think of, uh, you know, fiction writing as, um, as very evocative, you know, and really making, making the words, dance and making, making images of, uh, you know, appear in people’s minds in a, in a, in a sort of, uh, a dialogue where the, the author is not necessarily, um, you know, directing everything, but, but more sort of inspiring a response in the reader, whereas, um, certainly what I was doing. Uh, it’s, it’s not really evocative in that sense. It’s really a, I guess not making the words dance, but maybe making the March, uh, you know, trying to be clear enough that there’s a sort of a, it’s almost a kind of, I feel like it’s a kind of mind control almost, you know, you really have to have this sort of constant empathy for the reader to say, okay, well, what did they know?
Kevin M 00:17:00 What are they thinking? If I say this, how are they going to take it? Nevermind what the words I’ve said, how are they going to take it? And then do I need to explain something else? Um, do I need to give them, you know, a, a metaphor, something familiar that they can, um, take as a, a scaffold for an idea that, you know, that I’m trying to build up here. And, um, so yeah, I mean, I find actually writing the book, writing that kind of non-fiction for nonspecialists really, um, fun, uh, but it’s a different challenge to writing, you know, academic papers for very specialist audiences, where you can rely on the crutch of shared knowledge and shared perspective and shared assumptions. Um, and sometimes the goal in writing the, the interdisciplinary stuff is, is to question those assumptions from any, from any individual and, and, um, I guess try to recast, uh, things so that the relations between, like you said, genes and brains and minds, um, can be seen in it in a particular perspective. And the perspective I was taking in Nate is a developmental one. The argument was that the only way to make sense of that relationship is through it, through the prism of development
Paul M 00:18:14 And the take home. First of all, two things, one, the take home is that everything is messy, yes. And development. And so that’s one of the take home take homes in the, in the book is just, you have genes, you have psychological traits, they’re not a one-to-one mapping. Everything is super, super messy. And we have forgotten about development as a process that, um, gives rise to us just tons of variation in itself.
Kevin M 00:18:37 Yeah, exactly. The idea that there’s some genetic variation in our psychological traits is, is nothing new. Um, but what I think was the message I was trying to get across is that that variation is realized through the processes of development. And like you said, there’s not, there’s no one-to-one mapping between, you know, a gene for this and a gene for that cognitive traits. It’s really complex polytehnic, um, and very indirect and, and sort of emergent relationships between those. And yes, the processes of development themselves are noisy in molecular terms. So you can start with the exact same genome and you won’t get the exact same outcome every time you run that program, basically. So that’s why, you know, identical twins don’t look exactly the same and their brains are not exactly the same as each other and their minds are certainly not exactly the same. So, yeah, I think development is that, um, third source of variation in our individual natures, that’s often overlooked and, uh, and an inner sense, a really important one because it, it defies any predictability. It, it will never be predictable. It’s just inherently stochastic. Um,
Paul M 00:19:49 That’s a really down, it’s a real downer, you know, that well, in a sense,
Kevin M 00:19:53 Uh, you know, it puts a limit. It’s interesting, cause it puts a limit on, um, on genetic predictability, for example. So the, the, uh, claims that, you know, you’ll be able to sequence someones genome or sequence the genome of embryos and, and, and really predict with some accuracy what their psychological traits is going to be like, you just won’t ever. And it’s not just that we don’t know
Paul M 00:20:18 Designer babies.
Kevin M 00:20:20 Yeah. Designer yes. Designer babies. Yeah. Sorry. It’s not just that we don’t know enough now it’s that we never will. There’s a firm limit in principle on how much we could ever predict from that.
Erik H 00:20:30 Kevin, do you, do you find, um, that it’s harder to attract attention arguing like a non-fiction perspective wherein you’re arguing from, uh, like a more skeptical perspective? Like, like what you just said right. Is a lot easier. It’s a lot easier to sell the opposite.
Kevin M 00:20:51 Yeah. I, I do think, um, yeah, I do think that a more sensationalist point of view, uh, probably would sell more books than a, than a more the, the, the nuanced kind of picture that I’m trying to show, which is complex and it is messy. And at some point you just have to, you just have to accept that, but it doesn’t, um, you know, there aren’t that strong headlines, like, you know, a strong headline is DNA is your future. That’s a great, that’s a great newspaper headline that people are gonna want to read that. Whereas, you know, the headline, well, it’s complicated that doesn’t, uh, doesn’t necessarily jump off the page in the same way.
Erik H 00:21:32 Yeah. Right. Yeah. It’s, it’s something I’ve been struggling with, you know, myself. I mean, I think that the defining feature of like good literature is it’s agnosticism, you know, you’re, you’re kind of agnostic about, about almost everything when you’re writing, like, you know, whether or not this person is a good or bad person, you have to be agnostic about that. Um, and, and, and whether or not, you know, in, in the revelations, you know, it’s, it’s very much not that one particular hypothesis about how consciousness works is advanced. Right. All the characters have a different take on that. And then when I go to write non-fiction, it’s very much not agnostic. Right. Like you have to put that aside and take some sort of strong, you know, you’re, you’re either a hardcore atheist or you’re like a fundamentalist Christian, or what have you. Right. And that, then you kind of argue firmly for this belief. And the agnosticism kind of is, is left aside. I don’t know if you’ve ever had,
Kevin M 00:22:26 Yeah. I mean, in the sense, I guess what I was doing was, was taking a strong position against extreme positions. So I was arguing against genetic determinism, but also against, uh, naive empiricism where everything is. So, so in a sense, there’s an argument, you know, innate is, uh, argumentative in that sense, it’s advancing a set of ideas. It’s just that they’re their ideas in the middle. They’re not, they’re not ideas that one or other extreme.
Paul M 00:22:56 So, so for instance, Eric, I know that you consider yourself a, a writer first and, uh, an author first, perhaps, and a scientist. I don’t want to say second, but, um, because you’re, you’re, you know, fully engaged in science also, but I know from an early age, you have always bought, wanted to be a writer. So in some sense, you consider yourself a writer first. Um, the reason why I’m bringing this up is because I have this weird, what I really want to know is the right, uh, cyclical, um, pattern for me and for, for anyone to like work on something and then walk away, but not just walk away, work on something else. Right. And then coming. And then when is the right time to come back to the thing that you were originally working on and you have three or four different things you’re working on, what is the right pattern?
Paul M 00:23:42 Because when you do that, when you go work on something else, whether, you know, sometimes it’s just taking a walk, but often it’s also diving deep into another subject. And that’s when the real insight comes relative to your first for the thing that you’re mainly working on. And there must be some, uh, some right answer for people, you know, in particular for each individual, for how long and what debts to work on something before moving on to another thing and coming back and revisiting and cycling through. And I’m wondering what your experience is. If you found the right rhythm, um, with, with your writing and Kevin, this applies to you too, because writing nonfiction is a different beast and how much that informs your science and vice-versa
Erik H 00:24:24 Yeah. The description of the cyclical nature of that is key. You know, the reason I’ve described myself as a, as a writer first is one that, of course I want people to take the book seriously. I mean, I think that there’s the standard take is something like, oh, look at this a time, you know, uh, but you know, who, who somehow found the time and like was incredibly lucky to get it published. And it’s like, no, you know, if you look historically, I grew up in an independent bookstore that my mother owned and I worked there as a teenager. And so I always loved books and was surrounded by books and wanted to be an author first and foremost. But, um, all my favorite writers wrote about, um, really drew from their background and experience, you know, um, somebody like Herman Melville going off and writing type, he, after he gets stranded, amid the cannibals, you know, or Joan Didion finding the counter-culture right.
Erik H 00:25:18 And it’s like, well, I th I didn’t know where the counterculture was, you know, when I was 17, but I did find the non-fiction section of the store. And I realized that I could actually be pretty good at this. Um, and that the world of science was itself incredibly interesting and rich, and really had been under studied from like a literary slash humanities perspective. You know, you can go back and read like CP snow’s the two cultures, um, you know, a famous lecture where he’s just bemoaning the lack of communication between the humanities and the sciences. And I think that that’s still true today. And, you know, I did, you know, have this idea for the book you, you know, even in college. Uh, and I ended up pursuing my PhD in neuroscience, at least partly in order to kind of, I knew that I would need to have that background, as you said, so much of the book, you know, draws from reality and has that ring of hopefully has that ring of truth to it.
Erik H 00:26:17 And that’s from, you know, getting literally going and getting my PhD with all that said, just to answer your question about how to balance those things. Um, I think that it’s, it, it, it is very, very helpful to work in cycles. I don’t think that there’s any way that someone can completely appropriately balance two very, very different fields. And I’m sure this even applies within Kevin’s own scientific research, which draws from various interdisciplinary aspects, because just doing deep dives into something, and then coming up is always going to be better than doing something shallow. So there have been periods of time, you know, even like a year where I just have not written a word of fiction and then I’ll start writing again. And, you know, it’ll all just kind of pour out. So I’m, I’m very, very much in the cyclical nature. I wish I could systematize it and tell people some sort of good, you know, system to do it. Uh, but I think it it’s, it’s, it’s, it’s, it’s almost, uh, it’s almost always by the seat of my pants.
Kevin M 00:27:23 Yeah. Yeah. I mean, I, I would, um, yeah, say something similar. I think the, um, the cyclical nature for me is somehow enforced by reaching a point where I’m just not making progress, you know, where I’m just trying to write something and I just can’t, it’s just not flowing and I just need to go away and do something else. Um, it’s often when I written myself into a corner and actually I need to pull, I need to pull back from that. And, um, yeah, like, you know, going for a walk or something like that, or even just not looking at it for a week or so, and, and coming back fresh. Um, but also I think before I start writing, there’s a long, long period where I’m just kind of ruminating on stuff and I’m reading loads and loads of different things, um, kind of thinking about them.
Kevin M 00:28:11 I may be making notes and stuff. I might not even ever go back to the notes, but there’s sort of an active process there of saying, yeah, here’s an idea that I can use. And, and, um, I mean, the ones I really get excited about, I guess, are aware, I’m trying to explain one thing, and there’s an idea that comes from another field, but actually it’s, it’s very much the same process. And so it’s, uh, uh, you know, some, some kind of insight that I can use there that is a kind of a cross-fertilization of, of ideas. Um, that’s, for me, that’s the really intellectually satisfying stimulating part of doing the research for these kinds of books that are trying to make a synthesis of, of different fields. But then at some point I get to the stage where I’m like, yeah, okay. I think, I think I can start writing. I’m just going to start. Um, and then, um, yeah, I just carry on until I hit a wall again,
Paul M 00:29:06 Why are you ready for the, uh, the big showdown, the big debate,
Kevin M 00:29:10 Should we think we’re going to vigorously agree?
Paul M 00:29:14 Fine. I’ll disagree. What is it? So, uh, you guys, apparently at least on the surface differ in the answer to the following questions, to the following question, what our brains for, and in this corner, we have Kevin who says brains are for action. And in that corner, we have Eric who says brains are for consciousness. And I don’t, I don’t know this was just, it happens. This was a, for some reason, I, to be honest, I don’t know why I ever go on Twitter, but I saw that there is an exchange between you two on Twitter and it was this exchange. So I don’t know what the backstory is and how tongue in cheek it is.
Kevin M 00:29:55 I can’t remember. I can’t remember either. I do. I do remember I’m disagreeing about Marvel movies, but the, um, yeah, the consciousness versus action thing. I don’t, I don’t think that’s, I don’t think it’s a real versus there. I think it’s a, well, for me, I think if you look in an evolutionary sense and you say what our brains, or more basically what our nervous systems for, I think they’re for homeostasis actually, therefore keeping, helping the organism keep itself going right to keep its, its all of its systems in the optimal operating range. And um, one way the organism can do that. Of course it’s sort of regulating its internal physiology. So reconfiguring its biochemistry say, um, but another way it can do it is um, if the, you know, if it can’t locally adapt to its environment is to move. So it, but, but the goal of it moving, uh, is to restore itself to homeostasis.
Kevin M 00:30:55 So for example, it might be hungry. That’s a signal that its internal physiology is, is a skew out of the range that wants to be in. Um, and then it can move in order to find food. So a goal-directed reinforced, um, kind of behavior. And of course, you know, simple organisms, single single cell creatures like bacteria and amoeba do that. But nervous systems in, in multicellular creatures are really good for, um, you know, coordinating action across the, across the whole organism. And um, and of course they have built up this, this, uh, power of information processing. So rather than just having a single trigger that, you know, you go towards you just doing chemo taxes, you can assess multiple things in the environment and you can integrate that information and build up a picture of what’s out in the world and even predict things about what’s in the world and take action that anticipates things and so on.
Kevin M 00:31:53 So you can get this sort of elaboration over time that nervous systems allow, um, especially when they have a kind of a hierarchy that gets processes more and more abstract things about the environment. And the ultimately I would say that ends with consciousness where what it’s processing is the goals and beliefs and desires that are being represented or enacted within another part of the nervous system. So for me, consciousness is the ultimate means of in a sense controlling action. And it’s still in favor of the, or in the service of this ultimate goal of keeping the organisms persistent.
Erik H 00:32:34 Yeah, I think, I think just to follow up on this and maybe, maybe I’ll, I’ll try to say something radical. So Kevin and I actually have something to, to, to, to disagree about it, you know, to, to be like as, as, as radical as possible, um, you know, a big concern of mine and this is of course merit and you know, some of the, the, the characters in the revelations is this idea of a scientific theory of consciousness. And the way that I would maybe phrase this is that right now neuroscience has very good correlational, uh, measures. So we can do pretty good job in neuroimaging of correlating someone’s experience to some particular brain state, but we have one would say no lawful, uh, measures. So, so we have no lawful way to, or relations. We have no lawful way to relate, uh, you know, some ongoing neural activity to a particular conscious experience like, you know, classically the redness of red or the feeling of pain or so on.
Erik H 00:33:36 And if we don’t have a, and my suspicion is that if we had a lawful way to do this, it would become very apparent that most of the brain’s kind of architecture and design is in instantiating is based around instantiating. This, you know, basically stream of consciousness, which is kind of this dominant information flow within the brain and that everything is kind of subservient to it in that it’s feeding it or manipulating off of it or so on. And that this would be very, um, this would probably be, uh, a big paradigm shift just in the sense that a lot of previous results would maybe look pretty incommensurate. And the reason why I say that the goal is consciousness rather than behavior, is that, um, you know, certainly I think that you need behavior to develop consciousness, you know, and all these things. But I do think that it is true that most of the time for conscious experience, a lot of the world just does not actually filter as directly into behavior.
Erik H 00:34:46 In other words, it takes an immensely convoluted route, you know, in the end, we’re all Darwinian. And, you know, the, the reason that, you know, organisms survive is because of the way that they behave, right? Like that, that is in controvertible. But I think that there’s a very, uh, a view that I don’t agree with, which is that consciousness is very minimalistic or almost epi phenomenal, or you’re only conscious of as tiny, tiny top of the iceberg and everything else is going on. I think that that’s wrong. I think probably, you know, um, even organisms that we think of as having not very complex behaviors are, might have a very definite consciousness. And that, that is the thing that much like for ourselves that feels like it’s kind of in control and so on. And so, um, you know, this, this view you is, is, you know, in my, in my opinion, not quite, um, as popular as it should be.
Erik H 00:35:45 I mean, and I would say that as a bit of an understatement, because if it’s true and I’m not, you know, what one could argue against it, but let’s just assume for a moment that it is true. Then the question of lawful the question of lawful relationships between, you know, neural, um, uh, you know, neural states and experiences, it becomes incredibly powerful and probably would in my, and probably sweep away a lot of contemporary, you know, neuroimaging or the way that neuroscience has done or so on. So that’s why I stress this consciousness as primary approach, because it just is a change in it’s just so different or at least somewhat different than how, you know, this, maybe the staff, maybe the average neuroscientists, although that’s very hard to figure out, right. Like what the average neuroscientists view is.
Kevin M 00:36:30 So I would agree in one sense that first of all, that we don’t have any good, good theoretical grounding of consciousness really, or there’s hardly much good theoretical grounding in neuroscience, generally, it’s, it’s kind of theory free. Really. I disagree hanging on. I disagree. It might be good theory free, but there’s a lot of theories. Well, there’s a lot of theorizing. We don’t really have a, there’s not a, you know, and this goes for biology overall, actually we have one good theory, which is the, the theory of evolution by natural selection. That’s our bedrock and everything else around, you know, beyond that is, yeah, there’s loads of theorizing. Uh, but I don’t think we have a solid framework. We don’t have a standard model, but I’m not, I don’t, I don’t mean to be dismissive of the work of theoretical neuroscience is just, hasn’t gotten there yet.
Kevin M 00:37:20 I, I actually think it’s really important to be work to be doing. Um, but I would say, so the way that I think we’re going to get to, um, a principled understanding of consciousness might be, uh, in, uh, in, in following an evolutionary trajectory to say, okay, well, if we think of nervous systems, as, as you know, they’re two as control systems, basically, um, then what does consciousness get you in that context? How, you know, how, how does it better, uh, allow an organism to control itself by having that kind of a subjective experience of something going on? And when we get to humans, I think the idea that we’ve got what effectively is metacognition, you know, the, so that we can, it’s not just that we’re having a conscious experience it’s that we can introspect about our goals and beliefs and desires in a way that gives us actually some control over them.
Kevin M 00:38:18 Um, I think that’s, um, a powerful sort of maybe addition to, um, to the arsenal that an organism can bring to bear in terms of maximizing its agency and autonomy over time. But, you know, when you’re thinking about, say a fruit fly and I agree that a fruit fly probably has some kind of fruit fly consciousness, then, you know, the question is what does it, what does that feel like? But also what does it get the fly above and beyond the call, the control systems that are already built into its nervous system. Why does experiencing something help there? And I don’t, I don’t know what the answer to that is.
Erik H 00:39:01 Well, what’s so funny is that if you ask a purse, if you asked like an average person on the street and you ask them, like, what’s the point of consciousness, right? They’ll give you a very functional definition based off of things like, well, uh, you know, if something hurts, you’ll move away from it. Right. And if something feels good, uh, you’ll do more of it. Right. And things like that. And, um, you know, to be honest, I’m not entirely convinced, we’ve even been able to supplement that in, you know, the sort of artificial brains that we make with things like deep learning, right? Like we’re kind of cheating where, where we’re, we’re kind of, I mean, we were basically just doing calculus about the input and output and figuring out, you know, what, what, what inputs you need to get to the output that you want.
Erik H 00:39:48 That’s obviously not how biology is doing is doing this. It’s doing it off of somehow conscious experiences. Like don’t, don’t ask me how, or at least that’s what it appears to be. And so kind of there is this very naive functionalist approach, which is just that, you know, organisms have experiences. They have some sort of spectrum of, um, you know, AF fact along those experiences. And then everything they’re doing is kind of trying to maximize or minimize their, their effect along them. And that is I think, a viable read and might at some point reassert itself as a very viable read, if you got a good, you know, lawful relationship theory,
Kevin M 00:40:34 I think the only problem with that, Eric is that the, you know, you can build a lot of those sort of control systems into, into robots. For example, you know, you can make a robot, uh, withdraw from things that are damaging and you can make a robot go towards things that are rewarding. You can build reward and punishment into, into the circuits. And of course in, you know, and when we look in animals, you know, we can do these, these experiments now in, in mice or monkeys or other things where we’re tweaking those circuits. And we’re literally changing, not just, you know, not just controlling what the animal is doing, but controlling its cognitive states controlling what it’s, what it’s thinking basically. Um, but it’s all, you know, you th the, the counter argument would be to say, well, okay, all that machinery is there, right?
Kevin M 00:41:18 You’re, you’re, we’re going to send a reward signal that we’re going to send a punishment signal. The circuits are going to interpret it this way or that way. Um, and the question is, why does it, why does it help for that to feel like something as like, if you build it in a robot, is the robot to experience that, is that the, you know, where’s the, where’s the magic sauce coming from, um, that, that converts the neural processing into a conscious experience. And why does it help, you know, is it just that it’s broadcasting the signal to the whole nervous system? And that’s just what that feels like? Is it, does it inevitably feel like something, or does it add something functional to the, uh, to the mix?
Erik H 00:42:01 Yeah, let me maybe push back a bit on that initial assumption that we do have very good models for how it, for how it works. So, so one is, I would say, you know, maybe for some very, you know, maybe for like a cliche, you know, or something like that, we have very good neural models. The moment you get into something like mice, I honestly do become somewhat skeptical of, you know, a lot of, kind of the contemporary approaches. And now I know that that sounds like me just like throwing out the whole thing, but let me just give a, give an example of, I don’t quite think that if I, when I have like a Rumba, right? Yeah. My Roomba’s doing various things that look like it’s trying to avoid or go back home, you know, or so on. And I think that it could very easily be that we’re kind of fooled by this where we think, well, this is a very reasonable explanation for like an animal’s behavior where it has some sort of almost like pre-programmed algorithmic, you know, um, uh, very simple thing inside of it.
Erik H 00:43:07 That’s, you know, going to be governing it basically, you know, in the same way. And you can say, well, maybe that’s almost like a bit of an illusion, um, which is, you know, and that actually what’s going on inside an organism is like vastly more complicated and somehow rooted or grounded in the actual experiences. It’s having an, a Roomba just kind of apes that, and, you know, well, we can open up the Rumba and do experiments and we can open up a mouse and do experiments. Maybe they’re just actually kind of a fundamentally different natural kind. And you, you could have a whole behavioristic science of Roombas and our current techniques would work very well. But if you did it for mice, maybe the current techniques would only kind of seem to kind of work well enough that you can get publications and, you know, do various other stuff, but they’re not actually super effective as like a view of it. And again, this is, I’m not saying that this is a hundred percent true. I’m saying that I don’t find this view represented enough, just a really kind of like hardcore consciousness, first view of things. Wow.
Kevin M 00:44:12 I mean, I think so. I wouldn’t necessarily, I guess I’m very sympathetic to the idea that the, uh, the approach I just described there of, you know, digging into the, the, the neural circuitry of, of animals and tweaking this way in that way and showing that you can control the behavior. Uh, I, I don’t think that gives us understanding necessarily we can get control without understanding of what the organism is doing. And I think the reductionist sort of approach really mechanistic is just fundamentally wrong. I think these are, you know, we have to think of these as, as organisms in, uh, in concert with their environment as, as ongoing processes, really that have a kind of causation that’s not just instantaneous and mechanistic. And that, that sort of view is not really very, um, very popular. And I see in a really vague sense how consciousness will somehow fit into that kind of model better than a mechanistic one. But I mean, I don’t see exactly how obviously if I did, uh, we’d have a much better understanding of what consciousness is and what it’s for, then we, then we currently
Paul M 00:45:20 I’ll bite on, on Eric’s radical statement. I think that you like loaded up the crazy train and headed out by, by, uh, going with the, uh, I’ll just say something radical to, by, by going with a consciousness first approach. I mean, because there are so little evidence that, uh, con well, there’s so much evidence, so here here’s my here’s, here’s my pushback, I suppose that, um, I think there’s more evidence that consciousness is the tip of the iceberg. Whereas you were saying that there’s more of the iceberg in consciousness than, than we appreciate in, in academia. I have that. Right, right. Yes. And, but the, but the evidence I would suggest, um, is, would be in my favor, I guess, or what you’re saying is like the, the rest of academia, academia is favor that the vast majority of our processing is unconscious. And we have, uh, for me, uh, I’m, I’m at home at ease with the fact that I have a very low dimensional, very minor connection to the rest of my processing. And, you know, that sliver of freewill that I don’t really have, but I think I have is, uh, just, I just barely, I’m barely conscious, essentially. I’m barely aware of like what I’m doing and not in control at all, which is not a great feeling, but I’ve become at home with it. Um, so, but, but I think that the vast majority of, uh, research would support that notion that it is just the tip of the iceberg.
Erik H 00:46:49 Yeah. So, so, so I, I disagree. I think that that is a complete for you and holdover and that Freud’s immense. I mean, it just is very difficult to overstate. Freud’s immense impact on ways of thinking from about 1930 to 1970, I mean, his complete and utter domination of the intellectual scene and this idea that, that humans are driven by, you know, mainly on sub sub or unconscious processes and, you know, Freud’s theories, specific theories have now been, you know, pretty much round, you know, roundly. Um, yeah. But his, his, his focus on the unconscious and the minimization of consciousness is I think still incredibly predominant. I don’t agree that there’s any good evidence. I mean, as far as we know the only complex agential behavior that biological systems demonstrate occurs when they are conscious, you know, there is very, very few or rare cases of somehow loss of consciousness and complex behavior.
Erik H 00:48:00 And they’re very questionable. It’s, it’s completely, you have to separate between whether or not you are conscious of all the information flowing in your brain, which is not at all a position that’s even worth kind of discussing and whether or not in terms of a consciousness first approach, whether or not the stream of consciousness is completely necessary for the complex behavior that the organism is demonstrating. So, and these are, these are two different things, right? And this is something like, you know, your computer would be kind of non-functional without this sort of very nice top-level user interface kind of baked into it. So, so even if it’s the case and now the computer metaphor, isn’t perfect because, uh, you, you know, so, so let’s take it as it is, but like, even if it were the case that you could claim that consciousness is relatively high level within the brains, whatever term you want, representation, information processing either like poorly defined terms that neuroscientists throw around, um, you know, whether or not the, the brain is very high level, it doesn’t really matter because what matters is if you take away the high level, does the whole thing just collapse.
Erik H 00:49:10 And I would say both from a, from a naive perspective of like, just people’s understanding of other people’s psychology and their own psychology, this is true. And also there has been no good disprove and, and most of the stuff are things like working memory papers that I think are kind of poorly, poorly generalized and, and things like that. So, so I actually do disagree about the predominance of evidence.
Kevin M 00:49:32 Yeah. So that’s interesting. Cause I, um, I would be more, uh, uh, long Paul’s line here, but I think there’s a, there’s a question I guess, about Eric, when you’re talking about consciousness, whether, you know, because it means so many different things. Right. And if it sounds like what you’re talking about is that it’s, it’s just, the organism is online basically that it’s been booted up and it’s active. Right. And, and as opposed to the question of whether it has to be having subjective self exp self-aware experience and be aware of itself experiencing things, um, and, and to me, I’m happy to buy the idea that the whole system has to be working for, uh, the organism to behave as it normally does. Although I think that would look and feel very different for organisms of different level of complexity.
Erik H 00:50:22 Yeah. I, I certainly agree about the, the looking and feeling too to some that w w w the only thing, I mean, by conscious experience is a, is, is the Jamesian sense of a stream of experiences, which are qualitative. So the, what it is likeness. And so, and, and, you know, if you’re, if you’re, uh, if you’re giving explanations about people’s behavior, what you’ll find is that you talk entirely in terms of their conscious experiences. Now, sometimes you might say something like, well, they unconsciously wrote a letter or so on. Now the standard, by the way, just to, just to say this, you know, I think the standard reply that I’ve heard from this is that eventually it gets down to people saying something like, well, you know, when you add up numbers in your head, do you really do the addition or are you kind of handed the solution? Right. And I think that that’s actually a reasonable, uh, uh, take, but it doesn’t mean that you could actually do say, um, many of the things that you require consciousness to do unconsciously. This is the false.
Kevin M 00:51:29 Yeah. Okay. But if we maybe frame it in a different way and ask about, uh, you know, decision-making and action selection, then I think all the evidence is really clear that most of the decisions, sorry, most of the actions we take, we’re not consciously deliberating about them necessarily, uh, in a, you know, in a, in a, cause it just takes too long. We’re on autopilot for most of the things that we do most of the time, because we have these constraints built in to our habits, to our holistics, to the policies, you know, decisions that we’ve made before, about what we will do in the future, um, which is all good and important because otherwise we’d take so long deciding everything that we’d be we’d have been dead long ago. So, you know, in terms of, sorry, go ahead. Go ahead.
Erik H 00:52:10 Oh, I was just going to, just for that very specific example, I would say, I think that, again, some of this stuff is just linguistic, so, um, you know, your, your, your, your point is absolutely correct. Right. If we, if we cognitively kind of, you know, made high level decisions of what we think of as consciousness, but I th the trick is that I think that that’s a very different use of the word consciousness, as simple example might be like, let’s say, I reach for a glass, you know, a reach for a glass of water. Now you might say, well, did you really deliberate consciously about whether or not you would reach for the glass of water, you know, before you reached, right. And of course, everyone would say probably not most of the time. Right. And then, you know, I don’t think that one can, at that point claim victory at all, because what you can say is, listen, I kind of felt like this urge, like this whole, this whole thing played out within the activity of my stream of consciousness. I saw the water, I had an urge. I wouldn’t have really analyzed it or described it. I wouldn’t have spent much time on it. And then I, you know, consciously reached out, grabbed it. Everything is again, operating in the theater of my consciousness. And then I took a drink and I experienced the, you know, the sweet, cold liquid. Sure. That what I mean,
Kevin M 00:53:24 But there’s lots other situations
Paul M 00:53:25 That are even less than that. Can I give an example because I burned the hell out of myself two days ago with coffee. Um, so I have this, uh, this is gonna sound highfalutin, but I, I, you know, I put butter in my coffee or whatever, and you gotta mix it up. So I have like this air rater thing. Oh, stop grimacing, Kevin it’s. Okay. It’s, uh, it’s intermittent fasting anyway. So you stick this little wand in and it spins really fast. And I had, and kind of like air rates, the coffee mixes up the, the butter and stuff. Um, it’s unsalted butter. And I had heated the coffee hot enough so that when I put the butter in it, wouldn’t, wouldn’t get cold. And right when I started, um, air rating and I pressed the button and it goes is, and for some reason that it kind of blew up.
Paul M 00:54:08 I don’t know, it was, it’s a butter reaction or something with a coffee and in that. So, so my experience was nil, but what happened was I managed to, uh, take the air Raider out. I did actually accidentally throw it across the room, but nothing was broken. Um, and, and at the end of that experience, I was thankful that my body took over and perform these complex actions without me being aware of it. And you sort of like come to and realize, oh, I just did all I, I made, you know, a lot of degrees of freedom movements and yes, uh, the air, the, the little wand is okay, but I did have to pick it up, you know, cause I, my body did kind of, what I’m trying to do is, is take it away from reflex and say it was more than reflex because I was making a complicated movement. Uh, but it was all unconscious, all my body. So just to throw that example as, I don’t know if Kevin you’re going to
Kevin M 00:54:58 Yeah. Look, I mean, I think, um, again, there’s lots of things that we do on complete autopilot where we’re not even necessarily conscious of what we’re doing, uh, at all, you know, you can be driving along and, and just, uh, you know, drive to the wrong place because you’re not thinking about it at all. You’re, you’re, you’re just really not devoting much cognitive resources, uh, to that task at all, except a kind of a surveillance for, you know, danger and traffic signals and stuff like that. So, um, I guess, I mean, it’s sort of appealing to the, uh, system one system two, um, you know, dichotomy or, or a spectrum maybe, um, of, of Daniel Conaman, but in terms of decision-making, uh, you know, I think the, the things that we do consciously and deliberatively at least are a small subset of everything else, but, you know, maybe it’s maybe it’s, uh, maybe it’s semantic.
Erik H 00:55:54 Yeah. I, I find it incredibly telling that the clearest example you have is basically
Paul M 00:56:00 That’s what I was saying is, is that it was beyond before
Erik H 00:56:03 That I agree with, right. So, so it’s very telling that, right. We, we immediately go towards something that we actually do all agree would be a kind of classic unconscious activity. Right. We should like putting your hand on a hot stove. And let me just say that, even that, even that, right, like even it, particularly in your example right now, if you didn’t already have like the theater of consciousness set up such that you knew that kind of broadly available information about where your body is, where this thing is, all these things, and then yes, maybe you do have something that happens, you know, so quickly and kind of neural timescales that you’re only going to experience it once it’s, once it’s over, but it’s still making use of all that information that you already had. So even in that case, I wouldn’t be willing to say that your conscious, your stream of consciousness had no kind of significant causal impact on, on what you did.
Erik H 00:56:54 And if even that case, I feel like one can kind of possibly defend it. Then I think that when we get to more complex cases, it becomes more and more obvious. And again, I think that some of this stuff, you know, as you say, Kevin, it is semantic, right? Where one has to say a precisely what one means. But I think by focusing on this notion of a stream of consciousness and the degree to which that information is used right, and necessary, then one gets, I think, closer to kind of both, interestingly enough, closer to the naive perspective, which is actually probably, which is that, you know, human beings are experiencing these things and they’re just basically reacting based off of what they’re, what they’re conscious of. And, you know, they have their, their various, you know, he, Dominic, uh, pleasures and pains and so on. When you get closer to, when you take this view of brain function, you also get a lot closer to the naive view. And I find that is probably a good thing and good evidence for it.
Kevin M 00:57:53 So can I, can I push back Eric, just on the, um, well, I want to roll back in time as it were evolutionarily. So if we imagine just an amoeba say, and it’s a schmoozing around the place, and it’s getting some signals from the outside about where say some bacteria are that it could eat or where other amoeba are to form, uh, a fruiting body or something like that. So it’s got, it’s got information in that. There are, uh, you know, it’s got receptors on the surface, they’re sending a signal internally when they bind some chemical. There’s a, therefore there’s a pattern inside the organism that has relative information, right. It’s physically correlated with something out in the world and it’s configured in such a way that it responds to that by say approach or avoidance. So my question is, I guess, where is it experiencing any of that is an amoeba experiencing any of that. And if it is then then fine, you would say that’s a kind of a prodo consciousness, then that’s fine. I’m happy with that. But if you think that it isn’t, then at some point in evolution, consciousness arose where it wasn’t there before, and then, and then literally its behavior first consciousness, second as an, as an add-on in, in evolutionary terms. But I’m wondering, what do you think about the, the amoeba if it’s having a Miba experience?
Erik H 00:59:22 Yeah. Um, I would say that’s dependent on the final theory, right? So this is the boring answer, right? Like this is the boring answer I can give is that, you know, when consciousness arises, uh, is basically just a function of whatever this law, this lawful relationship, you know, is. And, uh, I don’t know what the lawful relationship is. Uh, unfortunately, you know, I wish I did. I, I can give some, some guesses and we could talk about like, you know, uh, uh, maybe, uh, uh, well, at least one of the bigger theories, which is like integrated information theory, uh, which is I think, um, you know, maybe it’s not well accepted, but it’s kind of well known and well discussed. And there are empirical studies that do support it. Like I, that one should be clear about that. There are, are some good studies, um, although I don’t think it’s correct.
Erik H 01:00:13 Um, but yeah, I, I, it’s reasonable to say just because I worked on it, so we should have, my, my personal opinion is probably that it’s not the final theory, but it’s, it’s a, it’s a good theory. It looks kind of like what a theory should look like. And, uh, so, you know, so, so, so that, I, I can’t quite answer it, but maybe I could just say that, um, you know, the, the gap here is probably a bit bigger than people think in that, depending on what the sort of lawful relations you end up with, it could be very much that consciousness and it’s totally at the phenomenal and only looks to be, you know, it just so happens, right? That we experience something very unpleasant, right? When we are supposed to be acting like we experienced something very unpleasant, um, you know, or it could be maybe very directly causally impactful.
Erik H 01:01:11 And I think for those sorts of questions, you know, we, we need, you know, theories of causation. You need theories. I know Kevin, you’re interested in like theories of emergence and, um, and, and theories of consciousness. And I think that those things need to be resolved like my own personal preference to be completely honest is that I think that emergence is very solvable scientifically. I don’t think that there’s anything in there, even in the most, even taking very seriously everything that philosophers talks about. I like classic analytic philosophy about eMerchants even taking all that stuff. Let’s just take it very seriously, even then I think it’s completely solvable. And that feels very different to me than like consciousness where, uh, you know, I have some ideas, but, uh, to, to, to be honest, I don’t have any of the same certainty that anyone’s gonna crack it, you know, in the next dozen years. I mean, maybe this is an opportunity to talk about, uh, emergence and some of the stuff maybe we do,
Paul M 01:02:07 Let’s, let’s go because I want to make sure we have enough time to go down that road. So, I mean, Kevin, one of the reasons why you’re here right now is because you’ve been working on, um, the evolution of agency and, and the essentially of agency and Eric, you have a host of recent publications talking, uh, examining how you can use information theory, um, concepts to show that you can get more there’s, there’s more in the macro level than in the micro level. You can show that mathematically in these certain systems that you use as examples. Uh, so yeah, I mean, I just kind of introduce those topics because I just want us to go down that road of, you know, so maybe I’ll start with here, here, Kevin, I’ll quote you in a recent, uh, talk here. He’s a patterns of neural activity have causal power solely by virtue of their meaning. Okay. So where does meaning come from? Let’s go down this road.
Kevin M 01:03:05 Well, yeah. Great. Good. Okay. So, um, yeah, I mean, that’s, that’s really a pushback to the reductive view that in fact, you know, as we learn more and more about how neural mechanisms work and, uh, seemingly underpin things like desires and beliefs and goals, and so on the less work there seems to be for the desires and beliefs on goals themselves to be doing anything right. Th th the mental content doesn’t seem to have any efficacy there. It’s just like, well, look, the neural circuits are firing that way, and they’re configured like this, and this is what’s going to happen. So what’s all this other stuff is just epi phenomena. And I think there’s a, there’s a strain, at least in modern neuroscience. That’s, that’s quite reductive in that sense. Um, and I think it’s absolutely backwards. I think that those patterns of neural activity only have any causal power in the system because they mean something.
Kevin M 01:03:58 So the system is configured in such a way that the patterns, uh, refer to something, represent something, reflect something, either out in the world or, or internally that is, um, tied through either evolutionary wiring that’s that does that sort of pact this program for configuring the nervous system a certain way into the genome or through the individual learning of, of the organism through experience such that the, um, the outcome is, uh, you know, um, appropriate for the, the organism and in, in light of the goals that it has at any moment. So, you know, that’s a long-winded way, I guess, to, to say that the organism is behaving as an agent, because it has purpose built into it by natural selection and the simplest things, uh, you know, single celled organisms, their purpose is just to persist, but that’s how natural selection works. Things that persist, persist and things that don’t don’t.
Kevin M 01:05:01 So we see the ones that do so that tendency is just wired in there. Um, you know, starting with biochemical circuits that, that maintain themselves going and, and, and then moving to, um, behavior when animals can sense things in the world that it is adaptive for them to, or avoid. And then that behavior gets reinforced over time. So in that sense, the meaning is, first of all, a pattern of information that’s correlated with something. So that’s just the, there’s nothing controversial about that. Lots of things are just physically correlated with each other. Um, but secondly, that it has some relevance for the organism in terms of its goals. So it, in terms of the purpose that it has, so it has some, some salient and some, um, and some importance, and it’s linked consequentially to some kind of action.
Erik H 01:05:53 Yeah. Kevin, maybe you could say something about, um, like this, the very first thing you said right. Which was kind of framing this, which is the reductionist drive within neuroscience. Um, w how do you find it, like almost overwhelmingly common? Um,
Kevin M 01:06:13 Kind of, yes. Uh, I think it’s, it’s not always explicit. It’s often just sort of implicitly there, the idea that we can, first of all, go, you know, w we can break down behavior to the circuits, the components that are driving it, and we can control them with these amazing experiments. And that sort of reinforces the idea of a mechanism at play that we can intervene on and, uh, and drive and manipulate. But then, you know, below that, there’s a, there’s an even deeper sort of idea that actually, you know, it’s the circuits, that’s all illusory. It’s actually just atoms and molecules. And it’s the laws of physics. You know, it’s a really deterministic view from physics. And this comes up in, in, in debates about free will, where people say, well, look, it’s all determined by the laws of physics. You’re just made of atoms.
Kevin M 01:07:03 The atoms are going to do what they’re going to do. What does you having a thought have to do with any of that? Nothing. It couldn’t possibly have any causal power, um, in the system. And I think that’s, uh, I think that’s completely wrong. It comes from a really impoverished view of causation, which is all basically bottom up and it ignores the causal, uh, potential of organization, which is a trivial commonplace sort of thing. Like we know that organization has, uh, you know, how some causal influence on the way that things happen, but people bizarrely seem to just reject that idea. And I can’t really understand why it seems to be so controversial.
Erik H 01:07:49 It’s actually quite funny. Um, because most of the time, the people who are the most reductionist are often not always, but often, um, you know, all their science in, in their particular science, its elements occupy some from very high up place in the city show, temporal hierarchy of physical objects, right? This is something that I’ve talked about a lot and have been to bring back as like a really big issue. You know, if you say science is about reduction, you have to explain the fact that there are very, there is a huge diversity of scientific fields, which all take various, um, high-level components as units of function and causation. And, uh, I’m not the, the by, by any means the first person to say, there’s probably, I think one of the best statements of this comes from the 1970s by a philosopher, Jerry Fodor, um, who wrote something called like the unity of the special sciences as a working hypothesis, but his, his whole, the whole paper.
Erik H 01:08:49 Um, and I think Jerry Frodo was probably one of the better analyte philosophers of the 20th century is basically just saying, listen, you can’t be a universal reductionist and still believe in science because science contains all sorts of things where people just sort of stop at some particular level of description, and then they like don’t want to reduce any further. And then his, his question is like, why don’t you want to reduce any further? And he doesn’t provide an answer to that, but he does point out that it’s, it’s a really big problem. You basically have to dismiss your own field and just say, well, if we could, we would. And that’s what I very much have been, trying to show is incorrect. And try to like prove is incorrect using simple, clear models because, um, you know, the moment you start talking even about physics in general, you’re talking about very complex systems that are difficult, but if you can show it in say salvia or automata, then you can be reasonably sure that it’s true, uh, you know, in the real physical world.
Erik H 01:09:48 So, you know, all my research has basically been looking at things like cellular automata or like small, simple, you know, Markov chains and simple systems like that. And then, um, asking questions about, say, you know, causation, when you move through different different levels or scales, and, you know, you find some very surprising and concrete effects, which is that two macro states by which I just mean summary dimension reduction in micro states can have a stronger dependency than their underlying micro states. I mean, it’s almost like so trivially true that it sounds absurd, but as it is very simple example, imagine I have 10 micro states and those 10 micro states all transition to one another, depending on what state you’re in. So it’s just a mark off Jane, just 10 states. And let’s say the first, you know, uh, three states, two, two of the states all are equally likely to go to each other.
Erik H 01:10:44 So a and B, if you’re in a, you could go to a, you could go to be equally likely 50, 50 chance, right? If you are in any of the other eight states, you are equally likely to go to one of those eight states. So you just bounce around, right? It’s like this. It’s like, if you’re in, if you’re in one of these eight states, you just bounce around between these two states, right? If you’re in these two, two states, you just bounce around. Okay, well, let’s think about some of the conditional dependencies, which was the traditional way to talk about causation in that system. And what you will quickly find is that the macro states of that system, if you just say these eight ladder eight states are macro state, you know, gamma, and the first two are macro state alpha or whatever, then you’ll quickly find that macro macro state alpha has a deterministic transition to itself.
Erik H 01:11:31 And the other macro state also has a deterministic transition to itself, even though the micro states are essentially choosing at almost random. So there there’s almost no like causal, the causal relationships of the micro states are immensely noisy, but the macro state relationships, while there are fewer macro states, they are deterministic. They’re not only deterministic they’re that you can retro Dick too. So now I have perfect prediction and perfect retrodiction, which in my research, this is called determinism and degeneracy. So you, you have, you have perfect determinism and zero degeneracy, and you had a lot of in determinism in your micro state model. And my argument is that, um, you know, if you’re, if you’re, uh, if you want to choose between your models of the system, both are equally valid descriptions of the system, but one of those actually contains two strong dependencies. And the other one contains just a bunch of totally weak, noisy dependencies.
Erik H 01:12:27 And according to various metrics of causation, they can be higher at this, uh, macro scale. And I think that a lot of the time, you know, it’s not just that what you want it, what you want to show to argue against like the universal reductionist position is not that somehow you can’t do this reduction. Of course you can, because what philosophers call super science holds. But if you do do the reduction, you lose something and quantifying that loss is what I’ve been been after. And we’ve, I’ve kind of proposed various measures by which one could do this. I happen to think that the latest one, which is just using the mutual information, which no one can argue with the mutual information, which is why I love it. You can’t get out, there’s no escape from the mutual information. If you show something into mutual information, you have to believe it.
Erik H 01:13:15 So know, just even showing in the mutual information that you can lose, you can break down into mutual information to three different types and you can lose different types of information. When you go down in scale, you can transfer from synergistic to redundant information by reduction. And so what this shows is that it’s not just about compression, right? It’s not just that, yes, everything should be all our models of the world should just be physical models, but of microphysics, but we just don’t have a big enough supercomputer. Like we’re not Laplas as demons. So we can’t do it. It’s like, no, Laplas demon has a provably bad low-information model of the world because he doesn’t have good dependencies. The world that he sees is just completely in deterministic. And it’s just, it, there’s no boundaries. And the causal relationships are, are, are poor and uninformative, and are all the information is redundant. It’s not synergistic or unique. And, you know, when you think about it like that, I think that you can a strong argument that you, that, uh, higher-level scales, you know, you, you can talk about it philosophically that they’re like ontologically real, but certainly I think just talking about in terms of method and when we’re, when one should or should not reduce is probably the best way to talk about it.
Kevin M 01:14:28 Yeah. Yeah. I mean, um, I agree, and, and I really appreciated your, your work on this because it, it, I think really clearly shows that, uh, it’s not the case that like, you know, someone like Sean Carroll, for example, the physicist talks about, um, you know, these, these other levels of description, higher levels of description as kind of convenient ways of talking about things. But the real truth is all down at the low level. And if we have the full picture of the low level, then we would have all the information that’s there. And the higher levels would emerge from in a very simplistic kind of sense would be completely determined by all that what’s happening at the lower levels. And of course, in an instant, uh, they’re instantiated in the low level organization, but that’s not where the explanation lies for how the system evolves.
Kevin M 01:15:20 And we have to have the right level at which to, um, to interrogate that and to understand it. And I think actually neuroscience these days is catching up with the idea that, uh, in any field of cells, for example, you’ll have some pattern of activity, but it’s got, you know, tons and tons of different possible micro states. And it actually is a trajectory through a sort of a low dimensional manifold. And depending on what the trajectory is, that’s what the meaning of that state is. And then what happens in the system is based on the configuration of the filter, the set of synaptic connections, for example, that that manifold goes through. And so it can be configured in such a way that if it’s manifold a, this happens and if it’s manifold B that happens. And all of the low-level information is just lost. It’s, it’s, it’s, it’s too noisy to begin with, but it’s actually actively filtered out by, um, by the nervous system.
Kevin M 01:16:19 So that’s what I mean, Paul, what I’m saying, the nervous system is, is running on meaning there it’s meaning it’s meaning that drives the mechanism and the meaning is inherent in the configuration of, um, of the, the, the circuitry. And it’s been put there, it’s been packed in there by evolution. So we have to think of it in and by experience. So we have to think of causation, not as this purely instantaneous sort of thing that just doesn’t capture why the system is the way it is. There can be some instantaneous trigger, but the structure of the system has causality packed into it. That is just often kind of ignored or seen as non non-scientific. It was almost banished by, you know, Francis bacon, who was just saying, well, look, we’ve got just the efficient cause. Uh, and the, the material cost, and we’re not going to talk about formal causes and, and final causes in our Aristotle’s, um, framing. And I think we’re still suffering from that, um, really narrow reductive, uh, both in, in space and level and time, uh, view of causation.
Erik H 01:17:33 That’s really interesting, Kevin. So, you know, just in terms of like this notion of meaning, um, you know, I’d be very interested in seeing some sort of, uh, you know, connection between, you know, cause meaning is kind of, you can think about it as like this very, very high level phenomenon, right? So it’s, it’s kind of like, almost like what happens if you dimensionally reduce enough. Right. Of course, you know, in a sense we are saying something a bit different, right. So, you know, you’re, you’re focused on this notion of, of meaning and the different sort of notions of, you know, causation, you know, like the classic Aristotelian. And I do think that that’s a really interesting way to talk about these issues. And, but I want to be clear. I don’t, I’m not, um, I don’t, I don’t know to what degree it will kind of fully like I have not actually studied it.
Erik H 01:18:25 Right. So, so I can’t speak to like the, the, the truth or falsity of it. Um, but I think it’s a very interesting approach, um, because I do agree that people take causation as this obvious primitive, like, and it’s not right. Like you have to specify what you mean. Right. And what you’re saying is like, well, okay, well, let’s be very serious about what you mean. Um, in your, in the example you gave of like the, uh, you know, someone like Sean Carroll, right? I mean, I think it’s when somebody says something like all the information is at the bottom, right. So that is directly provably wrong. So, and, but one has to be subtle when it has to be very subtle. So it’s, it’s provably wrong because the type of information that one is probably talking that someone’s probably talking about when they say that is something like the, like the coma girl of complexity or something where they’re like, yeah, like, listen, like the, you know, if you were to run a touring machine that was running the world and you ran it at the level of microphysics, it would, you know, the program that you need would be way longer than if you ran it at some higher level of scale.
Erik H 01:19:28 Right. And that’s like, obviously true and totally irrelevant to any discussion about the causal powers of higher level skills. What instead you have to look at is, you know, like a measure of causation or a measure of information, and you have to specify what measure you’re talking about. And, you know, like for example, in the, in the latest research that we did, we were using the mutual information, would, you can break down into redundant, unique or synergistic components. And what we showed is that yes, you can, you can have the same mutual information at the lowest level scale, and at a higher level scale, but at a higher level scale, that mutual information, all those bits are synergistic. And at the lowest level scale, all those bits are redundant. Okay. So choose between your two models, right? You can have a model where everything is just redundant bits, or you can have a model where all the interactions are synergistic and that synergistic effect disappears when you reduce it.
Erik H 01:20:27 So I want to be clear that as synergistic information disappears when you do that. So when you say, if somebody says all the information is at the bottom, it’s like, no, it’s literally not. And so I just think that this has been basically a massive confusion of people who weren’t like sitting around with simple models and just like specifying what they meant, and then w and also a good confusion of reduction with like universal reduction versus like taking things apart helps you understand what they do well, that is very, very obvious, right. But also not completely true, because we obviously always stop at a certain point and declare kind of victory or declare that we have a good sub field of science here with these kind of primitive atoms of function and so on. So I, I really think that I hate to talk about free will, because I do think that consciousness comes in and is the wild card in this discussion. But certainly I think one could even just say, just talking about neurons versus Adams, that there is zero is way stronger claim that your actions are caused by the macro states of your neurons, then by the underlying micro states of the atoms that make them up,
Kevin M 01:21:35 Which I think is totally true. Yeah. And I think a parallel way to argue that is, um, first of all, that I think physical indeterminacy is just not the case that there is real indeterminacy in the university. That’s a whole, whole other discussion and it, uh, physics hasn’t agreed on it. Um, but I think it’s, it’s right to say that the low level details of any neural state or the state of all the atoms inside a sickle cell by themselves, don’t fully determine the next state. And, and, uh, so you’ve got some neural state, it doesn’t determine the next state and you also have this multiple realizability and that many, many different micro states can mean the same thing at a macro at a macro level, which is where that, um, causation comes in. So if the, if the low-level details, don’t determine the next outcome of the whole brain, then, you know, you can ask, well, what does settle the outcome and what I would argue and many others is that it’s, it’s the meaning in the macro states. That is what drives the, the system. And that’s where, um, and that’s where I think, you know, agency and ultimately what we refer to in humans as free will, um, can be found because the there’s some causal slack in the system, it’s not just reductive the high level things, drive it. And that’s basically what we mean when we say we’re deciding things, is that we’re doing them for our reasons. I was
Paul M 01:23:05 Going to ask a naive question. And this is about from, from both perspectives, I think from both of your work, what role. So, so Eric, in, in your work, and again, this is naive, but when you make a macro state out of micro you’re, you’re making a move, but mathematically there there’s no cost to making that move. You just state it. And it happens, but in a physical world, in the real world too, to create a macro state, there might be physical Thermo dynamical penalty cost, right. To actually instantiating that in a physical world. And I’m, and this gets back to, um, and I don’t know if we need to talk about this more, but the idea of constraints and boundaries and just environment and the impact that the whatever system there is, the, the, the interaction with the environment and how that relates to, to the information and, uh, that, that you can glean from the micro and macro states and the emergence, whether emergence necessarily needs to take in, um, considerations from, from its environment.
Erik H 01:24:09 Yeah. So just to clear up a confusion, there’s definitely no cost to like creating a macro state. I mean, like, as a very simple example, you know, when we talk about colors, right. Uh, obviously if I say, you know, my wall is a certain color, what I’m saying is basically that there’s some sort of macro state where, and if you kind of averaged together, I’ll like the colors of my wallet it’ll end up being this. I don’t really mean that every single, you know, like, like the, the, the finer and finer, you zoom in that that color is just completely consistently maintained, right. That would be the description of the micro states of all the colors. And then you could go even further and further, right. Uh, of all the states. So it’s just describing something at a particular level. And just to differentiate, maybe just to try to differentiate Kevin and Maya’s position a little bit, cause it sounds like we agree on so much, um, would be, you know, on, um, this, this notion of, uh, you know, for me, the notion of meaning does not yet have to come into play for many of these phenomenons.
Erik H 01:25:12 Now, maybe it does come into play with something like a nervous system. As I said, I’m like open to this kind of interesting notion of like macro state, somehow gaining meaning. But just, if you look at like the macro state descriptions of a very simple system, they can be completely deterministic and therefore kind of constrained the past and the future to a greater degree than any of their underlying micro states. And it’s not a contradiction. So this is, this is a completely non contradictory thing to say. And I’ll give you a very simple example, which is, let’s assume that the macro state we’re talking about is your behavior. But again, this could be a very simple macro state. I’m just using this as an example, you know, I can predict what physiological macro state you’re going to be in, in about 12 hours, right. You’re going to be asleep.
Erik H 01:26:02 So, you know, my, my, my, my, my guess off of your current macro state, which is like, you know, you’re awake and it’s this time, and you’re feeling like this, my current guess is that I’m going to predict with, like, let’s say a 90% probability that you’re going to be asleep and that’s going to be the macro state that you’re going to be in. Now, my, now you compare that to like little plazas demon, right. And you’re gonna say, okay, Laplas bless his demon. Why don’t you make your prediction now about what their future state’s going to be. But here’s the thing I’m going to restrict you to talking about it in the language of microphysics, because that’s, what’s supposed to be so special about you, the pasta demon. So you gotta make this bet in terms of microphysics and the boss’s demon takes in your entire micro physical state.
Erik H 01:26:41 Right. And then I say, okay, which micro physical state are they going to be in, in 12 hours? Right. And Lovaza demon says, well, listen, I’m going to give you a really big list of possible micro physical states, all with vanishingly, small transition probabilities. So I’m going to say, listen, you’ve got a one in a billion chance to be in this micro state, one in a million chance to be in this micro state and so on. Why? Because you’re getting hit by solar flare, you fly solar rays and like other, you, you’re an open system. It’s just impossible. So the buses, Stephen makes this big list and you say, well, listen, the applause, this demon like the dependencies between the current state and this huge list of possible state, the dependency here is vanishingly small, right? You’re just saying like, you’re, you’re, you’re basically not bear.
Erik H 01:27:22 You’re only, you’re not even probabilistically sufficient, and you’re definitely not necessary for any of these states and so on. But my macro scale description suddenly I was able to get a really nice deterministic causal relationship. And as Kevin said, the, the world, and particularly at the micro physical level for open systems, even for getting physics is itself deterministic. If you take the full state of the universe, but we’re all open systems and you’re incredibly noisy. So, you know, you really are gaining something by talking about it in terms of macro states. And I think that that’s probably something that scientists are implicitly cuing in on when they find a nice field of study, because it’s like, oh, look, I can intervene on things here. And I get nice kind of deterministic responses. And, you know, my, my theory is basically that what you want to do is you want to maximize the determined to see, well, also maximizing this, the size of the model that you have. So you want to find that sweet spot where you’re as deterministic your, your, like your interventions to effects are that the conditional dependencies are as deterministic as they can. And you haven’t dimensionally reduced too much, you know? Cause you could just dimensionally reduce everything into one big macro state and declare victory. Right? So
Kevin M 01:28:34 Yeah, the interesting thing I think is that that’s what the nervous system is doing and it has to, because all those components are really noisy. Um, and neurons are just not great information and processors in isolation. And of course you go from, you know, you go from analog signals to digital and back to analog and, and you’re, you’re filtering all kinds of information and doing it and doing it really actively, you know, every time you go from one setup to the next that that neurons doing it’s may, you know, you’re performing some operations, um, on that, on that information either at a single synopsis or collectively from one area to the next. So, I mean, in a, in a sense there’s a cost to that, uh, in that that’s the activity, the work that the nervous system is doing, but on the other hand, it’s far less work to do that than to try to transmit all the individual bits of information. In fact, it’s pointless to, to just keep transmitting the same information along a chain without, without operating on it or extracting any, as I would say, meaning from it,
Paul M 01:29:38 I was worried this was going to happen. I have about 400 more questions to ask you guys, but, uh, the, I guess my questions are micro states and we’ll have to, we’ll have to, let me, let me ask one more question here. And I don’t know, um, if you guys will, will differ on this and then we can wrap up, um, so the question is, do we need to understand life to build intelligence? Um, and under, in other words is building artificial life, essentially a precursor to building artificial, a necessary precursor to building artificial intelligence. And my gut tells me Kevin, your work with understanding agents to try and understand how agency evolved would suggest that you do think that intelligence, presupposes, essentially life processes, homeostatic processes, and Eric, and I don’t know where you land, but maybe who knows if you guys will disagree or agree, but that’s the, that’s the question.
Kevin M 01:30:34 Okay, well maybe I’ll jump in there. So it’s really, really interesting. And I think in a sense, it depends on what you mean by intelligence. And there’s a been a tendency, especially in AI, you know, to think of intelligence in terms of things like playing chess and, you know, sort of logical, really cerebral, um, operations. Um, when, you know, for most things on the planet, intelligence means behaving in a way that keeps you alive. You know, I think intelligent behavior is, is things that keep the organism alive. So if you think of it in that sense, um, you know, it’s, it’s goal directed behavior. Um, and of course you can do information processing and cognition that underpins it. But my own feeling is that if we want to get to something that we would say has a kind of autonomous intelligence, then we do need to give it agency really. I know we need to, we need to make it a, um, a living autonomous thing that it has some sort of causal insulation from the rest of the world. And, um, isn’t just being, you know, it’s not just a stimulus response kind of machine, uh, or something that’s doing information processing in isolation from any, from any real-world goals. I think we need to give it a to care. Uh, and the easiest way to do that is to make it care about itself because that’s what life does. What do you think, Eric?
Erik H 01:32:09 Yes. I mean, I, again, pinching greatly on the definition of intelligence, right? So I think to get the sort of a gentle, uh, behavior that the average person would say, oh, this, this AI is intelligent or something like that. Uh, w most people wouldn’t even say that about Siri, right? Uh, like, like why wouldn’t they, right. Siri actually seems to know quite a bit. Um, they’d be like, well, Syria is no, like animus, like Siri just sits there and gets queries and spits back answers, you know? And it’s, it’s really not what we think of when we, when we think about intelligence, but I would say I, I’m also a little bit, maybe just to, to finally bring this all in full circle, um, you know, the sort of techniques that people use to build these artificial intelligences and so on. Look to me a lot more like, like cheats than the way that biology does it, you know, just like you’re, you’re, you’re what you’re literally doing is you’re just rewiring the system until you get the answer that you want.
Erik H 01:33:10 Right. And then you do that over and over and over and over again. And that’s what backpropagation is. And you know, it, it would be like if I, if you were taking a test and, uh, you know, you got, you got certain number of answers wrong, and then your teacher rewired your brain such that you would have gotten those answers correctly on this multiple choice question. And then they give you another test and you’re performing better on it. But what did you learn? Like, you didn’t learn anything, they just rewired your brain. Uh, you didn’t have the experience of learning. You didn’t, you don’t even feel like you’ve learned, right? Like, you’re, you’re, you’re just getting better at these questions. So I wonder if sometimes we are, uh, if we, we, might’ve just discovered like very different ways to do things and that the concerns of biology, which might include things like metabolic efficiency and so on, just completely ignored all these sorts of solutions, because they’re like, they’re not practical if you don’t have good training and testing data, and they’re not practical, if you can’t do post-hoc regularization and they’re not practical, if you can’t do blah, blah, blah.
Erik H 01:34:07 Right. So I wonder if, you know, again, maybe what you really want for intelligence is something that’s just conscious. And once it’s conscious, it’ll kind of look and act like us and, uh, or not look like us obviously, but it’ll act like us. And, uh, you know, it just requires a total reframing, but, well,
Kevin M 01:34:24 Let’s see. I think actually, just to, just to pick up one thing there on the energy efficiency thing, I think if anything is going to drive a move in AI towards a more biologically inspired, um, framing, I think it’s that it’s power consumption is going to be the limit of deep learning and, and, and the, you know, those kinds of, um, those kinds of methods. And there’s going to have to be a rethink of however, the hell it is that that brains managed to do this on, you know, whatever it’s 20 Watts or whatever, you know, something like that. So, um, I do think that there may be a radical rethink, um, which brings us closer to biological intelligence by virtue of having to be inspired by that biological design.
Erik H 01:35:11 I, I certainly hope so because, you know, the fact that something like GPT three can spit out a poem, and I don’t think that it has consciousness or mind. I, I wouldn’t say it has any of those things, uh, is, is, is a horror to me. So like, as a writer, like, I literally think it’s hard. Um, and, uh, if you think about it enough, I think it becomes a horror. And, and so, you know, I, I, I I’d love for it to actually be conscious because then at least, you know, I’m competing against, you know, an actual agent rather than just this like weird statistical summation game, uh, that is totally mindless and yet can like, you know, put out good Shakespeare poetry.
Paul M 01:35:51 So, Eric, uh, I mean, that, that’s a good note to end on because I don’t think GP T3 actually has your vocabulary reading, reading the revelations, like the, uh, just the, the, the descriptions. I mean, a lot of it is borderline poetry, uh, the way that you narrate and describe what’s happening. I mean, it’s really like just a pleasure to read so much of what you wrote in the book. So congratulations again, on the novel, Kevin, I can’t say that you write, uh, poetically in an eight. Maybe you are going to include some poetry is, is the new book about agency?
Kevin M 01:36:24 The book is about, is about agency and I can’t wait, ultimately freewill, and I don’t think there’s going to be too much poetry in it, not for me anyway,
Paul M 01:36:31 But anyway, it’s very enjoyable on my normal reading level, which is the nonfiction. And so I, I greatly, uh, just enjoy both of your works and research. Keep it up, guys. I really appreciate you being with me. Thanks. Thanks very much.
Erik H 01:36:42 Thank you so much, Paul. It’s been, it’s been awesome catching up in, in somewhat in person, Kevin. Likewise.
Kevin M 01:36:47 Thanks a lot.
Paul M 01:36:54 Brain inspired is a production of me and you. I don’t do advertisements. You can support the show through Patrion for a trifling amount and get access to the full versions of all the episodes. Plus bonus episodes that focus more on the cultural side, but still have science go to brain inspired.co and find the red Patrion button there to get in touch with me, [email protected]. The music you hear is by the new year. Find [email protected]. Thank you for your support. See you next time.
Check out my free video series about what's missing in AI and Neuroscience Support the show to get full episodes and join the Discord...
Michael and I discuss the philosophy and a bit of history of mental representation including the computational theory of mind and the language of...
Support the show to get full episodes and join the Discord community. Check out my free video series about what's missing in AI and...