Transcripts For CSPAN2 The Knowledge Illusion 20170806 : vim

Thank you very much. Were delighted to have you at this event, the office at mit series. Tonight were featuring steven sloman, a cognitive scientist who studies how people think. Hes been a close friend of mine for many years and also the editor of the journal cognition. And hes joined in conversation today with drazem, professor of economics at mits sloan school. He also holds an appointment in the department of brain and cognitive sciences. Before we begin, i ask that you please silence your phone if you havent already. I should also introduce myself. Im the director of the mit press, my name is amy brand. Its a pleasure to welcome you. We just started doing this series of events at the mit bookstore, and theyve been incredibly successful. We do events about every two weeks, so next one coming up is on a may 23rd, the book dream chasers immigration and the american backlash. So tonights event will last for approximately, you know, 4550 minutes before les a book signing, so well start off talking about the book, then drazen will have questions for him, and then well have a conversation with the audience before the book signing. I think i covered everything i was supposed to say. And after the presentation with the signing, books will be available more a 20 discount. Maybe ill buy one. [laughter] okay. I dont think i need this mic. Do i need this mic . No, you dont. Drazen needs it. Thank you so much, amy. Thank you all for coming out. Let me start by telling you a little anecdote from the book. So in the 40s, atomic physicists were still trying to perfect the atomic bomb. And eight of them, eight atomic physicists these are people who know atomic physics better than anybody they were developing the bomb. So eight of them coalesced in this room in order to run this experiment. And its an experiment that the famous physicist Richard Feinman calls tickling the dragons tail. And it involved taking two hemispheres of beryllium that had plutonium cores and bringing them closer and closer together, and hen neutrons would and then neutrons would start shuffling back and forth between the hemispheres, and it was really dangerous because you could have a lot of radioactivity. So the main physicist running this experiment, a guy named louie, was keeping these hemispheres beryllium separated by a flathead screwdriver. So what happened . The screwdriver slipped, the hemispheres came together, radiation filled the room, and louie was dead within nine days. And the other physicists were, they died young probably from the effects of this railed yo activity railed yo activity. So the question, and the question potioned by the book, is how can such smart people be so stupid . So the first claim made by the book is that people are relatively ignorant. And thats a fact in the sense that, you know, 25 of americans dont know that the earth revolves around the sun, and 50 dont know that penicillin kills bacteria and not viruses. Theres just radio, talk show hosts make fun of this fact all the time. Many people cant name the Vice President of the united states. But the real point of the book is that people think they understand things better than they do, right . So the main form of evidence for this originated by, in the lab of a great psychologist named frank kyle at yale, and what he did was ask people to think about simple, everyday objects like zippers, ballpoint pens, toilets. And he asked people how well they understood these things, and people felt they had a sense of understanding, right . On a sevenpoint scale, they would say four or five. And then hed say, okay, how do they work . What people discovered, for the most part, they had nothing to say. So when he again asked them how well they understand them, the ratings were lower. The act of trying to explain punctured their illusion of understanding such that they lost some of their hubris. And what ive done with some colleagues, todd rogers at harvard and craig fox at ucla and my coauthor, phil fernback, is to take this paradime and run anytime the context of political policy. So we take political policies like should there be unilateral sanctions on iran, cap and trade policy toes or carbon emissions, and we ask people how well they understand them, and then we say how well does it work . Sorry, we say how does it work, right . Explain how this thing works. And people just dont know. And so when we again ask them what their sense of understanding is, its lower. We puncture their illusion. Not only do we puncture their illusion of understanding, but we also puncture their confidence, their confidence in their attitude. They become less extreme. We reduce polarization in the group simply by asking for an explanation. So this is something that probably is true for only certain kinds of political issues; namely, those that rest on a consequentialist foundation. Those its the causal mechanism that really counts, right . Like, for a cap and trade policy what really matters is how it affects peoples willingness to put carbon in the area. There are other issues like abortion or assisted suicide which really arent about the consequences so much as basic values. And i dont think and, in fact, we have some data suggesting the same thing would not happen for those kinds of issues. So the next thing we do in the book is try to explain why this is the case, why is it that people live in this illusion of understanding or what kyle calls an illusion of explanatory depth. And the answer we offer is that its because we confuse what we know with what other people know. So there are other people who know how ballpoint pens work and, therefore, we think we do. There are other people who know how cap and trade policies work and, therefore, we think we do. We fail to distinguish the knowledge thats in our head from the knowledge thats in other peoples head. In other words, the claim is we live in a community of knowledge, right . And so were built, thought itself is a kind of collaborative process. Its a process which involves a team and does not solely go on inside the skull. So let me quickly describe an experiment that i ran with an undergrad at brown which tries to make this point directly. We told people about a scientific phenomenon, something we made up. So, for instance, we told them about a system of helium rain, which my real scientific friends tet tell me is not actually possible. We had made it up, and we said scientists discovered this thing. They havent explained it yet, they dont understand how it works, but theyve discovered it. How well do you understand how it works . [laughter] and not surprisingly, people said i dont understand at all on a 17 scale, they chose 1, essentially. Another group, same thing, scientists have discovered this system of helium rain, they understand how it works. They fully explained it. How well do you understand how it works . And now people say 2, right . So its not like they feel they fully understand helium rain, but theres a little bump in understanding thats attributable to the fact that other people understand. They themselves give them no information about it, right . All we said is other people understand, and now they understand. So think of this in the context of, say, to pick a random example, the last election, right . Imagine everyone around you thinks they understand why hillary is crooked, or, you know, lets be fair, maybe everyone around you with thinks they understand why diversity is effective, right . Merely the fact that everybody else understands if understanding is contagious in the way were suggesting is going to give you a sense of understanding. And if everybodys sense of understanding is a result of everybody else, everybody around hem having a sense of understanding, then we can have a lot of confidence and belief based on nothing, right . Confidence thats essentially a house of cards. So finally, the last thing we do in the book is draw out the implications for a number of things, science, literacy, our understanding of intelligence, Decision Making, technology and something, one or two other things that im not remembering at the moment. And thats what the books about. Very good. Thank you, steven. So i just want to say as a reader of the book and as someone who has worked on some related things, i really found much that was new and led me to think about different problems and some familiar things in a difference way. In a different way. Now, if you are not in this area, this is a great fun to realize as well. Thank you. Now, since maybe we can put you on the couch here as an author of the book. I think its always interesting to, especially when someone writes a book that builds on Scientific Research that goes through the editorial process and so on s to think about the deeper motivations for it. [laughter] so im going to start with one innocent question then have a followup question also. But the innocent question is do you is there a reformist impulse in the sense that that the knowledge illusion is a bad thing, or are you not because its not so obvious that it is a bad thing. One could say that the knowledge illusion shows that we are a communetarian species and we rely on others, and if you strip that away, well become locked to our own individual selves. So is it a bad thing that there is a knowledge illusion . Thank god that was the question, because i was sure you were going to ask me about my childhood. [laughter] no. I think youre absolutely right. For the most part, when it comes to ballpoint pens and toilets and zippers, its not a bad thing at all theres this illusion. And, in fact, in many other domains of life, in our spiritual lives, for instance, this is no problem with the fact theres no problem with the fact that we think together, that we think as a team, we think collaboratively. Indeed, its a great way to solve problems. In fact, it sort of relieves us of a kind of burden, right . We dont have to understand everything. If we accept this fact about ourselves, our own ignorance, then life is easier. Theres less pressure on us. In fact, we got an email from this one guy who said that he had suffered his whole life with some kind of mental disorder. He didnt elaborate what it was, and that it was such a relief for him to learn that it was okay to be ignorant, that everybodys ignorant. So in that regard, i agree completely. I just think that there are certain domains in which there are ill effects. And, you know, i think populism in politics is something that can cause a lot of damage. Im worried about the state of the world right now. And i think it has something to do with the fact that were living with this set of beliefs, this ideology that doesnt really have a firm ground. You know, there are other ill effects too. I think that that teams could probably work Better Together if the individuals and the teams had more respect for the point of view of others. So both on the large scale and the small, you know, i do think there are prescriptions that could be derive from these insights. But overall, i agree with you completely. Theres nothing. Theres not a problem, theres not an inherent problem with it. So i have a related question, and has to do with the general topic of collected knowledge which has been in the popular imagination and in scientific imagination the last, i would say, 10, 15 years. And my question is motivate by is there a particular political preference,. And ill raise it with an example thats not in your book, but with a discussion of crowd wisdom and Prediction Markets. It turns out that Prediction Markets are partly a new instrument for aggregating information, but also much of the interest there at least knowing the individuals who are pushing this comes from a kind of libertarian, antielitist agenda where you dont want to trust credentials experts, you want everybody many a democratic way to contribute and influence the outcome. Now, in your book it seems that one of the themes is that we claim too much knowledge on our own part. And that our contribution is smaller than we think. And you mentioned the case of scientific and artistic achievements where people dont realize how much they stand on the shoulders of giants. So that seems to have a perspective that its not libertarian, its rather communetarian or that we should understand to what extent were really a very small part of the whole s. That a motive or a theme in the backgroundsome. Its certainly a theme, and its not in the background, its in the foreground. Its not a motive, its a fact. [laughter] so, yes. No, thats definitely an implication of the book, and its an implication i would be willing to defend. In the domain of Prediction Markets, i actually didnt i mean, im certainly aware of Prediction Markets. We talk about them a little bit in the book. I wasnt aware that they came out of a libertarian perspective. It seems to me that much of the value of Prediction Markets is that theyre a means of sussing out the expertise in a community, right . That is, the people who are willing to pay the most, to risk the most on their prediction presumably, should be, the people who know the most and have the most knowledge to to bring to bear will have the most accurate predictions. And ive always thought thats the reasons Prediction Markets are successful. Its actually kind of surprising, because theres other evidence showing that the people who are most confident actually often know the least, not the most. So David Dunning has done a lot of work showing this simply, you know, asking people what their views are on various issues and then measuring their knowledge about the background for those issues and finding the people who do the worst on his general knowledge tests are the ones who are most confident about their opinions on the issue. There was this great experiment we mention in the book in which a bunch of researchers asked a group to locate the ukraine on a map. And most people were way off. Some people got it pretty close. They also asked these people how confident they were that the u. S. Should intervene in the war on crimea, unite right . The people who were most off many locating ukraine on the map were the ones that were most confident that the u. S. Should be in crimea. M. [laughter] i mean, thats an example of the converse, right . How knowledge actually leads to lack of confidence, the sort of lack of hubris. But in the case of Prediction Markets, ive always assumed it was true expertise that the Prediction Market was picking out. The, im just keeping track of the time. No, i was thinking that you get the idea in Prediction Markets is you would not need a ph. D. Or credentials or an m. D. , actually, the vote on what should be done with a patient and so on. I dont want to take maybe just one more quick question, which goes more to the research. Could you, its known, for example, that people confuse hair their own confidence with how much they think some information is generally shared. But you have results that it really matters whether you believe someone else knows something, that that is somehow sucked into a sense that you know it as well. But it also has to be accessing, is that right . The knowledge. Right. It cant be seal. So in this contagious understanding experiment, the helium rain that i described earlier, we had a condition in which the researchers worked more darpa, for the Defense Intelligence agency. And in one condition, they understood the phenomenon, but it was secret. So people had no access to it, right . And the question was would knowing the knowledge was out there but also knowing that you, the judge, had no access to that knowledge, would that also increase your sense of understanding. And the answer is it didnt, right . So knowing that others or believing that others understand something increases your sense of understanding but only if you can access that knowledge. And, in fact, it doesnt even have to be other people. It can be machines, right . So if youve theres evidence be youve been searching google for answers to questions, then you feel like youre a better question answerer. So i think we should give the audience a chance now to ask questions. Good. Yeah. Sure. You actually do need the mic because theyre taping. Id like to know, youre kind of like promoting your book, so im wondering why i should buy your book. In other words, what am i going to benefit from reading your book . Because you told me certain things, but i already knew them. So what [laughter] im being serious. Well, if you already knew them, then dont buy the book. [laughter] you already know what we have to offer. I dont know what to say. For another person that didnt know do you hope well, i thought, so there are two lessons, two main lessons. There are lots of lessons, but there are two main lessons that i think the book draws. One is most people have an inflated sense of their own understanding. No one in this room, im sure, but outside this room. And second, that the reason for this is because we should think about thought as a communal enterprise, not something thats going on inside the head. Now many, im glad you already know that, and its true that its not a completely novelling idea by any means novel idea by any means. But its also antithetical to what a lot of scientists assume, right . So im a cognitive scientist, and i can tell you that cognitive scientists, for the most part, assume that thought does go on inside the head, and thats a what we study, and thats how we talk about it. [inaudible conversations] hi. Im going to be the annoying person who asks what it mean toss say that we understand things. All right, everybody in this room probably agrees that there are, you know, dna is made up of four bases, double helix, that there are 46 chromosomes for humans and so on. Probably almost nobody in this room has actually replicated the experiments that cause us to know these things. Is what does it mean to say we know them rather than we just have this illusion that we know it . So it seems like youre reiterating my point, right . That we feel, we feel we understand these things and, actually, be we took a poll if we took a poll, my guess is fewer people in this room know those things than you think [inaudible] well, okay, so maybe im wrong. But even mit can be surprising. [inaudible] havent replicated other experiments. No, so exactly. So the point of one point of communal knowledge is that we depend on work done by others, right . That most of the thingses we do as lay people and as scientists depend entirely on knowledge that sits in other peoples heads. And that seems to be the point youre making, and thats exactly the point to have book, right . So most of the methodologies that we use are methodologies that have been, you know, developed and demonstrated effective elsewhere. Right, we dont replicate them. If i use someone elses theorum, rarely do i go out and reprove the theorum. I depend on what other people know. So, yeah, i couldnt agree more. As far as defining knowledge, thats a separate eshoo that a maybe we can issue that maybe we can talk about later. More questions. Hi. Hi. [laughter] so i have, i was thinking about what you were saying, and i was wondering do you have any thoughts as to the fact that different groups of people may have different sort of assumed knowledge from each other other . So im thinking about people, for instance, in academia and how you might get different fields, and people may be sort of siloed. And they may even if theyre approaching a similar problem, may, you know, approach it in a different became im thinking of this book that i read recently could inventology where the author talked about some really interesting inventers. And among other things, she talks about how people, some of people who come up with really Good Solutions to the things may come from a totally different background and maybe a different Knowledge Base from, you know, people who sort of traditionally, you know, from from people in fields that traditionally solve the problems. So i guess im just thinking, you know, how if you have any thoughts as to how we might sort of leverage this ability that we have to think collaboratively but also to avoid some of the pitfalls that that can, you know, produce. So i think what youre pointing out so eloquently is that there is a division of cognitive labor that we all are experts many only one or two very narrow areas, and that to accomplish anything we need expertise thats distributed across the range of possible fields. You know, look, i think society is structured to a large degree in accordance with what im talking about, in accordance with the fact that theres a community of knowledge that exists because we each have our own narrow area of expertise, and to accomplish anything of substance in fact, the accomplish most things of little substance we have to divide up cognitive labor, right . To build a ballpoint opinion, you need someone whos a material scientist, and you need someone who knows about fluid dynamics. What youre pointing out is society has taken that into account, and the reason were able to build iphones and send people to the moon and have wonderful bookstores is precisely because we take advantage of that distribution of expertise. So in a sense, were already doing it for the most part. You also asked what lessons there are about how we can do this better. And, you know, the little bit i would say about that is we could have a little less hubris about our expertise in areas beyond our own narrow field, right . We should better appreciate exactly a what youre saying, that other people do all kinds of useful things and have all kinds of useful knowledge that we dont have direct access to. That the diversity of perspective is the a good thing. So my question is. [inaudible] do you hear me . Oh, yeah. Now. So i think about this knowledge as a bubble, that its this booking is a basically breaking a bubble for me, its an awareness that its there. And lets say im a leader and i have a team, and i want them to understand this or be aware of this. I want you to tell me or give me a suggestion of how can i tell them this is important to take very big decisions, you know . As you say, there are things that we need to know that this is important, but there are others that people should know in a team that this is there, and maybe we should read more or should buy my book. [laughter] you know, im not going to give them a test and is tell them, hey, you know less than you think you know. How can i converse this to a team in a way that doesnt need to read your book or give them a test . Yeah. No, thats a great question. And the truth is im not going to offer a satisfying answer. I dont think anybody has a satisfying answer to offer. The one thing i will say is that getting people to focus on mechanism can be reality enlightening, right . So the primary experiment of the paper, the one many which we demonstrate the illusion of explanetary depth, or which frank kyle demonstrated the illusion, simply works by asking people to explain. I think the best way to persuade someone is to have them persuade themselves. And the way to do that in this case is to ask people for an account. Now, youre right, that can be kind of threatening. And, indeed, we have weve run experiments where we burst peoples illusion of understanding by asking them to explain, and then we see if now they want to learn more. Have we reduced their hubris and now theyll be open to new information. And the answer is, no. Ing right . Once you make people feel ignorant, they really dont want to talk to you anymore. [laughter] so the its a fine line, right, between getting people to see what they cant do on one hand and stroking them on the other. And thats an art. I have actually two questions that are related. On the one hand, i would like to know whether you have anything to contribute to understanding why fake news currently are so successfully spreading. I mean, you need to have trust in what you, on what you believe or what you not believe and apparently there are many people believing these news. And on the other hand, i would like to know whether you think that the phenomenon that you describe is changing, whether i mean, there are many people, there is a general perception that there is polarization, Political Polarization in the country, and does this core respond with an increase correspond with an increase in confidence in your opinions, and does it increase with ignorance in some way . So the basic idea that we live in a community of knowledge and that the mind is built for collaboration i take to be basic facts about humanity that have been true since, you know, the beginning of time, since we were punt hunters and gatherers. Whats changing, obviously, is our modes of interaction. And it seems to me that america, especially america hasnt faced the dynamics that its facing now. You know, the answer im going to give you is kind of selfevident, i think. Because of the internet, and the internet has changed everything, right . And its not only that we now live in these much, in these bubbles that have firmer walls because were cut off from the people who live next door who might have a different political perspective and instead are reaching out to people in serbia or bosnia who have the same political perspective. And that in turn is made worse by the fact that much of our news is individualized, were seeing only what we want to see, facebook and google, delivered to us, what we want to see which tends to be stuff we already agree with, right . So our bubbles are getting firmer and firmer for that reason. But at the same time, the old style leadership is disappearing. So, you know, we know people dont go to church as much. And so they dont hear this common voice that delivers the same perspective on the news regardless of the members political persuasion, right . And there have been a lot of people who have analyzed changes in demographics suggesting that intellectuals are moving more to the city and so theres less intellectual leadership outside the city, and as a result, people are appealing more to their bubbles in order to get their perspectives both validated and to just acquire them in the first place. You know, one way to characterize the point to have book is that the point of the book is rather than thinking of people as rational processers of information, we should think about people as channeling their communities. So what this implies about fake news is both, i mean, theres good news and theres bad news about fake news. The bad news is that it ises the mean it is the means by which people acquire their beliefs, the a large degree. If we just channel our community and our community is telling us all this stuff thats not true, its going to make a big difference to what we believe. The good news is that im not sure it matters so much, righting . In the sense that whether the news is real or fake, people are going to believe what their Community Tells them to believe anyway. And so its not obvious to me that fake news is having a huge effect on the distribution of belief in society. Yeah, so theres a lot to be said about that. So you seem very oriented toward with thinking about how American Adults think about things, so i want to ask you about two different populations; nonamericans and nonadults, particularly people from very different cultures. Do you really think bush men in the kalahari would show this . Do you think little children would show similar illusions . Great question, and the data arent in and, you know, ill follow the data. I have no reason to think that they wouldnt. I mean, i certainly have no reason to think that bush men in the kalahari live, you know, more inside their own individual minds than anybody else, right . I assume theyre also collaborators, theyre also team players, and that, i think, is the source of the illusion. So my prediction would be they would, indeed, show the illusion. Kids too. Its harolder the show with its harder to show with those populations, and thats important work to be done. I would like to ask you about reasoning, and in particular the difference between individual and group reasoning. A recent theory of reasoning by [inaudible] suggests that reasonings something that developed evolutionaryily [inaudible] and one of the predictions of that theory is that group or reasoning should therefore be somehow more powerful or more effective in finding the truth or some kind of optimal solution to a problem. But on the other hand, there are other findings from psychology that suggest that when people try to persuade each other, there are [inaudible] for example, the backfire effect. You try to to convince someone, and you end up mobilizing their cognitive question maatta which leaves them with [inaudible] so what would be your call . Is group reasoning somehow more powerful than individual reasoning . So i havent yet read the book youre referring to, although its on my bedside table. Clearly, ive got to answer yes to your final question. I think that its got to be more powerful because that is the nature of reasoning. And i think thinking about what goes on inside the head as a conversation with somebody else, right, is probably the best way to think about that form of deliberation. So i should say im a twosystem theorist, right . And i do believe that we have strong intuitions that we can think of as forms of reasoniing right . So we will see patterns and make predictions about the future and explain things by, essentially, a sophisticated pattern completion process that is intuitive in the intense that we in the sense that we see what the outcome is although we dont see the process that delivers that outcome. And i would distinguish that from deliberation or deliberative reasoning, right . And i love this word deliberation precisely because it plays on two different senses of deliberation. So on one hand deliberation you can think of as a cognitive process, right in the process of thought, the sequential process that goes on inside the head. But deliberation is also something that happens between people, right . Juries deliberate to come to a conclusion. And, you know, we do that, but i agree with mercier and spurber that we do that more effectively at a group level. The other assumption of their argument, that the mind evolved the argue, i have more trouble with, right . I think the minds evolved to do all kinds of things. I think that storytelling is at least if not more important than argumentation. Right . So there are all kinds of formal systems that we learn culturally, that we pass and discuss and develop culturally. But im not sure that thinking about reasoning as a process of argumentation is, in the end, going to lead us in the best direction. I just wanted to ask a question because i think it follows up on this. It to occurred to me that theres some similarity to your example which is show me how a zipper works with the socratic method which is an old trick of asking a person questions and showing them that they dont really understand what they mean when theyre using some terms. Thats what comment, i dont know if you want to comment on that. The other is more a question of rhetoric, that a standard device in persuasion is to to show the other person that you can recreate their argument, you can recapitulate their reasons and then disagree. Does the that have any connection with this . So if if you want to put me in the same camp as socrates, im perfectly happy with that. Again, i dont want to say theres anything fundamentally new here, right . I mean, a lot of these ideas have a long history. You know, when kyle originally did this work on the illusion of explanatory depth, he showed that people suffer from the illusion with regard to their understanding about how things work, right . Mechanism, causal model. But they dont show it with respect to narratives or scripts or, you know, facts like state capitals. So its a very specific kind of illusion, or it was in his hands. But the one domain in this which his student showed it also obtained is in logical justification. So people do apparently have the seasons that they can justify their beliefs to a greater extent than they can. [inaudible conversations] i think matt has a question. [inaudible conversations] there we go. So how do people know what competence youre asking about when you understand helium rain . If my uncle says, do you understand helium rain, i could maybe muddle through it. But if a student of mine asks do you understand helium rain, no go. I wont go there. And if my broker asks do you understand helium rain, its a different comment. So when you its just an experimental question. When you ask these questions, what do you think these people are thinking . So when we run the experiment, we give a details we give a whole sheet of instructions on what we mean by understanding, right . So we provide the scale and we say one means youre completely unfamiliar with it and seven means youre the worlds expert and you could answer all possible questions. And so we do try to define understanding. I take your point to be that in an experimental context, people can understand what youre saying in lots of ways, and the word understanding is vague k and they could understand it, you know, to mean many different things. And thats true. I dont think that actually affects our conclusion, right . So in this, under contagious understanding experiment what we show is simply saying other people understand causes people to put a higher number down on the scale. So what exactly does that number mean . I dont know exactly. Your point is well taken. But i can tell you this, its higher than the number that the people put down when the scientists dont understand. Right . So whatever understanding means, when other people have it, people have a greater sense of it. Again, im listening to all of your talk and only so compelled to ask or at least bring up the topic of the argument of Climate Change in the the political arena. I can, i know theres Climate Change, i know that we have to go alternative energy, but be you were to ask me, you know, to explain, i dont think i could either. So why should i be so, you know, proud of myself . My opponents will say, well, you dont know what youre talking about, but how would you respond given what you know . Well, i would respond in the same way i did to this gentleman earlier, that we all rely on expertise, and really the question is which experts are we going to believe. And in the case of Climate Change, im with you, you know . I believe, you know, upwards of 90 president of sign 90 of scientists who say we should worry about it. But if someone says, oh, its a conspiracy and these scientists only believe in Climate Change because its the only way they get published or get grant money, you know, the truth is all i can do is say, you know, thats not the cull which are of culture of science that i know. But its a problem, right . There is some uncertainty that comeses from the fact that we have to trust our experts. But look, we have to trust our experts. Its all we can do do, right . I cant fix my toilet by myself. I have to trust the expert. You know, i cant eat potato e chips if i dont trust the expert who makes them. And i think its a much, its a hard problem. Its a very hard problem, but its a hell of a lot easier than trying to explain how everything works to every individual. I was bond oring if you could comment wondering if you could comment on the people that are most wrong most often, whether there was any consistency across those people and maybe the extent to which academics might be part of this group and that theyre individuals that are subjecting Matter Experts and, therefore, might believe, therefore, their subject matter expertise in one area makes them experts in a wider variety of areas. So i cant speak to that last issue because i havent studied it and i havent heard of any studies of it. I can tell you that the people who really suffer from the knowledge illusion are people who are not reflective. Right . So some of you may be familiar with this cognitive reflection test, this simple threeitem test developed by shane fred ricks at yale, and essentially it asks whether people tell you whats on their minds immediately or whether they verify before telling you whats on their mind. So this is not from the test, but its a nice example that gives you the flavor of it, you know . Again, many of you may have heard of this. If i ask you how many animals of even kind did moses put on the ark, some people say two and other people say moses didnt put any animals on the ark, it was noah that did. And the difference is that generating the response is nonreflective. You just two came to mind and two comes to of courses mind, right . And other people verify it before uttering it. No, thats not right because it wasnt moses at all. So people who suffer from the knowledge illusion tend to be the nonreflective type, right in and, in fact, if you test people who are reflect i, you dont see any evidence for it. Presumably, thats because they explain before they respond. How well do you understand how well ballpoint pens work, people who are reflective think and try to explain how the pens work before they put down their response the fist time, right . So are scientists more reflective . On average, yes. But youd be surprised how many nonreflect i scientists already there are, right . So shane ran this cognitive reflection test on, i hate to say it, mit students as well as Harvard Students and all kind of other mit, were best. Were the best, but its still case that well over half turned out to be to turned out not to be reflective. Including some in this room. [laughter] thats the best i can do. So in the Financial Markets as we keep listening to the experts, at some level all of them are standing next to the cliff, and theres nobody standing on the other side. So people in the big shot movie and book, the only people who stood out were ten guys, five guys, a hundred guys, but they were th irrational thinkers. Could this be rational thinking [inaudible] because they did not listen to the entire herd . So shouldnt irrationality or being skeptical be a part of learning . Absolutely. It should be a part of it. I mean, look, id never argument that we shouldnt develop critical reasoning skills. You know, i bought into that part of the judgment in Decision Making program a long time ago, and ive tried to learn statistics, and i try not to commit various cognitive fallacies that i know people commit. Yes, one more is following the herd, and we shouldnt necessarily do it. Yeah, we can reap great advantage by not doing it, as your examples demonstrate. But dont mistake not following the herd with always being right, right . So if the herd is wrong, then youre brilliant if you dont follow the herd, but often the herd is right. And, you know, and i wouldnt, i wouldnt necessarily call someone irrational just because they dont follow the heard, i would call follow the herd. You know, if the herd is the community of scientists who are trying to figure something out, they do okay most of the time, at least in most doe domains. Financial markets are different and special that way, right . You know, and ill let those who understand Financial Markets better than me speak to this. But clearly, following the herd can earn you a lot of money at least for a while. So weve run out of time, but thank you very much. I want to thank our speaker, thank you. [applause] we have a short book signing. Some people reserved books ahead of the event, and youre also welcome to buy them there. Steven will be signing books here, so thanks again. Thanks, amy. Thanks, all of you, for coming. [inaudible conversations] booktv recently visited capitol thoil ask members of congress what theyre reading this summer. What im reading this summer, and it might take me all summer, is this commentary on romance, on the book of