In today’s episode, we cover decision making with Annie Duke. Annie walks through how poker taught her to think about uncertainty, how to read people by the story their actions tell, and why judging a choice by its result teaches the wrong lesson.
About Annie Duke
Annie Duke is a former professional poker player who says she has not played poker since 2012. Before poker, she studied cognitive science in graduate school, focusing on how people learn in uncertain systems. She now does consulting in the decision-making space. She’s the author of Thinking in Bets and How to Decide: Simple Tools for Making Better Choices.
Key takeaways
- Every decision is an educated guess, so ask how much education you can put into it.
- Reading people is mostly about listening to the story their actions tell, and asking what you’d be doing if you were in their seat.
- Confidence comes from knowing you handle a bad situation better than other people would, or better than your past self did.
- Resulting means judging a decision by its outcome, and it teaches bad lessons because good decisions can lose and bad ones can win.
- When you can’t know an exact number, give a low and a high bound. A range shows what you know and how sure you are.
- Swap vague phrases like “real possibility” for percentages, and ask others to define their terms so you’re actually having the same conversation.
Decision making is a skill we all use every day but one that few of us master, so why is the skill of decision making overlooked, what can you do to master it, and what can we learn about decision making from a professional poker player?
Resources from this Episode
- Annie Duke’s website
- How to Decide: Simple Tools for Making Better Choices by Annie Duke
- Annie Duke on Twitter
FAQ
What is resulting in decision making?
Resulting is judging a decision by how it turned out instead of how it was made. Annie Duke points out that we do this because the outcome is easy to see while decision quality is hard to work out. Luck and skill both shape results, so one result tells you very little.
How do you stop judging decisions by their outcomes?
Ask what the possible outcomes were and how likely each one was when you made the choice. Remember that a good decision can lose and a bad one can win, so look at the long run instead of a single result. Annie’s Pete Carroll Super Bowl example shows how one unlucky result can make a smart call look foolish.
How do poker players read people?
Annie says physical tells carry some information, but the bigger skill is listening to the story someone’s actions tell. Start with what most people do in that spot, adjust for what you know about this person, and ask what you’d have if you were making the same move. Then ask good questions to learn more.
How do you make a decision when you don’t have enough information?
Treat it as an educated guess. Annie suggests naming the lowest and highest numbers you think are reasonable, which shows what you already know without demanding a perfect answer. Then look for ways to make your next guess a little better informed.
How do you feel confident when you’re in a tough spot?
Annie says to stop comparing yourself with perfection. Ask whether you’ll handle the situation better than other people would, or better than you would have in the past. If you trust your process, you can find confidence even when the hand you’ve been dealt is weak.
What does “real possibility” mean as a percentage?
It depends on who you ask, and that’s Annie’s point. She says the answers she’s seen range from 16 to 81 percent (48:12). Write down your own number for phrases like this, compare with friends, and use percentages when it matters.
Related reading
- How to read people
- Reading social signals
- How to build confidence
- Winning techniques for business negotiations
- what social intelligence really is
- how to be more charismatic
- how to make a great first impression
- more Art of Charm podcast interviews
Updated October 31, 2026: added key moments and the full timestamped transcript.
Annie Duke podcast interview: key moments
Each moment below links to the exact second in the video.
[9:05] “That's where I've lived since then, the space between the two things”
[25:29] “We're going to have some good hands and we're going to have some bad hands”
[35:23] “Basically what we do when we're judging decision quality is we do the substitution”
[44:39] “In order to make a good decision, you have to be thinking about probabilities, because any decision that you ever make is a prediction about the future”
[51:43] “Am I going to be happy that I ate that cake”
Annie Duke interview transcript with timestamps
Below is the full conversation with speaker labels. Each speaker turn was checked against the episode audio by voice matching. Filler words and stutters are removed, and three short phrases are trimmed and shown as […]; the wording is otherwise unchanged. Every timestamp opens the video at that moment.
Read the full transcript
[0:00] Johnny: Annie, the way I saw this interview panning out, and we wanted to discuss your book today, but I wanted to set it up because you’ve been involved in notable cultural televised events, not just one, but several. Having an understanding of that, I think, will enlighten everyone to the way you think and why you’ve written this book. So obviously when I first heard of Annie, that was when Texas Hold’em first was getting on TV, and it wasn’t too long in that where you had taken the prize. That was number one, a cultural shift, a very significant impact on culture and Texas. I live in Vegas, I think about it all the time, and you’re one of the notables.
[0:56] Johnny: And then The Apprentice and facing off with Joan Rivers, and you won that by the way, but that was one of the biggest seasons if I’m not mistaken. It was.
[1:13] Annie Duke: I feel a little bad because I was on the season that revived the franchise.
[1:20] AJ: We won’t blame you.
[1:22] Johnny: Well, with all of that, and reading your book, I just couldn’t help thinking of the decision making and the way you have been able to see opportunities and ride them out for the greater purpose of making the world a better place through your charities and all the work you’ve done. And not only that, and being a mom with all of that. So, man, now you can set it up there because that’s just huge.
[1:57] Annie Duke: So it’s weird because obviously I’ve done all these different things and so it looks a little bit like I’ve been all over the map. But there’s actually a common thread that I love to pull. And then I’ll find different ways that I can go deep on that thread. So when I was in graduate school, I was studying cognitive science, which is really how there’s learning and decision making, and how you’re building models of the world. And when people ask me what is cognitive science, the way that I try to get it across is, well, there’s no such thing as green in the world, the color green.
[2:40] Annie Duke: So there are objects that have surfaces that light reflects off of and those wavelengths then hit our eyes, that gets processed a certain way and then our brains construct this idea of green that we then label with language, this idea of green, right? So we have this concept of green. And the reason why you know that is there are people who are color blind. And other animals don’t see that color. But you can take that concept of we’re interpreting the world in this particular way to anything. And what I was studying in graduate school specifically, while I did do a lot of psychophysiology and also decision-making.
[3:22] Annie Duke: And behavioral science and perception and all of that stuff. The thing that I was going deep on at the time was first language acquisition. Okay, I know that’s weird because I was like, wait, what are we talking about? She was a poker player. But if you think about it, it’s a really, really cool problem, right? So how does a kid learn any words? Because the parent points at stuff and says these unknown syllables like DAX, you know? And for us, if that syllable happens to be dog, it seems obvious that that means dog. But think about it from the kid’s perspective, right?
[4:05] Annie Duke: So let’s say there happens to be a dog in the room. Is the parent talking about the category dog? Or are they saying schnauzer or mammal or animal or something? They could be talking about a feature of the dog, like furry or soft, they could talk about a part of the dog, or they talk about paw, because by the way, every time that you point to a dog, you’re also pointing to a part of a dog. So any time that you say dog, you could also be talking about the paw. Okay, so you’ve got that little problem. So hopefully that’s helped if you point to a cat’s paw or something like that, but I don’t know.
[4:48] Annie Duke: But then there’s also, could it be an action? So maybe it means barking, or breathing, or panting, or sitting, or lying down, or running. So it could be that. Or it could be think. That becomes really hard. Like, oh look, I think that’s a dog. Okay, so now it could be the word think. So that’s really hard. And then sometimes you talk about dogs when there’s no dogs around. Okay, and then maybe it’s a picture of a dog in a book. So you’re actually talking about picture. It becomes, think about it, it’s really hard. And here’s the amazing thing.
[5:23] Annie Duke: Every one and a half year old has it mastered. That’s nuts. Have you tried to learn a language as an adult? Good luck. You’ll see how hard that is. So much more difficult. Some French person speaking really fast and there’s all these sounds coming out of their mouth and you’re trying to figure out what those words mean. Good luck. But kids do it really, really well. So, okay, what does that have to do with everything else I did in my life? Well, this is a really deep problem, but how do you learn in uncertain systems? There’s no certain mapping of the sounds onto the words.
[6:03] Annie Duke: And so what I was looking at was it turns out that language is kind in a particular way in which there’s a really distinct structure to the language called the grammar. So just as an example, if I say the DAX is walking, that eliminates all the verbs. It means that I must be referring to something that is an object, a person, place, or thing, right? And in particular, places can’t walk. So it has to be a thing or a person. In this case, a dog would be like a person, right? But if I say the dog is DAXing, that’s a whole different thing.
[6:38] Annie Duke: So now you know it has to be some sort of action. And then I can take it even further, which is, let’s say that we figure out that it’s an action, right? So I said the dog is daxing. Different things can be in different constructions. So let me explain what I mean by that. If I say the dog is daxing, but I could also say the dog is daxing into the room, that’s really different. There are lots of things that couldn’t do both of those things. They couldn’t take a preposition, or I could say I DAX the dog, right? So now we know it can’t be look, right?
[7:19] Annie Duke: Because the dog looks, that’s okay. The dog is looking into the room, that’s okay. But then I can’t look the dog. So right, now that whole choice is gone because it doesn’t fit into that construction. So it turns out that particularly with verbs, I could play a game where I can put it in enough context that you could actually get the exact verb. I could eliminate it down to one. Okay, so that’s really weird and long, but what that means is that what I was realizing is that you need to constrain your choice set, right? That’s what we were talking about. How do you constrain your choice set?
[7:55] Annie Duke: Because things are gonna go wrong in particular ways, because there’s a lot of uncertainty. And so if you’re gonna be an efficient learner, how do you constrain those choices that you can make so that you can learn really efficiently? So that’s what I really cared about. Well, if you know something about poker, that should actually sound pretty similar to you, it turns out. And then now with my consulting and really talking in general about how you create efficient learning in uncertain systems, how do you figure out what good choices are, what bad choices are, how you’re supposed to figure out what the right answer is, all of those things.
[8:28] Annie Duke: It’s the same problem that I was thinking about a long time ago. It just keeps taking different forms. So it’s always the same thread that I’m pulling on. I just go and think, that’s an interesting way to think about the problem. And then I feel like I got really lucky because once I started playing poker, at some point, actually a little bit through an accident because I got asked to give a talk, I realized about eight years into playing poker that there was this super interesting conversation to have between cognitive science and poker as ways to inform the exact same problem and that you could really dig into the space between those two.
[9:04] Annie Duke: And that’s where I’ve lived since then, the space between the two things. That was long and wonky, but you can cut that out if you want.
[9:14] AJ: I think, obviously, decision making is going to be a big part of what we discuss, but I want to touch on two other soft skills that I believe go along with poker, and especially when it comes to developing these skills in ourselves to relate to people and to communicate effectively. And the first, really for me, is recognizing other people’s tells and being able to read people and their reaction. And of course, at the professional level, we’ve seen on TV, people wear glasses and hats and all these things to remove any of those indicators. But it’s such an important part of the game at a high level.
[9:51] AJ: How did you develop that skill of reading other people in those situations?
[9:56] Annie Duke: Oh, gosh, I might be a little bit off here. It’s okay. The question that I have for you is how important specifically do you think physical tells are if people can be really successful playing poker online?
[10:10] AJ: Well, I don’t know that they’re necessarily important in the different types of poker being played, but more so for our audience, looking at how do we start to read people better, because so many of us are focused on ourselves and how we’re being judged. We’re not paying attention to a lot of the message that’s coming across from other people.
[10:30] Annie Duke: Yeah. Okay. So I like that you put it that way. Let me explain why I asked that question. I think we think about the signals that people give us when we’re thinking about poker in this very specific way that has to do with these physical tells. So I will tell you there is information in there. So essentially what you can think about is that there are physical things that happen to people when they’re uncomfortable. So that’s what you’re seeing as signs of discomfort. So barring someone being a psychopath, most people would be uncomfortable when they’re bluffing.
[11:05] Annie Duke: Because it’s a little bit like lying. This isn’t going to work if someone’s a psychopath. I just want to put that aside. But assuming they’re not a psychopath. So a lot of what you’re seeing in the physical tells is going to be either your autonomic nervous system showing signs of excitement or signs of discomfort. And the way that works in poker is that you map that onto signs that you really like your hand and that you’re excited to be in the pot or signs that you don’t. Okay, so I just want to say it’s not that that’s for nothing. It’s just that there are reasons that someone could be uncomfortable that don’t have to do with them lying, which is that they’re being stared at.
[11:44] Annie Duke: Or the stakes are really high or those kinds of things. So you have to parse out a little bit. Does this really have to do with the hand they’re holding? Or does it have to do with the fact that I’m staring this person down? And nobody likes to be in that situation. So we can talk specifically about those things. But what I want to talk about is a broader way of how you read other people’s signals and understand that there’s all sorts of communication that’s happening that isn’t happening with words. Exactly. So what you want to do is become a very good listener of what the story is that other people are telling you that doesn’t have to do with the words that are coming out of their mouth.
[12:23] Annie Duke: So I’ll give you an example. This is a pretty simple poker example. When people bet, they are telling you a story about their hand. And the way that you understand the story about their hand is that, well, if I’ve never met them before, I’m gonna take what most people do in this particular situation. So that’s gonna be what we call the prior that I come in with, my assumption that I come in with. But if I’ve played with you a lot, AJ, then I would know specific things about the way that you normally play, all right? So I have some idea of when AJ does certain things, I’ve seen this in the past and this is generally what it means.
[13:03] Annie Duke: So I would map those two things together, and then if you did something that was surprising to me, I would pay particular attention to it. And we need to be really good listeners of those kinds of signals because essentially, people in general have patterns in terms of the way that they act, and then you can start to narrow that down in terms of the particulars of the person that you’re dealing with and pay attention to what they’re telling you. That’s number one. And then number two is make sure that you are actually asking them good questions. That’s number two, so that you can actually get some information out of them.
[13:36] Annie Duke: So let me separate those two things. So here’s a really common way that people aren’t good listeners. So how much poker do you do, you know? A little.
[13:46] AJ: Little. Not a crazy amount, but definitely played.
[13:50] Johnny: Enough to throw down and lose. That’s perfect.
[13:52] Annie Duke: Perfect. Okay. Johnny, I’m going to do this with you. Okay. So let’s imagine that you raised before the flop and you had a hand like an ace ten, ace nine, something like that, and you raised before the flop and then the board hit and it was an ace and a nine and a three and they were all different suits. Okay, so do you have that in your head now? So you have ace ten. Okay, and the board is an ace and a nine and a three and they’re all different suits. So you have a pair of aces.
[14:32] Johnny: What About my suits? What about my suit? Doesn’t matter.
[14:34] Annie Duke: There’s three. This will make you a better poker player: if there’s three different suits on the board, don’t worry about the suits of the cards in your hand. Okay, so you don’t care about that, but you have a pair of aces. So you raise before the flop, somebody called in the blind, and now the board came an ace, an eight and a three. Okay, so you’ve got an okay hand but not an amazing one, but it’s pretty good. And now let’s say that person makes a pretty substantial bet. So it comes an ace, nine, eight, three, you’re thinking, oh, that’s kind of good, I hit an ace, but now they actually make a pretty big bet.
[15:11] Annie Duke: So what’s going through your head in terms of what you think they might have?
[15:16] Johnny: At least to match up with a pair, at least, if not the pair in their hand and one on the deck, which gives them three of a kind.
[15:28] Annie Duke: Yeah, okay, great. So you think they have a pretty good hand? Yes. Perfect. So you and everybody else. Okay, so let’s actually parse this apart. So this is AJ, this is gonna be what you were talking about. Okay, so you’ve played enough poker though. So let me ask you a question. Let’s say that you were the other person. So let’s say I raised you and you called me and you were trying to be tricky and you had two aces in your hand, but you didn’t raise me back before the flop because you’re a trickster. Okay, so I raised you and you have two aces and now the board comes an ace, a nine and a three.
[15:57] Annie Duke: You flop the very best hand you could have. Are you just making a big bet now?
[16:02] AJ: Well, no, I wanna […]. That’s right.
[16:04] Annie Duke: Right. You want to trick me, right? You’re not just gonna bet and try to scare me away. Oh, that’s interesting. Okay, what if you had three nines? What if I raised before the flop and you had two nines and now the board comes an ace and a nine and a three, are you just betting out? No.
[16:20] AJ: No, I still want to keep you playing.
[16:24] Annie Duke: No, You want to trick me. What if you had an ace and a nine and you flop top two pair, are you just betting into me? No, no. What if you had ace king? Are you just betting? No, because you have a really strong hand. So notice that your instinct there, what you think the story is that they told you, what your automatic reaction is, oh, they must have a really good hand because they’re betting. But if you’re a good listener and you say, well, let me imagine, what if I were in their situation, would I actually bet with a really good hand?
[16:53] Annie Duke: The answer is not in a million years. Why do you think you’re any different than they are? So there’s a situation where now actually your first read, this is where I talk about reading people through patterns, through understanding what do human beings generally do? What are their tendencies? Poker’s a game of deception, right? Are they trying to deceive me or not, right? So that idea of, they’re just betting out with something where they have a really good hand, makes no sense. The story doesn’t make any sense. So now you know they have to be weak. So that tells you that your hand is probably pretty good here because they must be bluffing, or maybe they just have a nine, like one nine or something like that.
[17:36] Annie Duke: And they’re thinking, just like you did, if I bet I’ll look strong. Right? Because if they really had a strong hand, they’d be like, I’m just gonna check and see what you did. Right? So this is where we go wrong, that we’re not listening well. We’re not saying, what are the things that they’re doing? Let me not go with my first instinct and let me actually put myself into their position and say, what would it mean if I did that thing? And this is how we can start to construct really good models of our opponent, and this is much better information than whether they’re blinking too fast. So I’m not particularly worried if someone happens to put sunglasses on, right, because that is helpful information when I need a little extra zhuzh, but the bulk of it, the real work, is this storytelling.
[18:30] Annie Duke: Yeah.
[18:31] AJ: Now, is that a skill that you picked up before poker and you translated, and that you were pretty adept at quieting your own story and your biases from the work you’d done previously to paint that story? Or is that a skill that developed through your poker career?
[18:48] Annie Duke: Absolutely, through my poker.
[18:49] AJ: I think the problem that many of us have is we get too tied to our own story and how we’re presenting to the world, and we lose that ability to listen to what could someone else’s story be? And in poker, it’s a great example because that story is far more important than your own.
[19:07] Annie Duke: Well, that’s the thing, right? There’s two things. In poker, their story is gonna be much more important than your own because your hand is only as good as it is relative to the other players. And that could be either you have a better hand than they do or you recognize that their hand must be weak enough that you could make them go away. Because we can take this to another level. Let’s say I raised before the flop with a hand like a king and a jack and the board came an ace, a nine and a three again, and the person bet into me. It should matter very little to me that I actually don’t have a good hand here because I know they don’t have a good hand. So this is a signal that I should be able to bluff them. Now, how I execute that bluff is complicated and not for this show.
[19:54] Annie Duke: But the point is that I know that that is what I should be planning to do because they’ve shown me a lot of weakness. But what people do is they’ll just say, oh, I didn’t make a good hand and so I should just go away. But we need to understand our stories, our position in life or in whatever, is always going to be relative to the strength of the other person’s position. This is certainly true in any negotiation, which is all that poker is. So we always want to be taking that into account, which is why their story matters so much. But then here’s the other reason why it matters, is that once you start to really understand, if I were in their shoes, what would I think?
[20:30] Annie Duke: Then that allows you to see yourself from their perspective also, which really matters, because it matters what story you tell. So if I want to bluff, I have to tell a really good story about why my hand is strong. And I can’t understand what a really good story about why my hand is strong is without actually imagining what it looks like to the person that I’m playing against. And then I need to start getting specific because a story of why my hand is strong would be different for someone who was new, an amateur. So for example, what we just discovered is I could just bet at you and you would think I was strong.
[21:07] Annie Duke: But a pro’s not gonna fall for that, right? So a pro is gonna know that’s kind of a weird story. So now I could reverse that on the pro because I understand how they’re gonna perceive me, and I could execute a bluff in a different way against a pro. Maybe if I had three aces, I would just bet at the pro because they might then misread me as being weak. So now I can get a lot of levels deep on that, but it all requires that I’m standing in their shoes. What would they do with different types of hands? What does this action mean for what they would have?
[21:39] Annie Duke: What would I do in those situations? That’s gonna help me understand that, and then how are they perceiving me? What is the way that they’re gonna view my actions? And so it’s all narrative based, and I think that people are surprised when they hear that about poker. They think that poker is very math based, and people are running algorithms and trying to solve these game theory optimal plays. And that is all true. But at its core, the way that you figure out what those unknown variables are, which are two-fold. One is I can’t see my opponent’s cards.
[22:08] Annie Duke: And the other is that I don’t necessarily know what they’re gonna do with those cards. One person who has a pair might be very sticky and never go away because they think they have an amazing hand. And another person might be easy to push around, right? So I’ve got two unknown variables. What are their cards and what are they gonna do with those cards? And the way that I’m deriving those unknown variables that would even allow me to get into a place where I could start to calculate out all the math and stuff, that’s all narrative. It’s a game of listening and storytelling. That’s really what poker is.
[22:39] AJ: And obviously, we don’t have to get into the technical ways of how you bluff. And I’m sure there are a lot of complex thoughts behind that. But just in general, many of us are in a situation that’s completely separate of poker, where we know we need to be confident, but we’re not feeling it inside. And for the amateur poker player, you could be staring down a crappy hand and knowing that, well, you have to confidently pretend that it’s not a crappy hand. So how have you navigated that, and what are the lessons to becoming confident in those moments when you don’t have it based on the hand?
[23:18] Annie Duke: That’s such a deep question. I love that question so much. I like any question where I have to pause. All right, no one’s asked me that before. So let me think. Or not that specific thing. So I think there’s a lot of things that I do and that I recommend that are around getting to another level deep, and it has to do with that idea of everything is relative. Right? So I’ll give you the overall example. I know that I know very little about the game of poker.
[23:55] Annie Duke: In terms of what there is to be known about it. It’s a really, really, really complex game and I am just a mere human. And so I know some things about the game, but in comparison to what perfection would look like, I’m a disaster. So you might think, oh, okay, well then how could she ever be confident when she plays? I haven’t played since 2012. I don’t think I would be particularly good today. But at the time when I actually was doing well, it’s that I go a different level deep and I think about, how am I relative to other people who are also facing the same problem?
[24:40] Annie Duke: And I think that that’s where you can really find the confidence in hard things. Because if you can find ways, and hopefully my books help people do this, if you can find ways that you think, yeah, it’s true that if I were to measure myself against perfection, I would be an absolute disaster. What really matters though is how I am compared to other people who are in the same situation. So if you’re facing a situation, whether it’s going into a negotiation or a business situation or job interview or a sale or something like that, where you feel like you’re not really in a winning spot, but if you feel like you can handle that better than another person can, that’s what really matters because all of us in our life, to use a poker analogy, we’re going to have a random deal.
[25:30] Annie Duke: We’re going to have some good hands and we’re going to have some bad hands. We’re going to have some mediocre hands. That’s just true. What makes you win or lose is do you do better with those than other people? That doesn’t mean you’re never going to make a mistake, and it doesn’t mean that sometimes you’re going to have to play a bad hand. Of course you’re gonna have to sometimes. You’re gonna get into bad spots. You’re gonna be dealt bad cards. But if you really believe that you have a good process that allows you to make better decisions than other people, then you can find confidence in that second order knowledge.
[26:00] Annie Duke: And by that what I mean is sometimes you can be in a situation where it’s a bad situation so you are gonna lose to it. But if you lose less than other people do in that situation, oh my gosh, you’re gonna win so much in life, right? That’s the thing. It’s all about, am I losing less than other people would in this situation? And if you really have confidence in that, I think that’s where you find the confidence. So I’m gonna play this hand better than other people, even though it sucks.
[26:30] AJ: See, I love that because so many in our audience are perfectionists and they do want to compare themselves to the ideal. And even hearing you say, I’m far from a perfect poker player, many of us have this illusion of the people who are successful that they have this just limitless confidence. They’re not facing these calculations. They’re not staring down these situations like us mere mortals, and therefore I can’t become them. But it’s an important part of the journey that striving, not comparing yourself to perfection, but striving to, comparing yourself to can I win a little bit more than others in this exact same position, is an excellent reframe when we’re talking about confidence in any environment, not when you’re just dealt two cards and you’re staring across the room at someone else.
[27:20] Annie Duke: Yeah, and I would add to that one other layer, which is sometimes that confidence comes from am I handling this situation better than I would have in the past. So it’s not just comparing how would other people handle the situation, but how would another person, meaning me, a past version of me, handle this exact same situation? And I think that that’s actually really important because it gets your eye on the right prize, which is not perfection, but progress. And there’s that whole thing, which is perfection is the enemy of the good. And this is one of the things that I say all the time, is that we can really get hung up, particularly in a lot of anxiety and analysis paralysis, if we have whatever perfect would be in mind, as opposed to, look, this is something that I say in my book, I say a lot of times when we know that we’re in a situation which could be described as guessing, which by the way is every situation you’re in in poker, because you’re doing some guessing about what the other player has, you’re doing some guessing about what you think is going to be the highest value move in a particular case.
[28:28] Annie Duke: It might be folding might be the highest value move, by the way, just cutting your losses, or raising. And if I raise, how much should I raise? And these are all obviously guesses. So if you allow yourself into a situation where you say, well, I can’t know what the right answer is, so therefore, I can’t do it because I’m too anxious. I’m too worried about being wrong, then you’re not actually going to be able to make any progress. You’re not going to be able to do anything because you’re going to be deciding too slow. The bar that you’re setting is too high, you’re not gonna actually be able to act, and you’re gonna make worse decisions for it.
[29:02] Annie Duke: So what I say is don’t ever think about something as a guess, think about it as an educated guess, because that’s what all guesses are. There’s nothing that you guess about that doesn’t have some educated in it. And the question is how much educated can you get in there? And if you can get a little bit more educated in there, if your guess can be a little better than the next person’s or then your past guesses might have been, then you are going to do really, really well in life. So one of the examples I try to give, particularly in this virtual environment where people can’t see what my computer is sitting on, you say, okay, my computer’s sitting on a desk.
[29:40] Annie Duke: How much do you think the desk weighs? Give me the smallest amount you think it weighs and the biggest amount you think it weighs. So I’ll just ask you to do that.
[29:47] AJ: So 50 on the low end and 100 pounds on the high end. Okay.
[29:52] Annie Duke: Why didn’t you guess 10,000 pounds?
[29:54] AJ: That’d be a very heavy desk.
[29:56] Annie Duke: That’s right. Why didn’t you guess five pounds?
[30:00] AJ: I probably wouldn’t be able to hold everything else that you need to keep on the desk.
[30:05] Annie Duke: This is what I think the interesting situation is. And I think this is where people go wrong, is that when I said to you, how much does this desk weigh? A reasonable response from you would have been, I don’t know. I can’t see it. But I said to you, no, just give me the lower bound and the upper bound, and you said 50 to 100 pounds. So it turns out you know a lot about desks. Because if it were a cow, you wouldn’t have guessed 50 to 100 pounds. If it were a car, you wouldn’t have guessed that. And if it were a feather, you wouldn’t have guessed that.
[30:36] Annie Duke: Because we know a lot about a lot of things that we don’t give ourselves credit for. So that’s number one, is try to figure out what you know. But notice the other thing I did was I didn’t make you get it perfect. I said, what’s the lowest and what’s the highest amount? So I was getting you into this Goldilocks zone of not just abandoning and saying, well, I don’t know, as if you knew nothing, but also not requiring that you get the exact number. Because it’s rare that we could get the exact number because most of the things that we’re doing in life actually are like guessing the weight of my desk.
[31:07] Annie Duke: I can’t see my opponent’s cards. I don’t know what they have. I can create a bound around it. I can get a range there, just as you did with the range of the guess. And what’s gonna make me better than the next player is that my range is better. That’s it. And you can think about that, that’s what expertise is putting in. So if I were looking at a cow and I was guessing what the lower bound and the upper bound is, that boundary would be much wider. I would have a much lower lower bound and a much higher upper bound than a rancher would.
[31:46] Annie Duke: Why? Because a rancher has more certainty about the weight of cows in general, so they just happen to know more. So their range would reflect that they have more certainty. And I think this is a much better way to think about this kind of stuff, like what do you know and what don’t you know? And you can allow that to actually express your uncertainty. So it’s the imperfection of the guess that becomes so informative, right? What does it do? It allows you to say, this is how much certainty I have around it. Number one, number two, it allows you to start really exploring what do I know, which actually gets you to a better state of perfection than you would have otherwise.
[32:20] Annie Duke: And the last thing is that when I say to you, let’s say you’re a rancher. If I say, well, I think the cow is somewhere between 300 and 1500 pounds, and it’s like a grown adult cow, inherent in there is a question of you to give me some help. And what’s gonna happen now? You’re gonna be, well, actually I’m a rancher and I know that for adult cows 300 is way too low, right? So all of a sudden you can deliver some knowledge to me that helps me. I’m 1500 pounds is way too high. We’re not talking about a bison here. So you can actually now help to give me some knowledge that’s gonna help me to narrow it down because I didn’t tell you I thought I knew in the first place.
[33:00] Annie Duke: And it gets you in that in-between place, which I really love.
[33:03] AJ: And certainly the process of dialing it in and gaining that expertise, it’s a better lens to look at it, that we’re making educated guesses, and the goal over time through education is to get that range to a place where it’s more accurate.
[33:18] Annie Duke: And so that you’re better in that state of uncertainty than other people would at handling the uncertainty and getting to somewhere closer, because you’re doing two things. You’re not demanding, you’re not saying, well, I don’t know, so I can’t guess, so that makes you better. And then you’re also not saying I do know, that you’re under the illusion that somehow you could know that my desk weighs not ninety three and a half pounds. I actually don’t know what it weighs, but you’re not pretending you know the exact number either.
[33:48] Johnny: What I really enjoyed about the book was that you lay out arguments for, here’s all the blind spots for our cognitive processes. Here’s what you cannot do. And then processes of what you can compensate for that or what you can do to educate yourself for those guesses. And it starts out with the first one being resulting and people measuring their performance on those results. And you mentioned about why this is misleading or how it can be misleading. Could you expand on that with us, please?
[34:28] Annie Duke: Gosh, basically here’s the problem that we have as decision makers, right? You can take the game of poker as an example, which is for someone to look back on a hand that somebody played. It’s very hard for someone to understand whether the decision-making was really good or not. It’s complicated because you don’t really know what the cards are and it’s hard to work out that math. I could reconstruct the math for you, but it’s hard. It takes a lot of work to actually reconstruct that math. And then you also have to explore what all the other alternatives were that you didn’t take and compare those other alternatives to the one that you did take.
[35:11] Annie Duke: And it’s a big process, so that’s hard. And it’s pretty opaque. Do you know what’s not opaque and hard? Figuring out whether you won or lost. That’s pretty easy. So Basically what we do when we’re judging decision quality is we do the substitution, which was, we know that judging decision quality is really tough, but judging the quality of the outcome is actually quite easy. And this is actually, Daniel Kahneman talks about this, that this is what we do a lot in subjective judgments, that we’ll substitute the judgment of the easy thing for the hard thing. So an example from real life would be, you’re trying to hire somebody into a job and they happen to be really charismatic in the interview.
[35:58] Annie Duke: You’ll substitute that in for the judgment of the overall skill that you really care about for your job, because that’s an easy and salient thing for you to look at. Well, I really liked them, right? I got along with them well. And so then when someone asks you, do you think they’re gonna be a great hire, you actually sort of judge how well you got along with them instead of the things that really matter for whether you’d want to hire that person. This happens all the time. But anyway, this creates this resulting problem, which is, I won the hand, I must have played it poorly. Well, rather, I lost the hand, I must have played it poorly. And we can see this happening all the time. And so I’ve talked about a variety of examples.
[36:31] Annie Duke: One of the most famous ones is the 2015 Super Bowl, if people remember this. So Pete Carroll is the Seahawks around the one yard line of the Patriots. And they’re down by four. So it’s second down, and they have 26 seconds left on the clock in the fourth quarter. And they have one timeout. So this is a tough spot. You have to score a touchdown. You obviously have three tries, second, third, and fourth down, but you only have 26 seconds left to get that done, which if you had three timeouts wouldn’t be so bad. But you only have one, so that just creates this huge clock pressure. And also it’s the Patriots.
[37:11] Annie Duke: Anyway, it’s a very famous play because everybody was expecting him to hand the ball off to Marshawn Lynch, which he did not do, of course. And he actually passed the ball into the corner of the end zone, where Malcolm Butler intercepted it. He lost the game, and everybody thinks that was the worst play in Super Bowl history. So here’s how we can tell that this is a resulting problem. So I want you to imagine. By the way, the headlines were so brutal. One headline actually called him an idiot.
[37:48] Johnny: Oh, it was awful.
[37:49] Annie Duke: Okay, so let’s imagine this. Let’s say that he decides not to hand it to Marshawn Lynch and he calls a pass play and Russell Wilson passes the ball and it’s caught for the game-winning touchdown. What are the headlines the next day? Genius. Genius.
[38:06] Johnny: Amazing. Yeah.
[38:07] Annie Duke: So That’s how we know it’s resulting, because we know very little about anything on one try. It would be kind of like, Johnny, if I was flipping a coin and you called heads and it landed heads and I said, he’s a genius. And it landed tails and it was like, what an idiot. But by the way, the funny thing is we do this all the time. So let’s say that I offer you a really good bet on a coin flip. And I think that people can intuit this pretty well. So let’s say that I say, if you call it right […].
[38:41] Annie Duke: This is an amazing bet. It’s incredible. You should totally take that bet. But everybody can feel this. So let’s say you take that bet because it’s a really good bet, and I flip the coin and you call tails and it lands heads. Don’t you feel like you made a mistake? Sure. Idiot. Right?
[39:07] Johnny: And I can also see looking at that and then remembering that and never taking that bet ever again in my life.
[39:16] Annie Duke: That’s exactly right. People think Pete Carroll made a terrible mistake. That’s going to stop people from doing that play, which by the way was super brilliant.
[39:24] AJ: Right. That’s what I want to talk about, is running with Marshawn Lynch was the most obvious play against a defensive mastermind who’s going to scheme for the most obvious play. Even though he’s an efficient short yardage back, it was the most obvious. And yet he gets slaughtered in the media after from that one result. But we do this to ourselves all
[39:48] Annie Duke: All the time. So there’s so many things that make that a great place. So that’s one of them, just from a game theory thing. It’s like, well, where do you think he’s gonna do it? And also, by the way, there’s a whole pile of Patriots sitting right there. So just so you know, Marshawn Lynch is only going to score 20% of the time there. Okay, so then the question is, okay, well, what happens if you pass, right? So touchdown, genius. Incomplete pass, nobody talks about it ever again. And then obviously if it’s intercepted, we know exactly what happens.
[40:23] Annie Duke: But here’s the really cool thing about this play. Remember, he only has 26 seconds and one timeout. So if he hands it off to Marshawn Lynch and Marshawn Lynch fails to score, which he’ll do 80% of the time, the clock runs. And he’s gotta call a timeout. So he burns his one timeout and then assume everybody wants him to hand it off to Marshawn Lynch again. That’s his last play. So remember, he’s got three downs. He only gets to use two of them if he hands it off to Marshawn Lynch two times in a row to start. But if he passes the ball on second or third down on one of those first two plays, and it’s incomplete, what happens to the clock?
[41:01] AJ: Stops. So he at least gets that third try. So he was maximizing the opportunity. That’s right.
[41:06] Annie Duke: Right. So I am completely agnostic as to whether he should pass on the first or the second play. I just know he should pass on one of them. And what’s the cost of that? The cost of that is the interception rate, which is only less than 2%. So this is the problem with resulting. Here was something that we saw that’s only gonna happen 2% of the time and everybody’s like, that was the worst play in the history of everything. So we do this to ourselves all the time, because what we lose sight of is that you could go through green lights and get an accident and you can go through red lights and have nothing happened to you bad at all.
[41:46] Annie Duke: And then we take really bad lessons. Not so much anymore because it’s been educated well, but when I was growing up, people would say all the time, I drive better when I’m drunk.
[41:56] Johnny: Oh well, we heard that all the time. My parents used to say that, right?
[42:03] Annie Duke: And now I also think that this is happening with the pandemic as well. Someone pointed this out to me, that there’s lots of people who went to a gathering of 10 people and they didn’t get coronavirus and now they’re like, aha, that’s a good decision. I should keep doing that.
[42:19] AJ: Or the ultimate resulting, the president surviving and then making rationalizations around other people being healthy, even though they caught it.
[42:27] Annie Duke: But that’s a really good example of resulting, right? You make a decision that carries a lot of risk with it, but a lot of risk that isn’t a guarantee. And we know that because, for example, in New York State right now, I think if you’re in a group of 10 people, there’s a 10 percent chance that someone has the virus. I think if you’re in one of the Dakotas right now, it’s something like 70 to 80 percent. But let’s take the Dakotas. So you go to a group of 10 people, there’s a 70 to 80% chance that someone has the virus.
[42:55] Annie Duke: Guess what? 20% of the time that means they’re not. And so you’re gonna walk away from that and say, see, that was a totally fine decision and that was good on me. But you do that enough times and it’s gonna play out. That’s why we don’t think about the long run very well. We get caught up in these short run loops about how are we learning from the outcomes? And this goes back to that language acquisition problem that I got so wonky on, right? What does an outcome mean when it could have happened because it was a good decision, or it could have happened because I got good luck?
[43:28] Annie Duke: Or it could have happened because it was a bad decision, or it could have happened because I got bad luck? Because all four of those things could be true, and trying to figure that out in retrospect is just really hard, and our brain plays all sorts of tricks on us in that way that leads us to very bad conclusions and slows our learning down.
[43:45] Johnny: That’s right, I love the language aspect of the book, especially when it came to probability theory, and there was the long list and the exercise is to write down what percentages you would think would go with each phrase or term. And AJ and I play probability theory all the time. We’ve been doing this company for 15 years and we’ll make choices and I’m like, what’s the probability you think that would happen? But this was so great for me because to be able to see it in verbiage and then the percentage after that, with now the low and the high to go along with it, I was like, oh, more tools for decision making.
[44:27] Johnny: How fun. I love that. Could you expand on the percentages and the words and why that was so important?
[44:36] Annie Duke: Yeah. So, okay. So the first thing to realize is that in order to make a good decision, you have to be thinking about probabilities, because any decision that you ever make is a prediction about the future. But it’s not like the future is deterministic or something. Like there’s only one way that something could turn out. It’s anything that you do, there’s a bunch of possibilities for how it could go. And there’s some probability of each of those things happening. You could think about a simple decision. If I leave for work at a certain time of day, I could get there on time, I could get there early, I could get there late, and there could be an accident and I could be really late, and each of those things is going to have some probability of happening. And there’s a reason why you don’t leave yourself an hour cushion to go to work, because that would be the way that you could guarantee that you get there on time-ish.
[45:32] Annie Duke: I mean, assuming your car doesn’t break down. But we don’t do that because it is probabilistic. We’re trying to balance out what’s the value of our time with how much of a probability do we need to get there. And you can tell that you’re thinking that way, even if it’s just implicit, because if you have a really important meeting in the morning that you cannot miss, you will actually leave earlier to increase the probability that you get there on time. So we are thinking that way, it’s just we don’t do it explicitly. And whenever there’s something implicit in a decision that you’re making, you’re usually better off making it explicit.
[46:03] Annie Duke: And so that’s why we wanna actually think about what are the possibilities and what are the chances that those occur. So the way that I start off is start thinking about that by using terms. Is it likely, highly likely, a real possibility, certain, so on and so forth. And so I give people, this is from Andrew and Michael Mauboussin, I give people a list of terms that would generally describe probability and I say start there. Just to get used to this idea of I want to think about how likely things are to occur and I’ve got these terms that I can use that will help me do that.
[46:32] Annie Duke: Maybe is one of them. It means about 50-50 for me. But then what I do is I take it further and I say, look, part of the problem that we have as decision makers is that often we think we mean the same thing as other people and we don’t. This is generally true. We think too much that other people hold the same political views that we do, or if we like a certain type of music, we’ll overestimate how much other people like that music. And if we think that mentor means a certain thing, then we’ll think that other people mean the same thing by mentor as we do. And I’ve seen that with coronavirus, with the word safe. Are you pretty safe about the virus?
[47:09] Annie Duke: Are you careful? And they’ll answer yes, and you think you have some sort of agreement. Whereas when they say, yeah, I totally wear my mask whenever I go into a bar, and you’re like, whoa, wait, that’s a totally different careful than I think, but that’s because you’re not actually defining the terms. Right. So this is a problem that we have, that we don’t actually dig down and get some definition around these terms. And this is particularly true when we’re using terms like real possibility. So what I ask people to do is actually take this list that I provided them after I’ve gotten them used to thinking this way and write down, if you were to use the term real possibility, like there’s a real possibility it’s gonna rain tomorrow.
[47:48] Annie Duke: How many days out of 100 are you saying it will rain? Right, and that gives you a probability. So if you think it’s 30 times out of 100, if I use that term, then it would be 30%. So I get them to write this down, but then I say, now I want you to go ask three friends. Don’t tell them what your answers were. And just get their answers also. And then it turns out nobody agrees with anybody on this stuff. So real possibility, the smallest number that I’ve ever seen someone answer for real possibility is 16%, and the highest is 81. So imagine if I say there is a real possibility of rain tomorrow, I could mean don’t bring an umbrella, because there’s only a 16% chance.
[48:30] Annie Duke: And you could be totally geared up or wanting to cancel because you think I told you there was an 81% chance. And by the way, just so you know how big this problem is, people don’t agree on what always and never mean. Never means somewhere between zero and 10% of the time, and always is in a similar range, right? So for me, always means always, it means 100%, never means never. But then when you actually quiz people on it, they mean, oh, well, no, I don’t really mean never.
[48:58] Johnny: Well that’s an interesting point, as even in our classrooms, when it comes to language, we’ve always talked about people, unless you’re absolutely certain, remove absolutes because you’re not doing yourself any favors.
[49:13] Annie Duke: Not at all. So now I say, okay, so now you really shouldn’t be using these terms like real possibility when you’re trying to figure out what are the chances I get to work on time if I leave at this hour? Don’t say, well, there’s a real possibility I’ll get to work on time. Actually put a number to it. And now that shouldn’t be so scary because you just created a list. So you can carry that list around with you. And when the term real possibility comes into your head, then just look at your list and say, well, what I mean by that is 62%, so that’s what I’ll say.
[49:46] Annie Duke: And notice now people know what you mean. And then if they say, well, I think there’s a real possibility, back to you, say, well, what does that mean? Could you express that as a percentage, please? Or if they say, I’m being very careful about coronavirus, make sure you define what careful means. And one of the ways that I do that with coronavirus is I say, imagine that you have coronavirus. You’ve got a positive test today. Tell me how you got it. Boy, you learn a lot about people that way, because I make you define what careful means when I ask you the question that way.
[50:17] Annie Duke: And we need to define terms better. When someone says, I think this job candidate is going to be a great mentor, say, well, what does mentorship mean to you? What do you mean by mentor? And make people define it so that you can at least be having the same conversation that you think you’re having in your head.
[50:32] Johnny: That seems to be a large problem in today’s culture, especially with tech. Everyone’s living in these subgenres and subcultures of gamer world and musician world and this world and that world. And everyone has different terms, and I’ve learned just for my own sanity to ask people to define what they mean, because of just how wildly different everyone is in how they live, and that language is in their culture.
[51:05] Annie Duke: That’s exactly right.
[51:07] AJ: Well we love asking all of our guests what their X factor is, and what is a skillset or a mindset that unlocks success in their life, makes them unique. What do you think your X factor is, Annie?
[51:18] Annie Duke: I’ll tell you what I think it is. I think that I am pretty good at mental time travel. I do it a lot. So the example of that would be, I try to get myself far, far into the future to think about what the impact of any kind of decision I might make right now is. And this is actually a place where decision making can get really bad. It’s the problem of I want to eat healthy, but there’s cake right in front of me. So I’m pretty good at saying, yeah, but in a week, am I going to be happy that I ate that cake?
[51:46] Annie Duke: And I use that skill a lot, not just in executing on my goals, like what’s actually gonna allow me to execute on my goals, but also in the moment, it stops me from making emotional decisions. So when you’re on with a customer service agent and you’re really pissed off and you just want to yell at them and tell them they’re an idiot, I’m pretty good in that moment of saying, is that actually going to help me achieve my goal? Am I going to regret having gotten pissed off at this person? Is this going to do what I want?
[52:09] Annie Duke: So I think I’m pretty good at interrupting those in the moment processes and getting pretty far in the future and thinking about, well, how is this gonna play out in the future? Am I gonna regret this in the future? Does this seem good in terms of my ability to achieve my goals? Now, I will say that that has a dark side, which is it means I’m always thinking about death and getting old. No, really. Really, I feel like time feels a little bit faster to me because I am thinking, I’ll be 10 years in the future sometimes.
[52:42] Annie Duke: And I’ll be like, oh my God, I’m gonna, and so I think about mortality a lot more than most people do, I think. But it has a good side, too, which is that I think I’m less impulsive than most people are. I would say that’s my X factor, is I can get myself out. But that’s the same thing as I can get myself out of my own head into somebody else’s head. That was really important in poker. I didn’t go on tilt in poker because I would think about what my long-term goals were, that kind of stuff.
[53:08] Annie Duke: And I think that comes across a lot of the stuff that I do. But then also I’m sad because I’m going to die.
[53:15] AJ: Well, thank you for sharing, and it’s such a great way to look at things for those in our audience who are trying to become better decision makers, and we thoroughly enjoyed the book and can’t wait to see what’s next for you.
[53:26] Johnny: Any parting words, where our audience can find you or what they can look out for?
[53:30] Annie Duke: Yeah, sure. So you can find me at AnnieDuke.com, my website. There’s lots of video of me, and you can link to my articles and podcasts that I do there. You can find my books there. You can find my newsletter there. There’s a contact form, and I do actually try to respond to everybody who writes me. I’m probably 80% or 90% on that. But it’s not because I didn’t want to respond to you. It’s because it got buried in my email and my life. But I am attempting. So I love when people write to me, actually. That actually tends to spur a lot of the thinking that I do, is hearing from other people and what’s on their mind.
[54:09] Annie Duke: And then you can also find me on Twitter at Annie Duke. I’m pretty active over there. It’s a better place to reach me than LinkedIn or Instagram or whatever. Just go over to Twitter. You can have a conversation with me over there. So that’s where you can find me. And then you can find my books, How to Decide and Thinking in Bets. And then the next book I’m writing someday will appear on there, so.
[54:35] AJ: Awesome. Well, thank you so much. Good luck on your […]. Thank you.
[54:40] Annie Duke: You. Thank you so much. That was perfect timing.
If you’re curious what it looks like when people practice these skills with real conversations in real time, take a look at how The Art of Charm’s XFA program trains them live.



