# How to resolve a hostage crisis: Part II

**Posted:**September 26, 2011

**Filed under:**Bayesian Games |

**Tags:**crazy types, crisis, feigning madness, hostages, insanity, normal types, SWAT team, villains 3 Comments

Last week, I showed that if the villains are perfectly rational, and this is “common knowledge,” then the villains will be best off by just surrendering immediately without killing any hostages. But the rationality assumption is a big one – let’s see what happens if we drop it.

Once there’s a good chance that the villains are “crazy,” even criminals who are perfectly sane will pretend to be crazy so they can extract money as ransom. We can then model this as a Bayesian game, with N periods corresponding to the hostages that are holed up in the bank. Each period will consist of two stages: in the first, the SWAT team decides whether to pay up or not; in the second, the villains choosing whether or not to kill a hostage; if they don’t, it’s tantamount to surrender. If they run out of hostages to kill, they are forced to surrender, and the surrender outcome gets progressively worse as they kill more hostages.

The payoffs are described as such:

**Each dead hostage:** gives to the SWAT team, and to the villains if they end up surrendering.

**Surrender:** gives to the villains.

**Pay up:** gives to the SWAT team, P to the villains, where (1)

Finally, we assume that there is a probability (initially) that the villains are nuts.

We’re going to construct a mixed strategy solution to this problem, which will yield a perfect Bayesian equilibrium. That is, in a given period , the SWAT team pays up with probability , and the villains execute a hostage with probability . For those who are unfamiliar with mixed strategies, the basic idea is that both sides are indifferent between (at least) two options, so they may as well flip a coin as to which one to do. The trick is that the coin is weighted so as to make the other side indifferent as well. Thus they will flip their coins so as to make the first side indifferent. Hence this forms a Nash equilibrium – neither side can benefit by unilaterally changing their strategy.

The derivation is a little drawn-out, so I’m going to break it into steps:

(i) If the SWAT team always pays up in some period , then the villains may as well execute their hostages until they reach that stage; after all, this guarantees them an automatic victory. But if they will do that, then the SWAT team should pay up immediately (i.e. in period 1): since they’ll lose anyway, they may as well save the lives of the hostages.

(ii) Conversely, if the villains will always execute a hostage at a certain stage, then the SWAT team should always pay up then. But then we run into the same issue as in (i), so the SWAT team will end up paying at the beginning. Combined, (i) and (ii) limit the types of equilibria we have to analyze.

(iii) If there is a period i at which it is known that the SWAT team will not pay up, no matter what, then the normal (not crazy) types, knowing this, will surrender in period . But this possibility leads to an inconsistency. Knowing that the normal types will do this, the SWAT team will believe that anyone who hasn’t surrendered must be crazy. If so, it is a best response to pay up in order to avoid more casualties.

(iv) Thus, from (iii), there cannot be a perfect Bayesian equilibrium in which the SWAT team will maintain the siege to the bitter end – they must always cave in to the villains’ demands with some positive probability. Indeed, we see from (i) and (iii) that either they pay up immediately, or they pay up in period with some nonzero likelihood.

(v) There is no benefit to the villains in executing the hostage. Thus, if they are normal, they will not execute, and so this hostage will be killed if and only if the villains are crazy, which occurs with probability .

(vi) In period , by (iv), the SWAT team must still be indifferent between paying up and maintaining the siege. This implies that

(vii) In all periods , the normal-type villains must be indifferent between surrendering and killing a hostage. Thus, if their expected payoff, if the game reaches the second stage of period , is , then we get

But we know that since the villains will be indifferent as well in the next period (unless ), . In any case, this formula still holds for , since the normal types surrender in period anyway. Thus we get, after substitution,

As expected, this probability goes down as more hostages are executed – after all, there is less of a risk of more future casualties, since there are fewer hostages left – a dark thought, indeed.

(viii) We now derive the probability that the villains execute a hostage in the periods other than the last. The SWAT team is indifferent between maintaining the siege and paying up. Hence if their expected payoff at the beginning of period is , then

But because the SWAT team will also be indifferent between paying up and maintaining the siege in the next period, . Hence

This value is constant! Note that it is decreasing in – if the hostage is more valuable to the SWAT team, then the likelihood that they will kill another doesn’t have to be as high in order to deter the SWAT team from maintaining the siege. Conversely, if the hostage is less valuable, the villains will have to be more likely to kill the hostage to show they mean business.

(ix) Combining (vi) and (viii) gives us the the proportion of crazy types, at the beginning of any period (after the first) in the perfect Bayesian equilibrium will be . Thus, if at period 1, the initial probability that the villains are crazy, , is greater than this amount, then the risk that they are nuts (or wannabe-nuts) is too high, and the SWAT team should fold immediately. Otherwise, they should maintain the siege in the first period, while the villains execute the hostages with the exact probability so that the likelihood that they are nuts, as of the start of period 2, is exactly . Afterwards, the villains follow the strategy given by (vi) and (viii), while the SWAT team follows the strategy given by (vii).

(x) As a final note, we see from (ix) that as , the threshhold for the initial likelihood of craziness necessary to enforce a SWAT team payout goes to 0. This makes sense – there’s a larger potential for more casualties as the number of hostages goes up.

(1) (footnote: though dropping this assumption only slightly changes the outcome. Also, we exclude the possibility of storming the bank, since it’s similar in concept to the other options).

# How to resolve a hostage crisis: Part I

**Posted:**September 18, 2011

**Filed under:**Extensive-Form Games |

**Tags:**bank robbery, crisis, hostages, SWAT team, villains 3 Comments

Suppose an archvillain, with a few lackeys, comes into a bank lookin’ for loot. Knowing that he has the potential to get more out of the bank than merely what’s in the vaults, and knowing that it’s not so simple to just drive away, they decide to hold the innocent civilians in the bank hostage. Unfortunately, Batman is away in Shangri-La for now, so he can’t help you. Spiderman is busy trying to learn how to fly. And the other superheroes just suck. So your only option is to engage in a standoff, with an elite SWAT team standing outside, ready to storm the building if possible/necessary. Meanwhile, the criminals are inside, threatening to kill their hostages unless they get $100 million.

Suppose, for now, that the criminals are completely rational, and this is known to the SWAT team as well. Let’s start with the case where there is only one hostage, and the SWAT team cares about this dude so much that his life is worth $100 million to save. Nonetheless, if the SWAT team refuses to pay the ransom, what are the criminals to do? If they shoot the guy, then there’s nothing to prevent the SWAT team from storming the bank and shooting them dead, or at the very least capturing them, resulting in a long prison term for murder (on top of robbing the bank). This extra penalty makes it worse than not killing the hostage. Thus the SWAT team has no incentive to give in to their demands, as the threat of killing the hostage is not *credible* – the criminals are worse off if they do so.

Now let’s see what happens if there are more hostages. We can use induction to see that the hostage-takers face this predicament, no matter how many hostages are involved. Suppose that, once there are N hostages left, the SWAT team has no reason to give in. We then look at the case with N+1 hostages. If the hostage-takers kill the spare, they are left in a situation in which they automatically lose – they won’t get their ransom, and they’re stuck there until they are forced to surrender. Thus they won’t want to kill the N+1^{th} hostage. We therefore end up with no dead hostages, no matter how menacing the threat.

I know what you’re thinking now: “Yeah right. Why don’t you try this strategy and see what happens? If you do, the hostages will end up DEAD.” And you’re probably right. So where have I gone wrong?

Uncertainty in the number of hostages doesn’t help much here, because the number of hostages will be bounded. We can therefore apply the same induction reasoning as before to the uncertain number of hostages, and once the criminals have claimed to kill the upper bound of the number of people that could possibly have been in the bank, they’re still dead meat. So we’ll have to find some other reason.

The key to my original argument was that the criminals are *rational*. Obviously, that’s not always going to be the case. After all, most rational, normal people do not go around robbing banks. So, chances are pretty good that the people robbing the bank aren’t quite rational, and will kill the hostages even though it ends up hurting them. In this case, it might be worth paying up to prevent the deaths of innocents. We’ll analyze this in part 2, which I will post in a week.