Game Theory · Chapter 8

Incomplete Information and Bayesian Games

Until now, every player knew the whole game: who was playing, what they could do, and what everyone wanted. Real life is rarely that tidy. The seller knows whether the car is a lemon; you don’t. A rival knows its own costs; you can only guess. Here you’ll run a used-car market where only the sellers know the truth and watch it fall apart, one good car at a time. Then you’ll see how warranties and inspections can rescue it, sort a thousand cars with Bayes’ rule, and outguess a rival whose costs are secret. Along the way you’ll learn John Harsanyi’s trick for turning “I don’t know what game we’re playing” into a game you can solve.

Markets

Live numbers

Missions

    What you’re seeing

    The lot. Forty used cars, worth from the bottom slider’s value up to $10,000 to their owners, spread evenly. Each car’s color is its true quality: red for lemons, gold in the middle, green for peaches. Only its owner knows the color. A buyer sees forty cars that look the same.

    The price. Buyers value every car more than its owner does (1.5 times as much at the start), so every sale would leave both sides better off. But they can’t tell cars apart, so they pay one price for any uncertified car: what the cars that were offered yesterday were worth to buyers, on average. On the first day, they assume the lot is a fair sample of all cars.

    The owners. Each day, every owner picks the best of three options, shown in the bottom-right chart: keep the car (blue line, worth its quality), sell it as is (gold line, the price minus anything a warranty makes them pay), or, if inspections are allowed, pay the fee, prove the quality, and sell for what the car is really worth to a buyer (pink line). Owners of cars worth more than the price drive home, which lowers the average, which lowers tomorrow’s price.

    Gains from trade. Every car that changes hands creates value: a buyer who values it at $6,000 gets it from an owner who values it at $4,000. “Gains kept” compares the value created with the most that could be created if every car sold. An inspection fee is a real cost, so it is subtracted.

    The market for lemons

    In 1970 George Akerlof asked a simple question: why does a car that’s a week old sell for so much less than a new one? It hasn’t worn out. His answer: the person selling a nearly new car knows something you don’t. Owners who discover they bought a lemon are the most eager to sell. Buyers know this, so they discount every used car, which makes owners of good cars unwilling to sell, which makes the average car on offer worse still. Akerlof called this the market for “lemons”. Economists call it adverse selection: the quality of what’s offered depends on the price, and in the wrong direction.

    Here is the logic in symbols. Suppose quality q is spread evenly (uniformly) from 0 to H. An owner values a car at q, a buyer at b q with b > 1. At price p, only owners with q ≤ p sell, so the average quality on offer is p/2. Buyers will pay at most b × p/2. A price that buyers are willing to keep paying must satisfy

    p = b · E[q | q ≤ p] = b p / 2so if b < 2, the only solution is p = 0: the market for anything but the worst cars disappears

    Even though every single sale would create value, almost none happen. Each day of the simulation multiplies the price by b/2, which is 0.75 in Akerlof’s market. If buyers value cars at least twice as much as owners (b ≥ 2), the average car is good enough to pay the best owner’s price, and nothing unravels.

    Worked example: a market that slides partway

    Qualities run evenly from $2,000 to $10,000, and buyers value cars at 1.5 times their owners’ values. Where does the price settle?

    1. At a price p, the cars offered run from $2,000 to p, so their average quality is (2,000 + p)/2.
    2. Buyers pay 1.5 times that: p = 1.5 × (2,000 + p)/2 = 1,500 + 0.75 p.
    3. Solve: 0.25 p = 1,500, so p = $6,000.

    Cars worth $2,000 to $6,000 sell, half of the market. The owners of the best half keep their cars, even though buyers would gladly pay more than those owners’ values if only they could see the quality. Try it: pick “A decent floor”. With only 40 cars, the simulation settles at 22 of 40 (55%); with 2,000 cars in our tests it settled at 50.1%.

    Fixing it: warranties and inspections

    Adverse selection is a problem of hidden information, so the cures make information visible or make lying expensive.

    • Inspection (certification). An owner pays a fee f to prove the car’s quality, then sells it for its full value b q. It’s worth it when b q − f beats both keeping the car and selling it unproven. Good cars certify; the uncertified pool still unravels, but only among the cheap cars left in it. The fee is a real cost, so certifying the very cheapest cars can waste more than it gains.
    • Warranty. Here a warranty with coverage w pays the buyer w(H − q), a share of how far the car falls short of the best. That costs a lemon’s owner a lot and a peach’s owner almost nothing, so the price buyers will pay holds up. With qualities from 0 to H, the market keeps every car exactly when w ≥ 2 − b; for b = 1.5, a warranty covering half of the shortfall is enough. (Problem 4 below works it out.)
    Try this: pick “Inspection” and drag the fee from $0 up to $3,000. At a low fee, nearly every car is certified and almost all the gains survive. As the fee rises, a middle tier of owners finds certifying too expensive and the uncertified market too cheap, so they keep their cars. The readout “Gains kept” falls even though more cars are still worth trading.
    Common mistake: “Sellers of lemons are cheating”

    No one in the simulation lies. Every owner simply refuses to sell for less than the car is worth to them. The market fails because information is unevenly spread and the price can’t depend on what buyers can’t see. Honest people, each acting sensibly, produce the collapse. That’s why the fixes are about institutions (inspections, warranties, return policies, reputations) rather than about better morals.

    Types, beliefs and Harsanyi’s trick

    Games with private information looked hopeless at first. If I don’t know your payoffs, I have to guess them; then I have to guess what you guess about mine, and what you guess I guess about yours, and so on forever. In three papers in 1967 and 1968, John Harsanyi cut this knot. Imagine that before the game starts, a player called Nature draws each player’s private information from a probability distribution that everyone knows. Each player then learns only their own draw, called their type. A game of incomplete information becomes a game of imperfect information: everyone knows the rules, but not every move Nature made.

    Naturehigh cost, θlow cost, 1 − θFirm 2: highFirm 2: lowFirm 1Firm 1can’t tell which

    Following Osborne (An Introduction to Game Theory, chapter 9), a Bayesian game has:

    • a set of players, and for each player a set of actions;
    • a set of states of the world, and a prior probability for each state;
    • for each player, a type (or signal) that depends on the state: what the player observes;
    • for each player, beliefs: given their type, the probabilities they assign to the states, found from the prior by Bayes’ rule;
    • for each player, payoffs that can depend on everyone’s actions and on the state.

    A strategy now says what to do for every type you might be, even the types you know you aren’t. That sounds odd, but your rival needs it: to predict your move, they must think about what each possible version of you would do.

    si(ti) maximizes Σt−i p(t−i | ti) · ui(ai, s−i(t−i); ti, t−i) for every type ti of every player ia Bayesian Nash equilibrium: each type of each player makes a best response, on average over what it believes about the others’ types

    A Bayesian Nash equilibrium is just a Nash equilibrium of the bigger game in which each type is treated as a separate player. Everything from Chapter 3 still applies: no type of any player can gain by changing its action, given the others’ strategies and its own beliefs.

    The common prior. Harsanyi’s setup assumes that all players start from the same prior and differ only in what they have observed. Robert Aumann showed in 1976 how strong that is: if two people share a prior and their posterior beliefs about an event are common knowledge, those posteriors must be equal. People with a common prior can’t “agree to disagree”. Many models in finance and politics drop the common prior on purpose for exactly that reason.

    Bayes’ rule: learning from a signal

    Beliefs change when you see something. If a mechanic’s test flags a car, how likely is it now to be a lemon? Bayes’ rule answers it:

    P(A | B) = P(B | A) P(A) ÷ P(B)posterior = likelihood × prior ÷ the overall chance of the evidence

    The hardest part is the bottom line: the test flags lemons, but it also flags some good cars, and good cars are far more common. The easiest way to see it is to count. Here are 1,000 cars:

    Worked example: the mechanic

    One car in five on a lot is a lemon. A mechanic’s check flags 90% of lemons, and wrongly flags 10% of good cars. The check flags your car. Count 1,000 cars:

    1. 200 are lemons; the check flags 90% of them: 180.
    2. 800 are good; the check flags 10% of them: 80.
    3. Flagged cars: 180 + 80 = 260, of which 180 are lemons. P(lemon | flagged) = 180/260 ≈ 69%.

    And if the check passes the car? 20 lemons among 740 passed cars: under 3%. A good test moves your belief a lot, in both directions.

    Worked example: when the base rate is tiny

    A screening test for a condition that 1 person in 100 has catches 90% of cases and wrongly flags 9% of healthy people. Out of 1,000 people: 10 have the condition and 9 of them test positive; 990 don’t, and about 89 of them test positive anyway. A positive test means about 9 / (9 + 89) ≈ 9%. Most positives are false alarms, because healthy people outnumber sick ones 99 to 1. (This is a made-up example about probability, not medical advice.)

    A Bayesian game: competing against a secret cost

    Two firms sell the same product and choose quantities at the same time, as in Cournot’s model from Chapter 5. The price is P = a − q1 − q2. Firm 1’s cost per unit, c1, is known to both. Firm 2’s cost is private: high (cH) with probability θ, low (cL) otherwise. This is the classic example in Gibbons’s Game Theory for Applied Economists (section 3.1.A).

    Firm 2 has two types, so its strategy is a pair of quantities, q2(cH) and q2(cL). Each type best-responds to firm 1: q2(c) = (a − c − q1)/2. Firm 1 can’t see the type, so it best-responds to the average: q1 = (a − c1 − E[q2])/2. Solving the three equations together:

    q1* = [a − 2c1 + θcH + (1 − θ)cL] / 3
    q2*(cH) = (a − 2cH + c1)/3 + (1 − θ)(cH − cL)/6
    q2*(cL) = (a − 2cL + c1)/3 − θ(cH − cL)/6

    Demand intercept a = 120 and firm 1’s cost c1 = $30 are fixed. Firm 2 chooses without seeing firm 1’s quantity; it plays its equilibrium quantities.

    Worked example: Gibbons’s numbers

    Take a = 120, c1 = 30, cH = 40, cL = 20 and θ = ½.

    1. q1* = (120 − 60 + 20 + 10)/3 = 30.
    2. q2*(cH) = (120 − 80 + 30)/3 + ½ × 20/6 = 23.33 + 1.67 = 25.
    3. q2*(cL) = (120 − 40 + 30)/3 − ½ × 20/6 = 36.67 − 1.67 = 35.
    4. Check: E[q2] = 30, and firm 1’s best response is (120 − 30 − 30)/2 = 30. Each type of firm 2 is on its best-response line: (120 − 40 − 30)/2 = 25 and (120 − 20 − 30)/2 = 35.

    Compare complete information. Against a rival known to be high-cost, firm 1 would make (120 − 60 + 40)/3 = 33.3 and the rival 23.3. Under uncertainty, firm 1 hedges at 30, so the high-cost type faces less competition and expands to 25. The low-cost type is hurt by the same hedging: it makes 35 instead of 36.7.

    Try this: drag firm 1’s quantity across the right chart. The gold curve is the average of the two dashed ones, weighted by θ, and its peak sits exactly at the blue equilibrium dot. Then slide θ from 0% to 100%: the equilibrium dots slide from the green (low-cost) hollow dot toward the red one.

    A little history

    Thomas Bayes (c. 1701–1761), an English minister, worked out how to reason from evidence back to causes. His friend Richard Price found the essay among his papers and published it in the Philosophical Transactions of the Royal Society in 1763. Pierre-Simon Laplace developed the same ideas independently and much further.

    John Harsanyi (1920–2000) survived the Second World War in Budapest, left Hungary in 1950, and rebuilt his career in Australia and then at Berkeley. His three-part paper, “Games with Incomplete Information Played by ‘Bayesian’ Players”, appeared in Management Science in 1967–68. He shared the 1994 Nobel Memorial Prize in Economic Sciences with John Nash and Reinhard Selten.

    George Akerlof wrote “The Market for ‘Lemons’: Quality Uncertainty and the Market Mechanism” as a young professor at Berkeley. In his own account, three journals turned it down, some reviewers finding it too trivial, before the Quarterly Journal of Economics published it in 1970. In 2001 he shared the Nobel prize with Michael Spence and Joseph Stiglitz for their analyses of markets with asymmetric information. You’ll meet Spence’s and Stiglitz’s ideas in Chapter 10.

    Robert Aumann’s “Agreeing to Disagree” (Annals of Statistics, 1976) is only a few pages long and is still argued over. Aumann shared the 2005 Nobel prize with Thomas Schelling.

    Where it shows up

    • Health insurance. If premiums are set for the average person, the healthiest find coverage overpriced and drop out, raising the average cost of those who stay. Economists call the extreme version a “death spiral”, and it’s why many insurance systems pool risks through employers or require broad participation.
    • Lending. A bank that raises its interest rate may drive away its safest borrowers first. Joseph Stiglitz and Andrew Weiss (1981) showed this can make banks ration credit rather than raise rates.
    • Online shopping. Ratings, reviews and generous return policies exist to fight the lemons problem. Zappos sold shoes people couldn’t try on by giving them a year to send them back; see Zappos: Selling Shoes by Selling Happiness.
    • Used cars today. Certified pre-owned programs, vehicle history reports and dealer warranties are the inspection and warranty sliders in real life.
    • Hiring. A firm that cuts wages may lose its best workers first, because they have the best outside offers. Adverse selection is one reason firms are slow to cut pay.

    These are teaching models of how markets work, not advice about insurance, loans or investments.

    Practice

    1. 5% of loan applicants will default. A credit check flags 80% of future defaulters and 10% of everyone else. An applicant is flagged. What is the chance they will default?

    Show the answer

    Count 1,000 applicants: 50 will default and 40 of them are flagged; 950 won’t, and 95 of them are flagged. P(default | flagged) = 40/(40 + 95) = 40/135 ≈ 0.296, about 30%. Most flagged applicants would have repaid.

    2. Car qualities run evenly from $0 to $20,000, and buyers value a car at 1.25 times its owner’s value. Buyers start by paying 1.25 times the average car, then each day pay 1.25 times the average of the cars offered the day before. Find the price on days 0, 1 and 2, and where it ends up.

    Show the answer

    Day 0: 1.25 × $10,000 = $12,500. Owners with cars worth up to $12,500 sell; their average is $6,250, so day 1’s price is 1.25 × $6,250 = $7,812.50. Then cars up to $7,812.50 are offered, averaging $3,906.25, so day 2’s price is $4,882.81. Each day the price is multiplied by 1.25/2 = 0.625, so it heads to $0: the market unravels completely.

    3. Qualities run evenly from $2,000 to $12,000 and b = 1.5. Find the price at which the market settles and the share of cars that trade.

    Show the answer

    At price p, cars from $2,000 to p are offered, with average (2,000 + p)/2. Settling needs p = 1.5(2,000 + p)/2, so 0.25p = 1,500 and p = $6,000. Cars from $2,000 to $6,000 trade: 4,000/10,000 = 40% of the market.

    4. Qualities run evenly from 0 to H. A warranty pays the buyer w(H − q). Show that every car trades exactly when w ≥ 2 − b.

    Show the answer

    An owner sells if p − w(H − q) ≥ q, that is, if q ≤ s = (p − wH)/(1 − w). A buyer values a car at bq + w(H − q); the average over cars from 0 to s is bs/2 + w(H − s/2), which is the price. Put that price back into the cutoff: s′ = s(b − w)/(2(1 − w)). The cutoff shrinks toward 0 if (b − w) < 2(1 − w), that is, if w < 2 − b; otherwise it stays at H and every car trades. With 40 cars instead of a smooth spread, the simulation needs slightly less (48.7% instead of 50% for b = 1.5).

    5. A variant of the coordination game Bach or Stravinsky. Player 1 gets 2 if both choose B, 1 if both choose S, 0 if they miss. Player 2 is one of two types. With probability q she wants to meet: she gets 1 at (B, B), 2 at (S, S), 0 otherwise. With probability 1 − q she wants to avoid player 1: she gets 1 at (B, S), 2 at (S, B), 0 otherwise. For which q is “player 1 plays B; the meeting type plays B; the avoiding type plays S” a Bayesian Nash equilibrium?

    Show the answer

    Given player 1’s B, the meeting type gets 1 from B and 0 from S, so B is best; the avoiding type gets 1 from S and 0 from B, so S is best. Player 1 expects 2q from B (he meets only the meeting type) and 1 × (1 − q) from S (he meets only the avoiding type, who plays S). B is a best response when 2q ≥ 1 − q, so q ≥ 1/3. (Checking the mirror-image profile shows it’s an equilibrium only for q ≥ 2/3, so for q < 1/3 there is no equilibrium in pure strategies.)

    6. In the Cournot game with a = 100, c1 = 10, cH = 25, cL = 10 and θ = ½, find the Bayesian Nash equilibrium, and compare firm 2’s high-cost quantity with what it would make if firm 1 knew its cost.

    Show the answer

    q1* = (100 − 20 + 12.5 + 5)/3 = 32.5. q2*(cH) = (100 − 50 + 10)/3 + ½ × 15/6 = 21.25. q2*(cL) = (100 − 20 + 10)/3 − ½ × 15/6 = 28.75. Check: E[q2] = 25, and (100 − 10 − 25)/2 = 32.5. With complete information against the high-cost type, firm 1 would make (100 − 20 + 25)/3 = 35 and firm 2 would make (100 − 50 + 10)/3 = 20. The high-cost type gains from firm 1’s uncertainty: 21.25 instead of 20.

    7. (Harder) In the general Bayesian Cournot game, show that firm 1’s equilibrium quantity is the same as its complete-information quantity against a rival with the average cost θcH + (1 − θ)cL. Why does averaging work here?

    Show the answer

    Firm 2’s best responses are linear: q2(c) = (a − c − q1)/2, so E[q2] = (a − c̄ − q1)/2 where c̄ is the average cost. Firm 1’s profit is linear in q2, so it only cares about E[q2]. Those are exactly the two equations of a complete-information Cournot game against a rival with cost c̄, whose solution is q1 = (a − 2c1 + c̄)/3. Averaging works because everything is linear; with a curved demand or a firm that dislikes risk, the spread of the cost would matter too.

    How the interactive works

    The lot. The 40 cars sit at the midpoints of 40 equal slices of the range of qualities, so the lot is a smooth spread with no luck involved. On day 0 buyers pay the average value to a buyer of all 40 cars. After that they pay the average value of the uncertified cars offered the day before (if none were offered, they assume the worst car). Every owner then takes the best of keeping the car, selling it as is, and, when allowed, certifying it. The market has settled when no owner changes their mind and the price stops moving.

    What’s simplified. Buyers learn from yesterday’s cars, not instantly; this slow learning is what lets you watch the unraveling, and it ends at the same place an instant equilibrium would. The warranty is a cash payment that grows with the car’s shortfall from the best car, a simple stand-in for repairs that lemons need more often. The inspection is perfect. Real markets have many prices and many kinds of buyers.

    The Bayes tool rounds each count to a whole car. The Cournot game finds the equilibrium by iterating best responses, which here shrink errors by half each round.

    How it was checked (Node.js tests, run before the page was built):

    • Akerlof’s market (b = 1.5, $0 to $10,000): prices $7,500 on day 0 and $5,625 on day 1, as the formula says; after 11 days only the 2 worst cars are left, at $375.
    • The floor ($2,000 to $10,000): the 40-car lot settles with 55% of cars trading; a 2,000-car lot gives 50.1%, against 50% for the smooth model.
    • Smallest warranty that saves every car: 0.795, 0.487 and 0.180 for b = 1.2, 1.5 and 1.8, against 2 − b = 0.80, 0.50 and 0.20 for a smooth spread of cars.
    • Inspection: a $200 fee keeps 92.4% of the gains (38 cars certified); a $2,000 fee splits the market into 24 certified, 2 sold as is and 14 kept, keeping 36% of the gains. At every settled market, no owner can do better by switching choices, and the price equals the average value of the cars offered.
    • Bayes: the mechanic example gives 0.6923 (flagged) and 0.0270 (passed); the screening example gives 0.0917.
    • Cournot: with Gibbons’s numbers the iteration gives 30, 25 and 35, matching the closed form to 10−9; the same holds for θ = 0.1, 0.3, 0.7 and 0.9. A search over every quantity in steps of 0.01 found no profitable deviation for firm 1 or either type of firm 2.

    Check yourself

    1. In Harsanyi’s approach, what is a player’s “type”?

      Show the answer

      Nature draws each player’s private information (costs, values, quality) from a commonly known prior, and each player sees only their own draw. That turns uncertainty about the game into uncertainty about a move by Nature.

    2. Why does the lemons market unravel even though every sale would create value?

      Show the answer

      Owners of good cars have the most to lose from a price based on the average, so they leave first. The average quality falls, so the price falls, and the process repeats. No one has to lie.

    3. One car in ten is a lemon. A test flags every lemon and also 10% of good cars. A car is flagged. Roughly how likely is it to be a lemon?

      Show the answer

      Of 100 cars, 10 lemons are all flagged, and 9 of the 90 good cars are flagged. 10/(10 + 9) ≈ 53%.

    4. In a Bayesian game, a player’s strategy must say:

      Show the answer

      Others can’t see your type, so to predict your behavior they need to know what every possible type of you would do. An equilibrium checks every type’s choice.

    5. In the simulation, raising the inspection fee can lower the gains from trade even while most cars still trade. Why?

      Show the answer

      Proving quality uses up resources, and owners of middling cars find neither certifying nor selling as is worth it, so their cars stay home.

    Sources

    • M. J. Osborne, An Introduction to Game Theory (Oxford University Press, 2004), chapter 9, “Bayesian Games”: definitions and notation used here.
    • R. Gibbons, Game Theory for Applied Economists (Princeton University Press, 1992), section 3.1: the Bayesian Cournot model and its closed form.
    • G. A. Akerlof, “The Market for ‘Lemons’: Quality Uncertainty and the Market Mechanism”, Quarterly Journal of Economics 84(3), 488–500 (1970).
    • J. C. Harsanyi, “Games with Incomplete Information Played by ‘Bayesian’ Players, I–III”, Management Science 14 (1967–68).
    • R. J. Aumann, “Agreeing to Disagree”, Annals of Statistics 4(6), 1236–1239 (1976).
    • J. E. Stiglitz and A. Weiss, “Credit Rationing in Markets with Imperfect Information”, American Economic Review 71(3), 393–410 (1981).
    • MIT OpenCourseWare, 14.12 Economic Applications of Game Theory (Muhamet Yildiz), lecture notes on static games of incomplete information.
    • Penn State STAT 414, Lesson 6, Bayes’ Theorem.
    • OpenStax, Principles of Economics 3e, 16.1 The Problem of Imperfect Information and Asymmetric Information.
    • The Nobel Prize, The Prize in Economic Sciences 2001 and 1994; G. A. Akerlof, “Writing ‘The Market for Lemons’: A Personal and Interpretive Essay” (nobelprize.org, 2003).
    • Wikipedia (secondary): The Market for Lemons, Bayesian game, Thomas Bayes, John Harsanyi.
    Saved on this device only.
    @teddyrookbook GitHub