Are prediction markets more accurate than polls?
One study found markets beat 74 percent of polls. A 2016 experiment found them 12 percent less accurate than another crowd method. The record is mixed.
Guess first
?
Sometimes, but the honest summary is that the record is mixed. Some studies found prediction markets beating polls, others found them matched or beaten, and the answer depends on the question, the timing and the comparison.
The best-known win for markets comes from US presidential elections. A study of the five contests from 1988 to 2004, by Berg and colleagues, found that prediction markets gave a more accurate estimate of the voting result than 74 percent of the opinion polls studied. Yet Erikson and Wlezien (2008) found that "damped" polls, adjusted before being turned into a forecast, outperformed all markets or models. But a from 2016 found prediction markets 12 percent less accurate than , another way of combining a crowd's probability judgments. And polls weighted by the confidence people expressed in their forecast performed as well as market-based forecasts.
Markets have also had famous misses. They leaned heavily toward the UK staying in the EU in 2016 and failed to predict the outcome, and they also failed to predict the winner of the 2016 US presidential election. One explanation offered is that traders treated the market odds as correct probabilities and did not update enough on outside information.
Timing matters too. Predictions are better for events close in time, and for elections more than a year away, prices are 50 percent. Polls have their own weakness: early in a campaign they are poor measures of voters' future choices. The sensible reading is that markets are another useful input, not an .
Quiz me
0/3
Recap
Compare methods by question, time horizon and measure, because a market can lean on its own odds and miss big turns.
💡 A trick to remember it · Two compasses beat one: check the market against the polls, and the polls against the market.
Surprising fact · One study found markets beat 74 percent of polls, but a 2016 experiment found them 12 percent less accurate than prediction polls.
Connects to
- 🌽 What are the Iowa Electronic Markets, and did they really beat the polls?
- 🎯 What does it mean for a forecast to be well calibrated, and how is it scored?
- 🐋 Why can a prediction market get it wrong?
- 🗳️ How can a poll of a thousand people speak for millions, when one of 2.4 million got it wrong?
- 🗳️ Can you win an election with fewer than half the votes?
- 🔍 Why do we notice only the evidence that proves us right?
- Prediction market
Sources (4)
No source, no claim. Every fact in this lesson (17 claims) cites at least one of these.