Can selfish players learn to cooperate?
Cooperation needs a future with no known end. And in 2004 one university won a famous tournament by entering 60 programs that worked as a team.
▶ Start the storyIn theory, yes, as long as they never know which round is the last. Played once, the prisoner's dilemma rewards betrayal: defecting always pays better than cooperating, whatever the other player does. Repetition alone does not fix that. If both players know the game lasts a fixed number of rounds, defecting in every round is still the dominant strategy: one might as well defect on the last turn, since the opponent will not have a chance to retaliate, and the same reasoning then unravels every earlier round. For cooperation to emerge between rational players, the number of rounds must be unknown or infinite. Robert Aumann showed in 1959 that rational players interacting in indefinitely long games can sustain cooperation.
Robert Axelrod's computer tournament, reported in his 1984 book The Evolution of Cooperation, put the idea to the test with programs that varied widely in complexity, initial hostility and capacity for forgiveness. The simplest, tit for tat, won: it cooperates first, then copies the opponent's previous move. After analysing the top scorers, Axelrod stated conditions for success. Besides being nice and forgiving, a winner must retaliate, because always cooperating is a very bad choice that nasty strategies frequently exploit. And it must not be envious: it does not strive to score more than its opponent.
Step 1: Cooperate first
Open with a friendly move
Step 2: Copy their last move
Cooperate if they did, defect if they defected
Step 3: Retaliate once
A defection is answered right away
Step 4: Forgive
If they cooperate again, so do you
The rules around the game matter too. In a 2004 tournament, the University of Southampton submitted 60 programs designed to recognise each other during the first five to ten moves. Once they had, one always cooperated and the other always defected, handing the defector the maximum points. Southampton took the first three places, by taking advantage of the fact that multiple entries were allowed.
So tit for tat is not invincible: it is not always the winner of a given tournament, only better than its rivals over a series of them.
Quiz me
0/3
Recap
Cooperation among self-interested players survives when the game has no known last round and cheating gets answered.
💡 A trick to remember it · Start friendly, answer in kind, forgive quickly: a mirror that smiles first.
Surprising fact · If both players know exactly when the game ends, backwards induction says to defect in every round, so a known last round kills cooperation.
Connects to
- 🍋 Why can a market collapse when only the seller knows the quality?
- ✂️ Why is rock paper scissors a serious piece of mathematics?
- 🦋 How does natural selection actually change a species?
- ♟️ How can you predict what people will do when each one's best move depends on the others?
- 🔒 Why can two smart choices add up to a bad outcome?
Sources (3)
No source, no claim. Every fact in this lesson (27 claims) cites at least one of these.