MathLabs
TheoremProved

Von Neumann's minimax theorem

Statement

For every m×nm \times n real matrix AA, max⁡x∈Δmmin⁡y∈Δnx⊤Ay=min⁡y∈Δnmax⁡x∈Δmx⊤Ay\max_{x \in \Delta_m} \min_{y \in \Delta_n} x^\top A y = \min_{y \in \Delta_n} \max_{x \in \Delta_m} x^\top A y, where Δm\Delta_m and Δn\Delta_n are the sets of probability vectors of length mm and nn. This common value vv is the value of the game.

Why is it true?

Without randomization, whoever moves "second" (choosing after learning the opponent's strategy) has an advantage, so maximin (row commits first) is generally at most minimax (column commits first). The surprising content of the theorem is that with mixed strategies this gap closes completely: randomizing removes any advantage from acting second, because the opponent can no longer predict — and exploit — a fixed choice.

Proof sketch

Weak duality. For any fixed x0∈Δmx_0 \in \Delta_m and y0∈Δny_0 \in \Delta_n: min⁡yx0⊤Ay≤x0⊤Ay0≤max⁡xx⊤Ay0\min_y x_0^\top A y \le x_0^\top A y_0 \le \max_x x^\top A y_0. Taking max⁡x0\max_{x_0} of the left side and min⁡y0\min_{y_0} of the right side preserves the inequality: max⁡xmin⁡yx⊤Ay≤min⁡ymax⁡xx⊤Ay\max_x \min_y x^\top A y \le \min_y \max_x x^\top A y. This direction needs no randomization argument at all.

Reduction to a linear program. Since y↦x⊤Ayy \mapsto x^\top A y is linear, its minimum over the simplex Δn\Delta_n is attained at a vertex, i.e. at some pure strategy jj: min⁡yx⊤Ay=min⁡j∑i=1mxiAij\min_y x^\top A y = \min_{j} \sum_{i=1}^m x_i A_{ij}. So the row player's problem max⁡xmin⁡yx⊤Ay\max_x \min_y x^\top A y is the linear program: maximize vv subject to ∑i=1mAijxi≥v\sum_{i=1}^m A_{ij} x_i \ge v for every j=1,…,nj = 1, \dots, n, and x∈Δmx \in \Delta_m.

The dual program. By the standard theory of linear programming duality, the dual of this LP is: minimize ww subject to ∑j=1nAijyj≤w\sum_{j=1}^n A_{ij} y_j \le w for every i=1,…,mi = 1, \dots, m, and y∈Δny \in \Delta_n — which is exactly the linear-programming formulation of the column player's problem min⁡ymax⁡xx⊤Ay\min_y \max_x x^\top A y.

Strong duality. Both the primal and dual feasible regions (Δm\Delta_m and Δn\Delta_n) are nonempty and compact, so the linear program is feasible and bounded; the strong duality theorem for linear programming then guarantees the primal and dual optimal values coincide: max⁡xmin⁡yx⊤Ay=min⁡ymax⁡xx⊤Ay\max_x \min_y x^\top A y = \min_y \max_x x^\top A y. Combined with weak duality, which already gave ≤\le in this direction, equality holds, proving the theorem.

Topics that use this theorem

Step-by-step proofs

No step-by-step proof yet for this theorem.

References

  1. John von Neumann, Oskar Morgenstern (1944). Theory of Games and Economic Behavior
  2. John F. Nash Jr. (1950). Equilibrium points in n-person games · DOI:10.1073/pnas.36.1.48
  3. John F. Nash Jr. (1951). Non-Cooperative Games · DOI:10.2307/1969529
  4. Constantinos Daskalakis, Paul W. Goldberg, Christos H. Papadimitriou (2009). The Complexity of Computing a Nash Equilibrium · DOI:10.1137/070699652