MathLabs
TheoremProved

Banach fixed-point theorem (contraction mapping theorem)

Statement

Let (X,d)(X,d) be a complete metric space and T:X→XT: X \to X a contraction: d(T(x),T(y))≤q d(x,y)d(T(x), T(y)) \le q\, d(x,y) for some fixed 0≤q<10 \le q < 1 and all x,y∈Xx,y \in X. Then TT has exactly one fixed point x∗∈Xx^* \in X (i.e. T(x∗)=x∗T(x^*)=x^*), and starting from any x0∈Xx_0 \in X the iterates xn+1=T(xn)x_{n+1}=T(x_n) converge to x∗x^* with the explicit error bound d(xn,x∗)≤qn1−q d(x1,x0)d(x_n, x^*) \le \dfrac{q^n}{1-q}\, d(x_1, x_0).

Why is it true?

It converts existence-and-uniqueness questions (does this equation have exactly one solution?) into a mechanical, guaranteed-to-converge computation, with a precomputable bound on how many iterations are needed for any target accuracy.

Proof sketch

Step 1 — The iterates form a Cauchy sequence. Fix x0∈Xx_0 \in X and set xn=Tn(x0)x_n = T^n(x_0). By the contraction property applied repeatedly, d(xn+1,xn)=d(T(xn),T(xn−1))≤q d(xn,xn−1)≤⋯≤qn d(x1,x0)d(x_{n+1},x_n) = d(T(x_n),T(x_{n-1})) \le q\,d(x_n,x_{n-1}) \le \dots \le q^n\,d(x_1,x_0). For m>nm > n, the triangle inequality chains this along the path xn,xn+1,…,xmx_n, x_{n+1}, \dots, x_m: d(xm,xn)≤∑k=nm−1d(xk+1,xk)≤∑k=nm−1qk d(x1,x0)≤d(x1,x0)∑k=n∞qk=d(x1,x0) qn1−qd(x_m,x_n) \le \sum_{k=n}^{m-1} d(x_{k+1},x_k) \le \sum_{k=n}^{m-1} q^k\,d(x_1,x_0) \le d(x_1,x_0)\sum_{k=n}^{\infty} q^k = d(x_1,x_0)\,\dfrac{q^n}{1-q}, using the geometric series formula since 0≤q<10 \le q < 1. As n→∞n \to \infty, qn→0q^n \to 0, so this tail bound goes to 0: (xn)(x_n) is Cauchy.

Step 2 — Completeness gives a limit, and continuity makes it a fixed point. Since XX is complete, the Cauchy sequence (xn)(x_n) converges to some x∗∈Xx^* \in X. The contraction inequality d(T(x),T(y))≤q d(x,y)d(T(x),T(y)) \le q\,d(x,y) shows TT is (Lipschitz) continuous, so T(x∗)=T(lim⁡nxn)=lim⁡nT(xn)=lim⁡nxn+1=x∗T(x^*) = T(\lim_n x_n) = \lim_n T(x_n) = \lim_n x_{n+1} = x^*. Thus x∗x^* is a fixed point.

Step 3 — Uniqueness. Suppose x∗x^* and y∗y^* are both fixed points. Then d(x∗,y∗)=d(T(x∗),T(y∗))≤q d(x∗,y∗)d(x^*,y^*) = d(T(x^*),T(y^*)) \le q\,d(x^*,y^*), so (1−q) d(x∗,y∗)≤0(1-q)\,d(x^*,y^*) \le 0. Since 1−q>01-q>0, this forces d(x∗,y∗)=0d(x^*,y^*)=0, i.e. x∗=y∗x^*=y^*.

Step 4 — The error bound. Letting m→∞m \to \infty in the Step 1 estimate d(xm,xn)≤qn1−q d(x1,x0)d(x_m,x_n) \le \dfrac{q^n}{1-q}\,d(x_1,x_0) and using continuity of dd gives exactly d(xn,x∗)≤qn1−q d(x1,x0)d(x_n,x^*) \le \dfrac{q^n}{1-q}\,d(x_1,x_0): the distance to the true fixed point after nn steps shrinks geometrically, and the bound can be computed before running a single iteration.

Topics that use this theorem

Step-by-step proofs

No step-by-step proof yet for this theorem.

References

  1. Walter Rudin (1976). Principles of Mathematical Analysis
  2. James Munkres (2000). Topology
  3. Shaojie Bai, J. Zico Kolter, Vladlen Koltun (2019). Deep Equilibrium Models · arXiv:1909.01377