Banach fixed-point theorem (contraction mapping theorem)
Statement
Let be a complete metric space and a contraction: for some fixed and all . Then has exactly one fixed point (i.e. ), and starting from any the iterates converge to with the explicit error bound .
Why is it true?
It converts existence-and-uniqueness questions (does this equation have exactly one solution?) into a mechanical, guaranteed-to-converge computation, with a precomputable bound on how many iterations are needed for any target accuracy.
Proof sketch
Step 1 — The iterates form a Cauchy sequence. Fix and set . By the contraction property applied repeatedly, . For , the triangle inequality chains this along the path : , using the geometric series formula since . As , , so this tail bound goes to 0: is Cauchy.
Step 2 — Completeness gives a limit, and continuity makes it a fixed point. Since is complete, the Cauchy sequence converges to some . The contraction inequality shows is (Lipschitz) continuous, so . Thus is a fixed point.
Step 3 — Uniqueness. Suppose and are both fixed points. Then , so . Since , this forces , i.e. .
Step 4 — The error bound. Letting in the Step 1 estimate and using continuity of gives exactly : the distance to the true fixed point after steps shrinks geometrically, and the bound can be computed before running a single iteration.
Topics that use this theorem
Step-by-step proofs
No step-by-step proof yet for this theorem.
References
- Walter Rudin (1976). Principles of Mathematical Analysis
- James Munkres (2000). Topology
- Shaojie Bai, J. Zico Kolter, Vladlen Koltun (2019). Deep Equilibrium Models · arXiv:1909.01377