MathLabs
TheoremProved

Convergence of fixed-point iteration

Statement

Let g:[a,b]→[a,b]g:[a,b]\to[a,b] be continuously differentiable with ∣g′(x)∣≤L<1|g'(x)| \le L < 1 for all x∈[a,b]x\in[a,b]. Then gg has a unique fixed point rr in [a,b][a,b], and for every starting point x0∈[a,b]x_0 \in [a,b] the iteration xn+1=g(xn)x_{n+1}=g(x_n) converges to rr with ∣xn−r∣≤Ln∣x0−r∣|x_n - r| \le L^n |x_0 - r|.

Why is it true?

A slope smaller than one in absolute value means every application of g squeezes points closer together, so no matter where you start, repeated squeezing must collapse the whole interval onto a single point.

Proof sketch

Step 1 (existence via the intermediate value theorem). Let h(x)=g(x)−xh(x)=g(x)-x. Since g(a)∈[a,b]g(a)\in[a,b] we have g(a)≥ag(a)\ge a so h(a)≥0h(a)\ge0, and similarly g(b)≤bg(b)\le b gives h(b)≤0h(b)\le0. Since hh is continuous, the Intermediate Value Theorem gives some rr with h(r)=0h(r)=0, i.e. g(r)=rg(r)=r: a fixed point exists.

Step 2 (uniqueness via the mean value theorem). Suppose r1,r2∈[a,b]r_1,r_2\in[a,b] are both fixed points with r1≠r2r_1\ne r_2. The Mean Value Theorem gives some cc between them with g(r1)−g(r2)=g′(c)(r1−r2)g(r_1)-g(r_2) = g'(c)(r_1-r_2); since g(r1)=r1g(r_1)=r_1 and g(r2)=r2g(r_2)=r_2, this reads r1−r2=g′(c)(r1−r2)r_1-r_2 = g'(c)(r_1-r_2), so ∣r1−r2∣=∣g′(c)∣ ∣r1−r2∣≤L ∣r1−r2∣|r_1-r_2| = |g'(c)|\,|r_1-r_2| \le L\,|r_1-r_2|. Since L<1L<1 and ∣r1−r2∣>0|r_1-r_2|>0, this is a contradiction, so r1=r2r_1=r_2.

Step 3 (contraction at every step). For any xn∈[a,b]x_n\in[a,b], apply the Mean Value Theorem to g(xn)−g(r)g(x_n)-g(r): there is some cnc_n between xnx_n and rr with g(xn)−g(r)=g′(cn)(xn−r)g(x_n)-g(r) = g'(c_n)(x_n-r). Since g(r)=rg(r)=r and xn+1=g(xn)x_{n+1}=g(x_n), the left side is xn+1−rx_{n+1}-r, so ∣xn+1−r∣=∣g′(cn)∣ ∣xn−r∣≤L ∣xn−r∣|x_{n+1}-r| = |g'(c_n)|\,|x_n-r| \le L\,|x_n-r|.

Step 4 (iterate the contraction). Applying Step 3 repeatedly from n=0n=0 gives ∣x1−r∣≤L∣x0−r∣|x_1-r|\le L|x_0-r|, then ∣x2−r∣≤L∣x1−r∣≤L2∣x0−r∣|x_2-r|\le L|x_1-r|\le L^2|x_0-r|, and inductively ∣xn−r∣≤Ln∣x0−r∣|x_n - r| \le L^n |x_0 - r| for every nn. Since 0≤L<10\le L<1, the right side tends to 00 as n→∞n\to\infty, proving xn→rx_n\to r.

Topics that use this theorem

Step-by-step proofs

No step-by-step proof yet for this theorem.