MathLabs
TheoremProved

Steinitz exchange lemma

Statement

If {v1,…,vm}\{v_1,\dots,v_m\} spans a vector space VV and {w1,…,wk}⊆V\{w_1,\dots,w_k\}\subseteq V is linearly independent, then k≤mk\leq m: an independent set can never be larger than a spanning set. Moreover, kk of the viv_i can be replaced by w1,…,wkw_1,\dots,w_k so that the resulting set still spans VV.

Why is it true?

Independent vectors cannot outnumber a spanning set, because each new independent vector can always be "traded in" for one of the spanning vectors without breaking the spanning property — the trade is only blocked once every spanning vector has already been used up, and at that point there is no room left to add another independent vector without contradiction, which is exactly what pins down k≤mk\leq m.

Proof sketch

Argue by induction on kk, the number of ww's exchanged in so far. For k=0k=0 the inequality 0≤m0\leq m is trivial, and no exchange is needed. Suppose inductively that w1,…,wk−1w_1,\dots,w_{k-1} have already been exchanged in for k−1k-1 of the original viv_i's (relabel so these are v1,…,vk−1v_1,\dots,v_{k-1}), so that {w1,…,wk−1,vk,…,vm}\{w_1,\dots,w_{k-1},v_k,\dots,v_m\} still spans VV.

If k−1k-1 already equals mm, every viv_i has been used up, so {w1,…,wk−1}\{w_1,\dots,w_{k-1}\} alone spans VV; but then wk∈Vw_k\in V would be a linear combination of w1,…,wk−1w_1,\dots,w_{k-1}, contradicting the linear independence of {w1,…,wk}\{w_1,\dots,w_k\}. So this case cannot occur while k≤mk\leq m is still to be shown for the current kk — precisely, it shows k−1<mk-1<m, i.e. k≤mk\leq m, immediately.

Otherwise k−1<mk-1<m, so at least one vjv_j (among vk,…,vmv_k,\dots,v_m) remains. Since {w1,…,wk−1,vk,…,vm}\{w_1,\dots,w_{k-1},v_k,\dots,v_m\} spans VV, write wkw_k as a combination wk=λ1w1+⋯+λk−1wk−1+μ1vj1+⋯+μm−k+1vjm−k+1w_k=\lambda_1w_1+\cdots+\lambda_{k-1}w_{k-1}+\mu_1v_{j_1}+\cdots+\mu_{m-k+1}v_{j_{m-k+1}}. If every coefficient μ1,…\mu_1,\dots on the remaining vv's were 00, then wkw_k would be a combination of w1,…,wk−1w_1,\dots,w_{k-1} alone, again contradicting independence — so some remaining vjv_j has a nonzero coefficient.

Solve that equation for vjv_j (dividing by its nonzero coefficient), expressing vjv_j as a combination of w1,…,wkw_1,\dots,w_k and the other remaining vv's. Substituting this expression for vjv_j wherever it appears shows that {w1,…,wk}\{w_1,\dots,w_k\} together with the remaining vv's (minus vjv_j) still spans VV — one more vv has been successfully exchanged for wkw_k, completing the inductive step and confirming k≤mk\leq m.

Topics that use this theorem

Step-by-step proofs

No step-by-step proof yet for this theorem.

References

  1. Sheldon Axler (2015). Linear Algebra Done Right
  2. Eric W. Weisstein (MathWorld) (2024). Vector Space