Steinitz exchange lemma
Statement
If spans a vector space and is linearly independent, then : an independent set can never be larger than a spanning set. Moreover, of the can be replaced by so that the resulting set still spans .
Why is it true?
Independent vectors cannot outnumber a spanning set, because each new independent vector can always be "traded in" for one of the spanning vectors without breaking the spanning property — the trade is only blocked once every spanning vector has already been used up, and at that point there is no room left to add another independent vector without contradiction, which is exactly what pins down .
Proof sketch
Argue by induction on , the number of 's exchanged in so far. For the inequality is trivial, and no exchange is needed. Suppose inductively that have already been exchanged in for of the original 's (relabel so these are ), so that still spans .
If already equals , every has been used up, so alone spans ; but then would be a linear combination of , contradicting the linear independence of . So this case cannot occur while is still to be shown for the current — precisely, it shows , i.e. , immediately.
Otherwise , so at least one (among ) remains. Since spans , write as a combination . If every coefficient on the remaining 's were , then would be a combination of alone, again contradicting independence — so some remaining has a nonzero coefficient.
Solve that equation for (dividing by its nonzero coefficient), expressing as a combination of and the other remaining 's. Substituting this expression for wherever it appears shows that together with the remaining 's (minus ) still spans — one more has been successfully exchanged for , completing the inductive step and confirming .
Topics that use this theorem
Step-by-step proofs
No step-by-step proof yet for this theorem.
References
- Sheldon Axler (2015). Linear Algebra Done Right
- Eric W. Weisstein (MathWorld) (2024). Vector Space