MathLabs
TheoremProved

Spectral theorem for compact self-adjoint operators

Statement

Let TT be a compact self-adjoint operator on a Hilbert space HH. Then there is an orthonormal basis of HH consisting of eigenvectors e1,e2,…e_1,e_2,\dots of TT, with real eigenvalues λ1,λ2,…\lambda_1,\lambda_2,\dots such that λn→0\lambda_n\to0 if HH is infinite-dimensional, and Tx=∑nλn⟨x,en⟩enTx=\sum_n\lambda_n\langle x,e_n\rangle e_n for every x∈Hx\in H.

Why is it true?

It says a compact self-adjoint operator, however complicated it looks, is secretly a diagonal matrix in the right orthonormal basis — exactly as a symmetric matrix in linear algebra is always diagonalizable by an orthonormal eigenbasis. This is what makes it possible to define functions of the operator, solve Tx=yTx=y, and decompose signals or images by their dominant eigen-directions (principal component analysis is this theorem in disguise).

Proof sketch

First, every eigenvalue of a self-adjoint operator is real: if Tx=λxTx=\lambda x with x≠0x\ne0, then λ∥x∥2=⟨Tx,x⟩=⟨x,Tx⟩=λˉ∥x∥2\lambda\|x\|^2=\langle Tx,x\rangle=\langle x,Tx\rangle=\bar\lambda\|x\|^2 (using self-adjointness on the middle step), so λ=λˉ\lambda=\bar\lambda. Similarly, eigenvectors for distinct eigenvalues λ≠μ\lambda\ne\mu are orthogonal: λ⟨x,y⟩=⟨Tx,y⟩=⟨x,Ty⟩=μ⟨x,y⟩\lambda\langle x,y\rangle=\langle Tx,y\rangle=\langle x,Ty\rangle=\mu\langle x,y\rangle forces ⟨x,y⟩=0\langle x,y\rangle=0.

Next, compactness guarantees an eigenvalue of maximal absolute value actually exists: the operator norm satisfies ∥T∥=sup⁡∥x∥=1∣⟨Tx,x⟩∣\|T\|=\sup_{\|x\|=1}|\langle Tx,x\rangle| for self-adjoint TT, and compactness lets one extract a convergent subsequence from a maximizing sequence for ∣⟨Tx,x⟩∣|\langle Tx,x\rangle|, producing a unit vector e1e_1 with Te1=λ1e1Te_1=\lambda_1 e_1 where ∣λ1∣=∥T∥|\lambda_1|=\|T\|.

Now induct: having found orthonormal eigenvectors e1,…,en−1e_1,\dots,e_{n-1} with eigenvalues λ1,…,λn−1\lambda_1,\dots,\lambda_{n-1}, restrict TT to the closed subspace Hn={e1,…,en−1}⊥H_n=\{e_1,\dots,e_{n-1}\}^\perp. Because TT maps HnH_n into itself (self-adjointness makes the orthogonal complement of an invariant subspace invariant too) and remains compact and self-adjoint there, the same maximal-eigenvalue argument produces the next eigenvector en∈Hne_n\in H_n with ∣λn∣≤∣λn−1∣|\lambda_n|\le|\lambda_{n-1}|.

Finally, if this process does not terminate, λn→0\lambda_n\to0: otherwise infinitely many ∣λn∣|\lambda_n| would stay above some δ>0\delta>0, but then {Ten}={λnen}\{Te_n\}=\{\lambda_ne_n\} would have no convergent subsequence (since ∥λnen−λmen∥2≥δ2⋅2\|\lambda_ne_n-\lambda_me_n\|^2\ge\delta^2\cdot2 for n≠mn\ne m by orthonormality), contradicting compactness of TT. One then checks that the closed span of {en}\{e_n\} together with ker⁡T\ker T exhausts HH, and that TT acts as 00 on ker⁡T\ker T, giving the eigen-expansion Tx=∑nλn⟨x,en⟩enTx=\sum_n\lambda_n\langle x,e_n\rangle e_n for all x∈Hx\in H.

Topics that use this theorem

Step-by-step proofs

No step-by-step proof yet for this theorem.

References

  1. Michael Reed, Barry Simon (1980). Methods of Modern Mathematical Physics I: Functional Analysis
  2. John B. Conway (2000). A Course in Operator Theory
  3. Werner Kirsch (2008). An Invitation to Random Schrödinger Operators · arXiv:0709.3707