MathLabs

Probability and statistics

Random matrix theory

Studies the statistical behavior of eigenvalues of matrices with random entries, linking to physics and number theory.

IntuitionIntuition: the eigenvalue cloud of a random matrix

Fill an N×NN \times N table with independent random numbers, symmetrize it, and compute its eigenvalues. A single matrix gives an unpredictable list of numbers. But stack up the eigenvalues of thousands of independently drawn random matrices into a histogram, and a smooth, reproducible curve appears every time — a bump shaped like a half-disk. This shape does not depend on whether the entries were Gaussian, uniform, or coin flips: only the mean and variance matter. That stability across wildly different random ingredients, called universality, is the central surprise of random matrix theory.

Downward parabola on [-√2, √2] approximating the silhouette of the Wigner semicircle eigenvalue density.
Wigner's semicircle law ρ(x)=12π4−x2\rho(x) = \frac{1}{2\pi}\sqrt{4-x^2} (red curve) and the empirical eigenvalue histogram (violet bars) of a large symmetric random matrix on [−2,2][-2, 2].

UndergraduateDefinitions: the Gaussian random matrix ensembles

Definition: GOE and GUE

The Gaussian Orthogonal Ensemble (GOE) consists of real symmetric random matrices H=HTH = H^T of size N×NN \times N, whose entries HijH_{ij} are independent Gaussian variables (off-diagonal entries with half the variance of diagonal entries), invariant under conjugation by orthogonal matrices. The Gaussian Unitary Ensemble (GUE) consists of complex Hermitian matrices H=H†H = H^\dagger, with independent complex Gaussian off-diagonal entries and real Gaussian diagonal entries, invariant under conjugation by unitary matrices. In both cases the eigenvalues λ\lambda solve det⁡(H−λI)=0\det(H-\lambda I)=0, and they are always real because HH is symmetric or Hermitian.

ρ(x)=1π2−x2,x∈[−2,2]\rho(x) = \frac{1}{\pi}\sqrt{2-x^2}, \qquad x \in [-\sqrt{2}, \sqrt{2}]

Here ρ(x)\rho(x) is the limiting density of eigenvalues after rescaling them by N\sqrt{N} (so that as N→∞N \to \infty the spread neither shrinks nor blows up), xx is the rescaled eigenvalue position, and the density is supported only on [−2,2][-\sqrt{2}, \sqrt{2}]: no rescaled eigenvalue ever lands outside this interval in the limit. This is the Wigner semicircle law, and it holds for GOE, GUE, and in fact for any Wigner matrix (independent entries with mean 00 and matching variance), regardless of the exact entry distribution.

p(s)=πs2e−πs2/4p(s) = \frac{\pi s}{2} e^{-\pi s^2/4}

Here s≥0s \ge 0 is the spacing between two consecutive eigenvalues after normalizing the local mean spacing to 11, and p(s)p(s) is the probability density of that spacing for the GOE. Because p(s)→0p(s) \to 0 as s→0s \to 0 (indeed p(0)=0p(0)=0), eigenvalues actively avoid sitting next to each other: this level repulsion is the qualitative signature distinguishing random-matrix statistics from independent, Poisson-distributed points, where spacings would cluster near 00 instead.

Comparing the GOE and GUE ensembles
PropertyGOEGUE
Matrix typeReal symmetric, H=HTH = H^TComplex Hermitian, H=H†H = H^\dagger
Symmetry groupOrthogonal O(N)O(N)Unitary U(N)U(N)
Dyson indexβ=1\beta = 1β=2\beta = 2
Wigner surmisep(s)=πs2e−πs2/4p(s) = \frac{\pi s}{2} e^{-\pi s^2/4}p(s)=32π2s2e−4s2/πp(s) = \frac{32}{\pi^2} s^2 e^{-4s^2/\pi}
Level repulsion near s=0s=0Linear, p(s)∼sp(s) \sim sQuadratic, p(s)∼s2p(s) \sim s^2

UndergraduateTwo foundational theorems

As N→∞N \to \infty, the empirical distribution of the rescaled eigenvalues of a Wigner matrix converges (in probability, in distribution) to the density ρ(x)=1π2−x2\rho(x) = \frac{1}{\pi}\sqrt{2-x^2} supported on [−2,2][-\sqrt{2}, \sqrt{2}].

Why is it true?

The trace of a high power of H sums over closed walks on the index set; because entries are independent with mean 0, only walks that traverse each edge an even number of times survive expectation, and counting the dominant surviving walks reduces to a purely combinatorial problem whose answer is the Catalan numbers — exactly the moments of the semicircle distribution.

Proof

Step 1 (target). The moments of the semicircle density ρ(x)=1π2−x2\rho(x) = \frac{1}{\pi}\sqrt{2-x^2} on [−2,2][-\sqrt{2}, \sqrt{2}] are the Catalan numbers: the 2k2k-th moment equals Ck=1k+1(2kk)C_k = \frac{1}{k+1}\binom{2k}{k}, and all odd moments vanish by symmetry. So it suffices to show the moments of the rescaled empirical eigenvalue distribution converge to these same numbers.

Step 2 (expand the trace). Write Tr⁡(H2k)=∑i1,…,i2kHi1i2Hi2i3⋯Hi2ki1\operatorname{Tr}(H^{2k}) = \sum_{i_1,\dots,i_{2k}} H_{i_1 i_2} H_{i_2 i_3} \cdots H_{i_{2k} i_1}, a sum over closed walks of length 2k2k on {1,…,N}\{1,\dots,N\}. Taking expectation and using independence of entries, E[Tr⁡(H2k)]\mathbb{E}[\operatorname{Tr}(H^{2k})] splits into a sum, over ways of pairing up the 2k2k factors, of products of the second moments E[HijHkl]\mathbb{E}[H_{ij}H_{kl}] of each pair (odd-order joint moments vanish for mean-zero, and unpaired factors vanish too since E[Hij]=0\mathbb{E}[H_{ij}]=0).

Step 3 (only non-crossing pairings survive at leading order). Each pairing corresponds to a way of identifying edges of the closed walk; a pairing contributes a factor of NN to a power determined by the number of distinct vertices visited. Counting shows a pairing contributes at order Nk+1N^{k+1} only when the identified edges form a non-crossing (planar) pairing of the 2k2k endpoints; crossing pairings contribute at strictly lower order in NN and vanish after dividing by Nk+1N^{k+1} to normalize.

Step 4 (count and conclude). The number of non-crossing pairings of 2k2k points on a circle is exactly the Catalan number Ck=1k+1(2kk)C_k = \frac{1}{k+1}\binom{2k}{k}. Hence 1NE[Tr⁡((H/N)2k)]→Ck\frac{1}{N}\mathbb{E}[\operatorname{Tr}((H/\sqrt{N})^{2k})] \to C_k as N→∞N \to \infty, matching the moments of ρ(x)=1π2−x2\rho(x) = \frac{1}{\pi}\sqrt{2-x^2} term by term; since the semicircle distribution is determined by its moments, the empirical spectral distribution converges to it.

For a 2×22\times2 GOE matrix, the distribution of the (normalized) eigenvalue gap is exactly p(s)=πs2e−πs2/4p(s) = \frac{\pi s}{2} e^{-\pi s^2/4}; Wigner's heuristic was that this small-matrix formula already captures the qualitative local spacing statistics of the full N×NN\times N GOE for large NN, a claim later confirmed rigorously (to high precision, though not identically) by the exact correlation-function methods of Gaudin and Mehta.

Why is it true?

A 2x2 matrix is the smallest system that has a gap between two eigenvalues at all, and it is small enough to compute the exact joint density of its entries by hand — yet it already contains the essential mechanism (the gap depends on an off-diagonal entry that must vanish for a degenerate eigenvalue, and vanishing is a single extra condition, which is what produces repulsion instead of clustering).

Proof

Step 1 (setup). Let H=(abbc)H = \begin{pmatrix} a & b \\ b & c \end{pmatrix} be a 2×22\times2 GOE matrix with a,ca,c independent standard normal and bb independent normal with variance 12\frac12. Its characteristic polynomial gives eigenvalues λ±=a+c2±s2\lambda_{\pm} = \frac{a+c}{2} \pm \frac{s}{2} where the gap is s=(a−c)2+4b2s = \sqrt{(a-c)^2 + 4b^2}.

Step 2 (change of variables). Set u=a−c2,  v=b2u = \frac{a-c}{\sqrt{2}}, \; v = b\sqrt{2}; a direct check of variances shows uu and vv are independent standard normal variables, and s=u2+v2s = \sqrt{u^2+v^2} exactly, since (a−c)2+4b2=2u2+2v2(a-c)^2+4b^2 = 2u^2+2v^2 simplifies to 2(u2+v2)2(u^2+v^2) after the substitution — so s=2⋅(u2+v2)/2s = \sqrt{2}\cdot\sqrt{(u^2+v^2)/2}, i.e. ss is 2\sqrt{2} times the radius of a standard 2D Gaussian vector.

Step 3 (polar coordinates). The radius r=u2+v2r=\sqrt{u^2+v^2} of a standard 2D Gaussian vector is Rayleigh distributed with density r e−r2/2r\,e^{-r^2/2} (from integrating the joint Gaussian density 12πe−(u2+v2)/2\frac{1}{2\pi}e^{-(u^2+v^2)/2} over the angle, which contributes a factor 2π2\pi, and the Jacobian rr from du dv=r dr dθdu\,dv = r\,dr\,d\theta). Substituting r=s/2r = s/\sqrt2 and using dr=ds/2dr = ds/\sqrt2 turns this into a density c⋅s e−s2/4c\cdot s\, e^{-s^2/4} in ss for some constant cc.

Step 4 (normalize). Fixing cc so that the mean spacing ∫0∞s⋅p(s) ds=1\int_0^\infty s\cdot p(s)\,ds = 1 (the convention used throughout the theory) pins down c=π/2c = \pi/2, giving exactly p(s)=πs2e−πs2/4p(s) = \frac{\pi s}{2} e^{-\pi s^2/4} — matching the claimed formula.

ResearchCurrent research: from matrix eigenvalues to zeta zeros

In 1972, number theorist Hugh Montgomery was studying the spacing of the nontrivial zeros 12+iγn\frac{1}{2} + i\gamma_n of the Riemann zeta function ζ(s)\zeta(s), and showed physicist Freeman Dyson his pair-correlation formula over tea at Princeton. Dyson recognized it instantly: it was the pair-correlation function of GUE eigenvalues. Andrew Odlyzko later computed millions of zeta zeros numerically and confirmed the match to remarkable precision — the Montgomery–Odlyzko law, a conjecture that the local statistics of zeta zeros coincide with GUE eigenvalue statistics.

UndergraduateReal-World Applications and Worked Examples

Random matrix statistics show up whenever a system has many interacting, similarly-scaled random components. In finance, the correlation matrix of hundreds of stock returns is dominated by noise; the Marchenko–Pastur law (a cousin of the semicircle law for correlation-type matrices) tells portfolio managers which eigenvalues carry genuine signal and which are noise to be filtered out before risk estimation. In wireless communications, the capacity of multi-antenna (MIMO) channels is governed by the eigenvalue distribution of random channel matrices. In nuclear and atomic physics, Wigner's original motivation, energy-level spacings of complex nuclei follow the GOE surmise. In ecology, May's random-matrix stability criterion uses the semicircle law's edge to predict when a large food web becomes dynamically unstable. In number theory, as seen above, zeta zero statistics match GUE predictions.

Example: Denoising a financial correlation matrix

A portfolio manager estimates the correlation matrix of N×NN \times N-like return data from N=50N=50 assets over T=200T=200 trading days, giving the aspect ratio q=N/T=0.25q = N/T = 0.25. The Marchenko–Pastur bound for the largest "pure noise" eigenvalue is λmax⁡=(1+q)2\lambda_{\max} = (1+\sqrt{q})^2. One eigenvalue of the sample correlation matrix comes out to λ=3.1\lambda = 3.1. Is that eigenvalue signal or noise?

Solution

First compute the noise bound: with q=0.25q=0.25, λmax⁡=(1+q)2\lambda_{\max} = (1+\sqrt{q})^2 gives λmax⁡=(1+0.25)2=(1+0.5)2=2.25\lambda_{\max} = (1+\sqrt{0.25})^2 = (1+0.5)^2 = 2.25.

This 2.252.25 is the largest eigenvalue a purely random (structureless) correlation matrix with this aspect ratio would ever produce, with high probability, in the large-NN limit.

The observed eigenvalue λ=3.1\lambda = 3.1 exceeds 2.252.25. Since it sits outside the Marchenko–Pastur bulk, it cannot be explained by sampling noise alone: it signals a genuine common factor (for example, a market-wide risk factor) in the data.

In practice, a manager would keep this eigenvalue (and its eigenvector) as a real risk factor, while replacing all eigenvalues below 2.252.25 with a flat noise floor before inverting the matrix for portfolio optimization — this is exactly the eigenvalue-clipping technique used to stabilize covariance estimation.

Example: Computing a spacing probability with the Wigner surmise

Using the GOE Wigner surmise p(s)=πs2e−πs2/4p(s) = \frac{\pi s}{2} e^{-\pi s^2/4}, compute the probability that a normalized level spacing exceeds the mean spacing, i.e. find P(s>1)P(s>1).

Solution

P(s>1)=∫1∞πt2e−πt2/4 dtP(s>1) = \int_1^\infty \frac{\pi t}{2} e^{-\pi t^2/4}\,dt. Substitute u=πt2/4u = \pi t^2/4, so du=πt2 dtdu = \frac{\pi t}{2}\,dt exactly cancels the prefactor, turning the integral into ∫π/4∞e−u du\int_{\pi/4}^\infty e^{-u}\,du.

This elementary integral evaluates to [−e−u]π/4∞=0−(−e−π/4)=e−π/4[-e^{-u}]_{\pi/4}^{\infty} = 0 - (-e^{-\pi/4}) = e^{-\pi/4}.

Numerically, π/4≈0.7854\pi/4 \approx 0.7854, so e−π/4≈0.4559e^{-\pi/4} \approx 0.4559.

So despite level repulsion pushing small spacings down, there is still a substantial (≈45.6%\approx 45.6\%) chance that two consecutive normalized eigenvalues are spaced further apart than the mean — repulsion suppresses very small gaps, it does not make large gaps rare.

According to the Wigner semicircle law ρ(x)=1π2−x2\rho(x) = \frac{1}{\pi}\sqrt{2-x^2}, on which interval is the density supported (after the standard N\sqrt{N} rescaling)?

Why does the Wigner surmise p(s)=πs2e−πs2/4p(s) = \frac{\pi s}{2} e^{-\pi s^2/4} satisfy p(0)=0p(0)=0?

A portfolio manager has N=50N=50 assets, T=200T=200 observations (q=N/T=0.25q = N/T = 0.25), and finds a sample-correlation eigenvalue of 2.02.0. Using λmax⁡=(1+q)2\lambda_{\max} = (1+\sqrt{q})^2, should this eigenvalue be treated as signal or noise?

The Montgomery–Odlyzko law conjectures that the spacing statistics of the nontrivial zeros 12+iγn\frac{1}{2} + i\gamma_n of ζ(s)\zeta(s) match which random matrix ensemble?

References

  1. Alan Edelman, N. Raj Rao (2005). Random matrix theory
  2. Wikipedia contributors (2024). Montgomery's pair correlation conjecture
  3. Wikipedia contributors (2024). Wigner semicircle distribution