Probability and statistics
Random matrix theory
Studies the statistical behavior of eigenvalues of matrices with random entries, linking to physics and number theory.
IntuitionIntuition: the eigenvalue cloud of a random matrix
Fill an table with independent random numbers, symmetrize it, and compute its eigenvalues. A single matrix gives an unpredictable list of numbers. But stack up the eigenvalues of thousands of independently drawn random matrices into a histogram, and a smooth, reproducible curve appears every time — a bump shaped like a half-disk. This shape does not depend on whether the entries were Gaussian, uniform, or coin flips: only the mean and variance matter. That stability across wildly different random ingredients, called universality, is the central surprise of random matrix theory.
UndergraduateDefinitions: the Gaussian random matrix ensembles
Definition: GOE and GUE
The Gaussian Orthogonal Ensemble (GOE) consists of real symmetric random matrices of size , whose entries are independent Gaussian variables (off-diagonal entries with half the variance of diagonal entries), invariant under conjugation by orthogonal matrices. The Gaussian Unitary Ensemble (GUE) consists of complex Hermitian matrices , with independent complex Gaussian off-diagonal entries and real Gaussian diagonal entries, invariant under conjugation by unitary matrices. In both cases the eigenvalues solve , and they are always real because is symmetric or Hermitian.
Here is the limiting density of eigenvalues after rescaling them by (so that as the spread neither shrinks nor blows up), is the rescaled eigenvalue position, and the density is supported only on : no rescaled eigenvalue ever lands outside this interval in the limit. This is the Wigner semicircle law, and it holds for GOE, GUE, and in fact for any Wigner matrix (independent entries with mean and matching variance), regardless of the exact entry distribution.
Here is the spacing between two consecutive eigenvalues after normalizing the local mean spacing to , and is the probability density of that spacing for the GOE. Because as (indeed ), eigenvalues actively avoid sitting next to each other: this level repulsion is the qualitative signature distinguishing random-matrix statistics from independent, Poisson-distributed points, where spacings would cluster near instead.
| Property | GOE | GUE |
|---|---|---|
| Matrix type | Real symmetric, | Complex Hermitian, |
| Symmetry group | Orthogonal | Unitary |
| Dyson index | ||
| Wigner surmise | ||
| Level repulsion near | Linear, | Quadratic, |
UndergraduateTwo foundational theorems
As , the empirical distribution of the rescaled eigenvalues of a Wigner matrix converges (in probability, in distribution) to the density supported on .
Why is it true?
The trace of a high power of H sums over closed walks on the index set; because entries are independent with mean 0, only walks that traverse each edge an even number of times survive expectation, and counting the dominant surviving walks reduces to a purely combinatorial problem whose answer is the Catalan numbers — exactly the moments of the semicircle distribution.
Proof
Step 1 (target). The moments of the semicircle density on are the Catalan numbers: the -th moment equals , and all odd moments vanish by symmetry. So it suffices to show the moments of the rescaled empirical eigenvalue distribution converge to these same numbers.
Step 2 (expand the trace). Write , a sum over closed walks of length on . Taking expectation and using independence of entries, splits into a sum, over ways of pairing up the factors, of products of the second moments of each pair (odd-order joint moments vanish for mean-zero, and unpaired factors vanish too since ).
Step 3 (only non-crossing pairings survive at leading order). Each pairing corresponds to a way of identifying edges of the closed walk; a pairing contributes a factor of to a power determined by the number of distinct vertices visited. Counting shows a pairing contributes at order only when the identified edges form a non-crossing (planar) pairing of the endpoints; crossing pairings contribute at strictly lower order in and vanish after dividing by to normalize.
Step 4 (count and conclude). The number of non-crossing pairings of points on a circle is exactly the Catalan number . Hence as , matching the moments of term by term; since the semicircle distribution is determined by its moments, the empirical spectral distribution converges to it.
For a GOE matrix, the distribution of the (normalized) eigenvalue gap is exactly ; Wigner's heuristic was that this small-matrix formula already captures the qualitative local spacing statistics of the full GOE for large , a claim later confirmed rigorously (to high precision, though not identically) by the exact correlation-function methods of Gaudin and Mehta.
Why is it true?
A 2x2 matrix is the smallest system that has a gap between two eigenvalues at all, and it is small enough to compute the exact joint density of its entries by hand — yet it already contains the essential mechanism (the gap depends on an off-diagonal entry that must vanish for a degenerate eigenvalue, and vanishing is a single extra condition, which is what produces repulsion instead of clustering).
Proof
Step 1 (setup). Let be a GOE matrix with independent standard normal and independent normal with variance . Its characteristic polynomial gives eigenvalues where the gap is .
Step 2 (change of variables). Set ; a direct check of variances shows and are independent standard normal variables, and exactly, since simplifies to after the substitution — so , i.e. is times the radius of a standard 2D Gaussian vector.
Step 3 (polar coordinates). The radius of a standard 2D Gaussian vector is Rayleigh distributed with density (from integrating the joint Gaussian density over the angle, which contributes a factor , and the Jacobian from ). Substituting and using turns this into a density in for some constant .
Step 4 (normalize). Fixing so that the mean spacing (the convention used throughout the theory) pins down , giving exactly — matching the claimed formula.
ResearchCurrent research: from matrix eigenvalues to zeta zeros
In 1972, number theorist Hugh Montgomery was studying the spacing of the nontrivial zeros of the Riemann zeta function , and showed physicist Freeman Dyson his pair-correlation formula over tea at Princeton. Dyson recognized it instantly: it was the pair-correlation function of GUE eigenvalues. Andrew Odlyzko later computed millions of zeta zeros numerically and confirmed the match to remarkable precision — the Montgomery–Odlyzko law, a conjecture that the local statistics of zeta zeros coincide with GUE eigenvalue statistics.
UndergraduateReal-World Applications and Worked Examples
Random matrix statistics show up whenever a system has many interacting, similarly-scaled random components. In finance, the correlation matrix of hundreds of stock returns is dominated by noise; the Marchenko–Pastur law (a cousin of the semicircle law for correlation-type matrices) tells portfolio managers which eigenvalues carry genuine signal and which are noise to be filtered out before risk estimation. In wireless communications, the capacity of multi-antenna (MIMO) channels is governed by the eigenvalue distribution of random channel matrices. In nuclear and atomic physics, Wigner's original motivation, energy-level spacings of complex nuclei follow the GOE surmise. In ecology, May's random-matrix stability criterion uses the semicircle law's edge to predict when a large food web becomes dynamically unstable. In number theory, as seen above, zeta zero statistics match GUE predictions.
Example: Denoising a financial correlation matrix
A portfolio manager estimates the correlation matrix of -like return data from assets over trading days, giving the aspect ratio . The Marchenko–Pastur bound for the largest "pure noise" eigenvalue is . One eigenvalue of the sample correlation matrix comes out to . Is that eigenvalue signal or noise?
Solution
First compute the noise bound: with , gives .
This is the largest eigenvalue a purely random (structureless) correlation matrix with this aspect ratio would ever produce, with high probability, in the large- limit.
The observed eigenvalue exceeds . Since it sits outside the Marchenko–Pastur bulk, it cannot be explained by sampling noise alone: it signals a genuine common factor (for example, a market-wide risk factor) in the data.
In practice, a manager would keep this eigenvalue (and its eigenvector) as a real risk factor, while replacing all eigenvalues below with a flat noise floor before inverting the matrix for portfolio optimization — this is exactly the eigenvalue-clipping technique used to stabilize covariance estimation.
Example: Computing a spacing probability with the Wigner surmise
Using the GOE Wigner surmise , compute the probability that a normalized level spacing exceeds the mean spacing, i.e. find .
Solution
. Substitute , so exactly cancels the prefactor, turning the integral into .
This elementary integral evaluates to .
Numerically, , so .
So despite level repulsion pushing small spacings down, there is still a substantial () chance that two consecutive normalized eigenvalues are spaced further apart than the mean — repulsion suppresses very small gaps, it does not make large gaps rare.
According to the Wigner semicircle law , on which interval is the density supported (after the standard rescaling)?
Why does the Wigner surmise satisfy ?
A portfolio manager has assets, observations (), and finds a sample-correlation eigenvalue of . Using , should this eigenvalue be treated as signal or noise?
The Montgomery–Odlyzko law conjectures that the spacing statistics of the nontrivial zeros of match which random matrix ensemble?
References
- Alan Edelman, N. Raj Rao (2005). Random matrix theory
- Wikipedia contributors (2024). Montgomery's pair correlation conjecture
- Wikipedia contributors (2024). Wigner semicircle distribution