Analysis
Harmonic analysis
Decomposes functions and signals into basic waves, generalizing Fourier series to broader settings.
IntuitionFrom waves to frequencies
Any sound you hear — a violin note, a voice, traffic noise — is really a single wiggling pressure signal over time. Yet your ear (and a graphic equalizer) can tell you it is made of many pure tones at different pitches. Harmonic analysis is the mathematics of that splitting: it takes a function and rewrites it as a sum or integral of pure oscillations , each with its own frequency . Fourier series does this for periodic signals using a discrete list of frequencies; harmonic analysis extends the idea to non-periodic signals, higher dimensions, and even other groups (the circle, finite groups, Lie groups).
UndergraduateFourier series on the circle: the convergence question
Write the -th partial sum of the Fourier series of a periodic function as , where . In everything is clean: the exponentials form an orthonormal basis, Parseval's identity holds, and in the norm. The hard question is pointwise convergence: does at a specific point ? The square wave shown above already hints at the trouble — near its jump, always overshoots by about 9% of the jump height, no matter how large is (the Gibbs phenomenon, with the overshoot tending to times the half-jump).
Definition: Dirichlet kernel
The partial sum is itself a convolution: , where the Dirichlet kernel is . Every convergence question is therefore really a question about the shape of .
The Fejér kernel (the Cesàro average of ) and the Poisson kernel are both nonnegative, so they are honest approximate identities: mass , norm , and mass concentrating at as (or ) — enough to force and uniformly for every continuous . The Dirichlet kernel is not: its negative lobes make (the Lebesgue constant) grow like , unbounded as . By the Banach–Steinhaus uniform boundedness principle, unbounded Lebesgue constants force the existence of a continuous function whose Fourier series diverges at a point — exactly the phenomenon du Bois-Reymond exhibited by hand in 1873, obtained here for free. Kolmogorov later showed the failure can be far worse for merely integrable functions: in 1923 he built an function whose Fourier series diverges almost everywhere, and in 1926 one that diverges everywhere.
If is continuous and -periodic, then the Cesàro means converge to uniformly as .
Why is it true?
Averaging the partial sums cancels exactly the oscillation that makes misbehave: while has wild negative lobes, its running average is a smooth, nonnegative bump that only ever adds up pieces of with a positive weight. So even though can fail to converge, its running average always settles down — the same trick that tames a jittery sequence of partial sums in calculus by looking at its Cesàro average instead.
Proof
Step 1 (Fejér kernel is a positive approximate identity). Averaging and using a telescoping trigonometric identity gives the closed form . Since and for every , also ; being nonnegative, too, so the norm never blows up.
Step 2 (mass concentrates at ). For any fixed , on the denominator is bounded below by a positive constant, so uniformly there; the mass outside tends to as .
Step 3 (approximate-identity estimate). Write using . Split the integral into and . On the first piece, uniform continuity of makes for small, and with total mass bounds that piece by . On the second piece, and is bounded, so that piece as . Both bounds are uniform in , so uniformly.
If , then for almost every . (Hunt, 1968, extended this to every with .)
Why is it true?
Given Kolmogorov's 1926 example of an function that diverges everywhere, it seemed entirely plausible that — barely a stronger condition — would fail the same way, or at least almost everywhere. Carleson's theorem is a genuine surprise: the tiny extra assumption of square-integrability rules out divergence everywhere except a set of measure zero. It closed a problem that had been open since Luzin conjectured it in 1913, and is regarded as one of the deepest theorems of twentieth-century analysis.
Proof
A full proof is one of the hardest arguments in twentieth-century analysis; Fefferman gave a celebrated simplification in 1973 whose strategy can be sketched in three moves.
Step 1 (control by a maximal operator). It suffices to bound the Carleson maximal operator on , since a weak-type bound on plus density of nice functions (for which convergence is easy) implies the full a.e. convergence statement.
Step 2 (time–frequency decomposition into tiles). Decompose using wave packets adapted to dyadic tiles in the time–frequency plane — rectangles of area , exactly the atoms discussed in the 'Time and frequency' section below. Each tile carries a piece of localized to both a time interval and a frequency band.
Step 3 (organize tiles into trees and sum). Because the cutoff frequency can vary with , tiles relevant to form 'trees' ordered by time-frequency containment. Fefferman's key combinatorial estimate bounds the total energy carried by all trees, controlling in and completing the proof.
The technique that finally cracked Carleson's theorem — organizing time–frequency tiles into trees — turns out to be a general-purpose tool used elsewhere in modern harmonic analysis (for instance, the same style of argument settled a Calderón open problem about the bilinear Hilbert transform in 1997, via Lacey and Thiele).
UndergraduateThe Fourier transform on the real line
Definition: Fourier transform
For an integrable function on , its Fourier transform records how much of each pure frequency is present in . It is defined by , where the exponential is a unit-length spinning vector; multiplying by it and integrating measures the correlation of with that spin rate.
When is itself integrable, the original signal can be rebuilt exactly by summing all those pure frequencies back up: . This inversion formula is the precise sense in which 'a function equals the sum of its frequency components.'
| Setting | Domain of the signal | Frequency side | Key identity |
|---|---|---|---|
| Fourier series | Circle / period | Integers | Discrete sum of harmonics |
| Fourier transform | Real line | Real line | |
| Poisson summation | Real line, sampled at | Integers |
AdvancedKey theorems
If , then . In words: the Fourier transform preserves total energy, with no constant needed in this normalization.
Why is it true?
Physically, is the energy of a signal (think: power dissipated by a voltage waveform). Plancherel says you can compute that energy either by scanning the signal in time or by scanning its spectrum in frequency — a spectrum analyzer and an oscilloscope must agree on total power.
Proof
Step 1 (a special case). First check the identity for a Gaussian . A direct computation (completing the square in the exponent) gives , so both sides of equal the same Gaussian integral .
Step 2 (extend by linearity and the convolution theorem). For nice (Schwartz) functions , write where ; then , and by the convolution theorem together with Fourier inversion, . This proves the identity for all Schwartz functions, which include Gaussians and all smooth rapidly-decaying functions.
Step 3 (density argument). Schwartz functions are dense in : every is a limit of Schwartz functions in the norm. Since the Fourier transform is an isometry on this dense subspace by Step 2, it extends uniquely to a bounded operator on all of that still satisfies — this extension is what 'the Fourier transform of an function' means when the defining integral may not converge absolutely.
For a Schwartz function , : summing the function over all integers equals summing its Fourier transform over all integers.
Why is it true?
It is the bridge between sampling a signal at integer points and periodizing its spectrum: the left side is what you get by adding up samples , the right side is what you get from the spectrum. This single identity underlies the sampling theorem, lattice sums in crystallography, and the functional equation of theta functions and the Riemann zeta function.
Proof
Step 1 (periodize). For a Schwartz function , define . Rapid decay of makes this sum converge absolutely and uniformly, and is a smooth function with period 1, so it has its own Fourier series on the circle.
Step 2 (compute the Fourier coefficients of the periodization). The -th Fourier coefficient of is . Substituting in each term and using periodicity of in reassembles the pieces into a single integral over all of : .
Step 3 (evaluate at x=0). Since is smooth, its Fourier series converges to it pointwise, in particular at : , i.e. . The left side is literally by definition, which finishes the proof.
AdvancedThe Hilbert transform: the first singular integral
Convolving against a kernel that is merely bounded and integrable — like the Poisson or Fejér kernel above — is tame. Some of the most important operators in analysis instead convolve against a kernel with a genuine singularity at the origin, not integrable near and redeemed only by a delicate cancellation between its positive and negative parts. The prototype is the Hilbert transform on the real line, , understood as a principal value: the singularity at is excised symmetrically before the limit is taken. In frequency, this singular convolution turns into strikingly simple multiplication: — the Hilbert transform is a pure phase rotation of every frequency, flipping the sign of without changing magnitude.
There is a second, classical way to see this: for defined on the real line, let be its harmonic extension to the upper half-plane (convolution with the Poisson kernel from the earlier section), and let be its harmonic conjugate, built from the conjugate Poisson kernel so that is a holomorphic function of . As , the boundary value of recovers exactly the Hilbert transform of . This is the complex-analytic ancestor of the whole theory: a singular integral operator on the boundary is really the shadow of an honest holomorphic function living one dimension up.
The Hilbert transform is bounded on for every : there is a constant so that for every . (Marcel Riesz, 1927.)
Why is it true?
The case is essentially free: the multiplier has modulus exactly almost everywhere, so is literally an isometry on by Plancherel — a phase rotation of every frequency changes nothing about total energy. But extending boundedness to other is a genuinely different and much harder problem: there is no analogue of Parseval's identity outside , so no algebraic shortcut is available, and the proof has to fall back on real-variable estimates about the size and geometry of the set where is large.
Proof
Step 1 (, directly). By Plancherel and the multiplier formula, , using for (a single point does not affect the integral). So is an isometry on , in particular bounded with .
Step 2 (general , forward reference). The full range of exponents does not follow from Step 1 by any soft argument. It is a genuine theorem of real-variable Calderón–Zygmund theory: the Hilbert transform's kernel satisfies exactly the smoothness and cancellation conditions of a Calderón–Zygmund kernel, so the general singular-integral machinery developed in the next section applies to it. That machinery produces a weak-type bound from the bound proved in Step 1, and Marcinkiewicz interpolation between the weak- bound and the bound (then a duality argument for ) completes the proof for every — this half of the argument is carried out in full in the Calderón–Zygmund section immediately below, rather than repeated here.
Example: The Hilbert transform of an indicator function
Let , the indicator of : a bounded, compactly supported, utterly unremarkable function. Compute .
Solution
By definition, . Away from there is no singularity to excise, and the antiderivative of in is , so (for inside the same computation goes through as a genuine principal value, since the two divergences at and cancel). This gives .
The striking feature is what happens at : itself is perfectly bounded there (it simply jumps from to ), yet blows up logarithmically at exactly those two points. A bounded, compactly supported, textbook-nice function is turned by into a function with two genuine singularities — this is the local signature of every singular integral operator, and it is exactly why controlling requires more delicate estimates than controlling a convolution with a nice bounded kernel.
AdvancedThe Hardy–Littlewood maximal function and the Calderón–Zygmund decomposition
To finish M. Riesz's theorem for a general singular integral operator — not just the Hilbert transform — analysts needed a purely real-variable tool that says nothing about Fourier transforms at all. Hardy and Littlewood introduced it in 1930: the maximal function , the largest possible average of over any interval centered at . It is a blunt but extremely effective instrument for controlling every averaging process that could ever be applied to near , all at once.
is of weak type : for a universal constant (one can always take ). Consequently, by interpolation, is also bounded on for every — but itself is never bounded on .
Why is it true?
bounds, in one stroke, every average of that could ever be taken over an interval around — the running mean at every possible scale. Controlling that single quantity turns out to be exactly what is needed to prove the Lebesgue differentiation theorem (the average of over shrinking intervals around converges to for almost every ): once is known to be finite almost everywhere, a short soft argument upgrades that to the full differentiation statement. This is the real-variable engine behind the Calderón–Zygmund theory below, playing the role that Plancherel's identity played for the easy estimate.
Proof
Step 1 (a cover by good balls). Fix . For every with , by definition of the supremum there is some interval centered at with . These balls cover the set .
Step 2 (Vitali -covering lemma). From any collection of balls of bounded radius, one can always extract a countable disjoint subcollection such that the -times dilated balls still cover the union of the whole original collection. Apply this to to get a disjoint subfamily with .
Step 3 (sum the disjoint pieces). Each satisfies by construction. Since the are pairwise disjoint, summing over gives , so . Finally , which is exactly .
Definition: Calderón–Zygmund decomposition
Given and a height , Calderón and Zygmund (1952) showed how to split the line into disjoint 'stopping' dyadic intervals adapted to and : start from one large dyadic interval, and recursively bisect it, stopping and keeping a dyadic interval the very first time its average exceeds (its parent's average was still , so bisecting can at most double it). This produces a disjoint family of stopping intervals with , with total length , and with almost everywhere on what remains outside .
The decomposition splits into a 'good' part and infinitely many 'bad' pieces, : the good part equals outside all the and equals the (roughly -sized) average of on each where it is kept, so everywhere and is handled by the easy theory. Each bad piece is supported on its own cube and has mean zero there, — that cancellation is exactly what lets a smooth kernel's contribution from stay small once you are far enough from , since the kernel looks nearly constant across and a nearly-constant kernel integrates a mean-zero function to almost nothing. Combining this good–bad split with the weak-type Hardy–Littlewood maximal bound, through Marcinkiewicz interpolation, is exactly the real-variable machinery Calderón and Zygmund used to finish M. Riesz's theorem for general singular integral operators — not just the Hilbert transform — extending boundedness to every , closing the loop back to the theorem above.
UndergraduateReal-World Applications and Worked Examples
Because the Fourier transform turns 'shape in time' into 'content in frequency,' it is the standard tool wherever engineers or scientists need to isolate, filter, or count oscillations: audio equalizers, MRI and radio-telescope imaging, and the heat and wave equations of physics.
Example: Filtering hiss out of a recording
A microphone records : a 440 Hz musical note (A4) mixed with a 3000 Hz electronic hiss. An engineer applies an ideal low-pass filter that sets whenever . What signal comes out?
Solution
Each cosine is a sum of two pure spinning exponentials at frequencies : in the frequency domain, has energy concentrated only at and (as spikes in ).
The filter keeps everything with and kills the rest. Since but , the spikes at are removed while the spikes at survive untouched.
Applying the inversion formula to what remains reconstructs exactly the surviving frequencies: the output is , the clean musical note with the hiss gone. This is literally how a graphic equalizer's low-pass knob works.
Example: Why heat spreads out: solving the heat equation
A rod has initial temperature profile and obeys the heat equation . Use the Fourier transform (in ) to find for .
Solution
Taking the Fourier transform in turns each spatial derivative into multiplication by , so becomes . The PDE becomes the ordinary differential equation in for each fixed — a huge simplification, since a hard PDE became an easy family of decoupled ODEs.
This ODE has solution , an exponentially decaying factor that kills high frequencies fast: fine spatial detail smooths out quickly, which matches the everyday fact that sharp temperature spikes flatten out first.
Inverting the transform (a product in frequency is a convolution in space, by the convolution theorem run in reverse) gives : the temperature at time is the initial profile smeared out (convolved) against a spreading Gaussian bump — literally the mathematical picture of heat diffusing.
Definition: Uncertainty principle
A function cannot be sharply localized in both time and frequency at once. If and measure the spread of and respectively, then . Squeezing a pulse in time (small ) forces its spectrum to spread out (large ), and vice versa — the same trade-off used to derive Heisenberg's uncertainty principle in quantum mechanics.
Under the convention , the Fourier transform of the Gaussian is:
Plancherel's theorem, , is best described as a statement of:
An MRI machine measures samples of a spatial signal's Fourier transform ('k-space'). If only the low-frequency samples ( small) are collected, the reconstructed image will be:
The uncertainty principle implies that:
Fejér's theorem says the Cesàro means converge uniformly to any continuous . Carleson's theorem is a separate, much deeper statement about:
By M. Riesz's theorem, the Hilbert transform is bounded on exactly for:
References
- Terence Tao (2003). Recent progress on the restriction conjecture · arXiv:math/0311181
- Elias M. Stein, Guido Weiss (1971). Introduction to Fourier Analysis on Euclidean Spaces
- Loukas Grafakos (2014). Classical Fourier Analysis · DOI:10.1007/978-1-4939-1194-3