Probability and statistics
Brownian motion and stochastic calculus
A continuous random process modeling erratic motion, with a calculus of its own used in finance and physics.
IntuitionWhy does a speck of pollen dancing in water need its own kind of calculus?
In 1827 the botanist Robert Brown watched pollen grains suspended in water under a microscope and saw them jitter endlessly, changing direction at every instant with no pattern he could discern. The explanation, only understood decades later, is that each grain is being bombarded from all sides by billions of invisible water molecules per second, and the net random kick at each moment nudges the grain a little further in a completely unpredictable direction. Brownian motion is the mathematical idealization of this endless, directionless jitter: a random path that is continuous — it never jumps — yet so jagged that it has no well-defined velocity at any instant, ever. That single fact, that the path is continuous but nowhere smooth, is what forces mathematicians to build an entirely new calculus, since ordinary calculus assumes you can zoom in on a curve and see it look like a straight line.
The distribution curve above describes where a particle may be at one fixed time. A two-dimensional Brownian motion uses two independent copies of this process; with time as a third coordinate, one sample becomes a jagged space-time path.
UndergraduateThe Wiener process: a rigorous definition
Definition: Standard Wiener process (Brownian motion)
A standard Wiener process (or Brownian motion) is a continuous-time stochastic process such that: (1) almost surely; (2) it has independent increments — for any , the increments are mutually independent; (3) each increment is normally distributed, for ; and (4) almost every sample path is continuous. Property (3) alone already forces the process to look identical in distribution at every time scale — this self-similarity is why Brownian motion appears as the universal limit of so many different discrete random walks.
A defining, almost paradoxical feature of Brownian paths is their quadratic variation: summing the squared increments of over a fine partition of converges (in probability) to itself, , no matter how fine the partition — the squared wiggles never vanish, they accumulate to exactly . Compare this to any ordinary differentiable function , whose quadratic variation over any interval is always , since its increments shrink like rather than . This single difference in scaling — Brownian increments are of order , not — is the root cause of everything unusual about stochastic calculus.
| Aspect | Smooth function | Brownian path |
|---|---|---|
| Differentiability | Differentiable, tangent line exists | Nowhere differentiable, no tangent anywhere |
| Increment size over | Order | Order |
| Quadratic variation on | (never zero) | |
| Chain rule for | Needs an extra second-derivative term (Itô's lemma) |
For a standard Wiener process and any , where the sum is over a partition of whose mesh tends to , the limit holding in probability (in fact almost surely along dyadic partitions). Consequently, almost every sample path is differentiable at no point .
Why is it true?
This is the theorem that makes stochastic calculus necessary in the first place: it rules out treating as an ordinary infinitesimal the way is treated in classical calculus, and it justifies the heuristic rule that drives Itô's lemma below.
Proof
Quadratic variation. Partition into equal pieces of length and let . Each term has mean (since the increment is ) and, using the fourth moment of a normal variable, variance . Summing independent such terms, exactly and as , so in probability (and mean square) — this proves the quadratic variation identity.
Nowhere differentiability. Suppose, for contradiction, that were differentiable at some point with derivative finite. Then for small , , so the squared increment over a tiny interval of length would be of order — but the quadratic variation computation above shows the typical squared increment over an interval of length is of order (much larger than for small ), and summing these order- terms over intervals is exactly what produces a total that converges to the finite, positive number rather than to .
This mismatch — differentiability would force quadratic variation to be , but it is provably — is irreconcilable, so no point of differentiability can exist; a full measure-theoretic argument (due to Paley, Wiener and Zygmund in 1933) makes this rigorous by directly bounding the probability that any difference quotient stays bounded near any point, showing this probability is exactly zero simultaneously for every point on the path.
Let be a standard Wiener process and let be twice continuously differentiable in and once in . Then the process satisfies — a stochastic chain rule with an extra second-derivative ("Itô correction") term compared to the ordinary chain rule.
Why is it true?
This is the single most-used tool in stochastic calculus: it tells you exactly how to differentiate a function of a random path, which is the starting point for deriving the dynamics of any quantity (an option price, a physical observable) that depends on Brownian motion.
Proof
Taylor expand. For a smooth , the ordinary second-order Taylor expansion in both variables over a small step with reads — this much is pure calculus, valid for any smooth path.
Order the terms by size. Because is of order (not , as shown in the previous theorem), the terms scale as: is order ; is order (the dominant, leading-order random term); and are order and respectively, negligible compared to ; but is order — the same order as , not negligible at all, unlike in ordinary calculus where is always negligible next to .
Replace by its mean. By the quadratic variation theorem, summed over many small steps behaves like (its mean, with fluctuations around that mean vanishing as the steps shrink and are summed), which is the informal justification for the heuristic substitution rule in the limit of infinitesimal steps.
Take the limit. Dropping the negligible higher-order terms and substituting in the limit turns the Taylor expansion into the differential form exactly as claimed — the term is precisely the contribution that ordinary calculus discards but stochastic calculus must keep.
UndergraduateReal-World Applications and Worked Examples
Beyond describing physical diffusion (pollen in water, heat spreading through a solid, gas molecules mixing), Brownian motion and Itô calculus became the mathematical foundation of modern quantitative finance. A stock price is commonly modeled as geometric Brownian motion, , where is the average growth rate and the volatility. Applying Itô's lemma to the value of a financial derivative (like an option) leads to the celebrated Black–Scholes partial differential equation, , whose solution gives the fair price of options traded on every major exchange. The same mathematics — Wiener processes and Itô's lemma — also underlies models of neuron membrane potentials in neuroscience, interest-rate models in economics, and turbulent dispersion in fluid dynamics.
Example: Expected value and variance of a Brownian displacement
A particle's position follows a standard Wiener process in one dimension, starting at . Find and .
Solution
For the first quantity, use with : is , so directly — Brownian motion has no drift, so its expected position never moves away from the start.
For the second quantity, apply the same defining property with , : , i.e. .
The variance of a random variable is by definition, so reading off the parameter directly, .
Notice the variance only depends on the elapsed time , not on the starting time itself — this reflects the time-homogeneity built into the definition of the Wiener process.
Example: Applying Itô's lemma to
Use Itô's lemma to find , the stochastic differential of the squared Wiener process, and use the result to confirm .
Solution
Take , so , , .
Substituting into Itô's lemma with these derivatives (evaluated at ): , which simplifies to .
Integrating both sides from to (using ): .
Taking expectations, and using the key fact that an Itô integral always has mean zero (it is built from increments independent of the past, so there is no systematic drift to accumulate): , confirming directly what we already knew from (whose variance is ), but this time derived purely from the stochastic calculus machinery rather than from the definition.
For a standard Wiener process, the increment (for ) is distributed as:
The quadratic variation of Brownian motion on is:
Compared to the ordinary chain rule, Itô's lemma has an extra term because:
The Black–Scholes PDE for option pricing is derived by applying:
References
- Ioannis Karatzas, Steven E. Shreve (1991). Brownian Motion and Stochastic Calculus
- Kiyosi Itô (1944). Stochastic Integral
- Fischer Black, Myron Scholes (1973). The Pricing of Options and Corporate Liabilities