Combinatorics and discrete mathematics
The probabilistic method
Proves that an object with a desired property exists by showing a random construction has positive probability of having it.
IntuitionProving existence without building anything
Sometimes the fastest way to show that a mathematical object with a strange, desirable property exists is not to build one by hand, but to build a random one and compute the odds. If a random construction has the desired property with probability greater than zero, then at least one instance of it must exist somewhere among all the possible outcomes — even if nobody can point to it directly. This is the probabilistic method: turn an existence question into a question about averages and probabilities.
UndergraduateThe first-moment method
Definition: Random 2-coloring and monochromatic clique
Color each of the edges of independently red or blue, each with probability . For a set of vertices, say is monochromatic if every edge inside got the same color. Let be the total number of monochromatic -subsets of .
Here sums an indicator over all possible choices of . Since each of the edges inside is colored independently, is monochromatic (all red, or all blue) with probability . Linearity of expectation — which holds even though the events for overlapping sets are far from independent — lets us add these probabilities directly to get .
| Result | What is shown to exist | Technique |
|---|---|---|
| Ramsey number lower bound | a 2-coloring of with no monochromatic | First-moment method |
| Graph cuts (Max-Cut) | a bipartition crossing at least edges | Linearity of expectation |
| Independent sets (Turán-type) | an independent set of size at least | Deletion method |
| Hypergraph 2-colorability | a 2-coloring with no monochromatic edge | Lovász Local Lemma |
UndergraduateKey theorems
For any events in a probability space (not necessarily independent), if counts how many of them occur, then .
Why is it true?
It lets us compute the average of a count by adding up individual probabilities one at a time, without ever worrying about how the events interact with each other — the single most useful shortcut in the probabilistic method.
Proof
Write where is if occurs and otherwise. Expectation is itself defined as a sum (or integral) over outcomes weighted by their probability, and this sum is always additive over a finite list of random variables — this is true regardless of whether the variables are independent, since additivity of expectation never uses independence, only that we are summing the same underlying probability measure.
Formally, by additivity of expectation over a finite sum of random variables.
Finally, for any indicator variable, . Substituting this into the sum gives exactly , with no assumption on how the relate to one another.
For every integer , .
Why is it true?
As grows, the number of -subsets of an -vertex graph grows only polynomially in , but the chance that any particular subset is monochromatic shrinks doubly-exponentially in . Balancing these two rates shows the expected number of monochromatic cliques stays below even when is exponentially large in , which is far better than any bound anyone has managed to construct by hand.
Proof
Set . From the first-moment computation above, . If we show , then since only takes nonnegative integer values, some 2-coloring must achieve — otherwise always, forcing . A coloring with has no monochromatic -clique at all.
Bound the binomial coefficient by , and since we get . Substituting into the expectation formula, .
Simplify the exponent: . So , and it suffices to show for every .
Check this by induction on . Base case : and , and indeed . For the inductive step, suppose holds at some . Then , and since , this exceeds , which is exactly the claim at . So holds for every , which gives as needed.
Therefore a 2-coloring of with no monochromatic -clique exists, so . Since for every real , this gives , which is exactly .
UndergraduateReal-World Applications and Worked Examples
The probabilistic method is a working tool in computer science, not just a pure-existence curiosity. Randomized algorithms routinely use the same first-moment argument to guarantee a good solution exists, then either search for it or output a random instance that is good with high probability — this underlies randomized approximation algorithms for network cuts, the design of error-correcting codes and pseudorandom generators, and frequency/channel assignment in wireless networks.
Example: Guaranteeing a large network cut
A data-center network is modeled as a graph with links between racks. Show that the racks can always be split into two groups so that at least links go between the groups (useful for load-balancing traffic across two halves of the network).
Solution
Randomly and independently assign each rack to group or group with probability each. For any fixed link , it crosses the groups exactly when and land in different groups, which happens with probability (either or ).
Let be the number of crossing links. By linearity of expectation over all links (regardless of how the links share endpoints), .
Since is always a nonnegative integer, some particular assignment of racks to groups must achieve — if every assignment gave , the average could not reach . That assignment is the desired split.
Example: A guaranteed interference-free channel set (deletion method)
A wireless network has transmitters and pairs of transmitters that interfere with each other if both are active at once. Show that at least transmitters can be activated simultaneously with no interfering pair among them.
Solution
Model transmitters as vertices of a graph and interfering pairs as edges, so , , and the average degree is . We want an independent set (no edge inside it).
Pick a uniformly random ordering of all vertices, and keep a vertex if it appears earlier in the order than every one of its neighbors (a "local minimum"). If two kept vertices were adjacent, the later one in the order would have an earlier neighbor and could not have been kept — so the kept vertices always form an independent set .
A vertex of degree is kept exactly when it is first among itself and its neighbors in the random order, which happens with probability . By linearity of expectation, , and since is convex, this sum is minimized (by Jensen's inequality) when every equals the average degree , giving .
Plugging in the numbers, . Since is an integer-valued random variable, some ordering must achieve , giving the desired interference-free set of transmitters.
Events (possibly dependent) each have . Let count how many occur. What is ?
For , evaluate at . (Recall and .)
A network engineer models a network as a graph with links. Using the probabilistic method (random bipartition and linearity of expectation), what cut size can always be guaranteed?
The first-moment method shows for the number of monochromatic -cliques under a random 2-coloring of . What can we correctly conclude?
References
- Noga Alon, Joel H. Spencer (2016). The Probabilistic Method
- Marcelo Campos, Simon Griffiths, Robert Morris, Julian Sahasrabudhe (2023). Towards fully exponential bounds for the diagonal Ramsey numbers · arXiv:2303.09521 [preprint, not peer-reviewed]
- Reinhard Diestel (2017). Graph Theory