MathLabs

Combinatorics and discrete mathematics

The probabilistic method

Proves that an object with a desired property exists by showing a random construction has positive probability of having it.

IntuitionProving existence without building anything

Sometimes the fastest way to show that a mathematical object with a strange, desirable property exists is not to build one by hand, but to build a random one and compute the odds. If a random construction has the desired property with probability greater than zero, then at least one instance of it must exist somewhere among all the possible outcomes — even if nobody can point to it directly. This is the probabilistic method: turn an existence question into a question about averages and probabilities.

The complete graph on 5 vertices, representing the random edge-coloring used in the probabilistic method.
The complete graph K5K_5: (52)=10\binom{5}{2}=10 edges, each independently colored red or blue with probability 1/21/2. This is the random object at the heart of Erdős's argument: instead of hand-picking one 2-coloring of KnK_n, we imagine tossing a coin for every edge.

UndergraduateThe first-moment method

Definition: Random 2-coloring and monochromatic clique

Color each of the (n2)\binom{n}{2} edges of KnK_n independently red or blue, each with probability 1/21/2. For a set SS of kk vertices, say SS is monochromatic if every edge inside SS got the same color. Let XX be the total number of monochromatic kk-subsets of KnK_n.

X=∑S⊆V, ∣S∣=k1[AS]X = \sum_{S \subseteq V,\ |S|=k} \mathbb{1}[A_S]

Here XX sums an indicator over all (nk)\binom{n}{k} possible choices of SS. Since each of the (k2)\binom{k}{2} edges inside SS is colored independently, SS is monochromatic (all red, or all blue) with probability 21−(k2)2^{1-\binom{k}{2}}. Linearity of expectation — which holds even though the events for overlapping sets SS are far from independent — lets us add these probabilities directly to get E[X]\mathbb{E}[X].

E[X]=(nk) 21−(k2)\mathbb{E}[X] = \binom{n}{k}\,2^{1-\binom{k}{2}}
Some classical results proved by the probabilistic method
ResultWhat is shown to existTechnique
Ramsey number lower bounda 2-coloring of KnK_n with no monochromatic KkK_kFirst-moment method
Graph cuts (Max-Cut)a bipartition crossing at least m/2m/2 edgesLinearity of expectation
Independent sets (Turán-type)an independent set of size at least n/(d+1)n/(d+1)Deletion method
Hypergraph 2-colorabilitya 2-coloring with no monochromatic edgeLovász Local Lemma

UndergraduateKey theorems

For any events A1,…,AmA_1,\dots,A_m in a probability space (not necessarily independent), if X=∑i=1m1[Ai]X = \sum_{i=1}^m \mathbb{1}[A_i] counts how many of them occur, then E[X]=∑i=1mPr⁡[Ai]\mathbb{E}[X] = \sum_{i=1}^m \Pr[A_i].

Why is it true?

It lets us compute the average of a count by adding up individual probabilities one at a time, without ever worrying about how the events interact with each other — the single most useful shortcut in the probabilistic method.

Proof

Write X=∑i=1m1[Ai]X = \sum_{i=1}^m \mathbb{1}[A_i] where 1[Ai]\mathbb{1}[A_i] is 11 if AiA_i occurs and 00 otherwise. Expectation is itself defined as a sum (or integral) over outcomes weighted by their probability, and this sum is always additive over a finite list of random variables — this is true regardless of whether the variables are independent, since additivity of expectation never uses independence, only that we are summing the same underlying probability measure.

Formally, E[X]=E[∑i=1m1[Ai]]=∑i=1mE[1[Ai]]\mathbb{E}[X] = \mathbb{E}\left[\sum_{i=1}^m \mathbb{1}[A_i]\right] = \sum_{i=1}^m \mathbb{E}[\mathbb{1}[A_i]] by additivity of expectation over a finite sum of random variables.

Finally, for any indicator variable, E[1[Ai]]=1⋅Pr⁡[Ai]+0⋅Pr⁡[Ai‾]=Pr⁡[Ai]\mathbb{E}[\mathbb{1}[A_i]] = 1 \cdot \Pr[A_i] + 0 \cdot \Pr[\overline{A_i}] = \Pr[A_i]. Substituting this into the sum gives exactly E[X]=∑i=1mPr⁡[Ai]\mathbb{E}[X] = \sum_{i=1}^m \Pr[A_i], with no assumption on how the AiA_i relate to one another.

For every integer kk ≥3\ge 3, R(k,k)>2k/2R(k,k) > 2^{k/2}.

Why is it true?

As kk grows, the number of kk-subsets of an nn-vertex graph grows only polynomially in nn, but the chance that any particular subset is monochromatic shrinks doubly-exponentially in kk. Balancing these two rates shows the expected number of monochromatic cliques stays below 11 even when nn is exponentially large in kk, which is far better than any bound anyone has managed to construct by hand.

Proof

Set n=⌊2k/2⌋n = \lfloor 2^{k/2} \rfloor. From the first-moment computation above, E[X]=(nk) 21−(k2)\mathbb{E}[X] = \binom{n}{k}\,2^{1-\binom{k}{2}}. If we show (nk) 21−(k2)<1\binom{n}{k}\,2^{1-\binom{k}{2}} < 1, then since XX only takes nonnegative integer values, some 2-coloring must achieve X=0X=0 — otherwise X≥1X \ge 1 always, forcing E[X]≥1\mathbb{E}[X]\ge 1. A coloring with X=0X=0 has no monochromatic kk-clique at all.

Bound the binomial coefficient by (nk)≤nk/k!\binom{n}{k} \le n^k/k!, and since n≤2k/2n \le 2^{k/2} we get nk≤2k2/2n^k \le 2^{k^2/2}. Substituting into the expectation formula, E[X]≤2k2/2⋅21−(k2)k!\mathbb{E}[X] \le \dfrac{2^{k^2/2}\cdot 2^{1-\binom{k}{2}}}{k!}.

Simplify the exponent: k22+1−k(k−1)2=1+k2−k2+k2=1+k2\dfrac{k^2}{2} + 1 - \dfrac{k(k-1)}{2} = 1 + \dfrac{k^2 - k^2 + k}{2} = 1 + \dfrac{k}{2}. So E[X]≤21+k/2k!\mathbb{E}[X] \le \dfrac{2^{1+k/2}}{k!}, and it suffices to show k!>21+k/2k! > 2^{1+k/2} for every k≥3k \ge 3.

Check this by induction on kk. Base case k=3k=3: 3!=63! = 6 and 21+3/2=22.5≈5.6572^{1+3/2} = 2^{2.5} \approx 5.657, and indeed 6>5.6576 > 5.657. For the inductive step, suppose k!>21+k/2k! > 2^{1+k/2} holds at some k≥3k \ge 3. Then (k+1)!=(k+1)⋅k!>(k+1)⋅21+k/2(k+1)! = (k+1)\cdot k! > (k+1)\cdot 2^{1+k/2}, and since k+1≥4>2k+1 \ge 4 > \sqrt2, this exceeds 2⋅21+k/2=21+(k+1)/2\sqrt2 \cdot 2^{1+k/2} = 2^{1+(k+1)/2}, which is exactly the claim at k+1k+1. So k!>21+k/2k! > 2^{1+k/2} holds for every k≥3k \ge 3, which gives (nk) 21−(k2)<1\binom{n}{k}\,2^{1-\binom{k}{2}} < 1 as needed.

Therefore a 2-coloring of KnK_n with no monochromatic kk-clique exists, so R(k,k)>n=⌊2k/2⌋R(k,k) > n = \lfloor 2^{k/2}\rfloor. Since ⌊x⌋+1>x\lfloor x\rfloor + 1 > x for every real xx, this gives R(k,k)≥⌊2k/2⌋+1>2k/2R(k,k) \ge \lfloor 2^{k/2}\rfloor + 1 > 2^{k/2}, which is exactly R(k,k)>2k/2R(k,k) > 2^{k/2}.

UndergraduateReal-World Applications and Worked Examples

The probabilistic method is a working tool in computer science, not just a pure-existence curiosity. Randomized algorithms routinely use the same first-moment argument to guarantee a good solution exists, then either search for it or output a random instance that is good with high probability — this underlies randomized approximation algorithms for network cuts, the design of error-correcting codes and pseudorandom generators, and frequency/channel assignment in wireless networks.

Example: Guaranteeing a large network cut

A data-center network is modeled as a graph with m=17m=17 links between racks. Show that the racks can always be split into two groups so that at least 99 links go between the groups (useful for load-balancing traffic across two halves of the network).

Solution

Randomly and independently assign each rack to group AA or group BB with probability 1/21/2 each. For any fixed link {u,v}\{u,v\}, it crosses the groups exactly when uu and vv land in different groups, which happens with probability 2⋅12⋅12=122\cdot\tfrac12\cdot\tfrac12=\tfrac12 (either u∈A,v∈Bu\in A, v\in B or u∈B,v∈Au\in B, v\in A).

Let YY be the number of crossing links. By linearity of expectation over all m=17m=17 links (regardless of how the links share endpoints), E[Y]=17⋅12=8.5\mathbb{E}[Y] = 17\cdot\tfrac12 = 8.5.

Since YY is always a nonnegative integer, some particular assignment of racks to groups must achieve Y≥⌈8.5⌉=9Y \ge \lceil 8.5\rceil = 9 — if every assignment gave Y≤8Y\le 8, the average could not reach 8.58.5. That assignment is the desired split.

Example: A guaranteed interference-free channel set (deletion method)

A wireless network has n=40n=40 transmitters and m=60m=60 pairs of transmitters that interfere with each other if both are active at once. Show that at least 1010 transmitters can be activated simultaneously with no interfering pair among them.

Solution

Model transmitters as vertices of a graph and interfering pairs as edges, so n=40n=40, m=60m=60, and the average degree is d=2m/n=2⋅60/40=3d = 2m/n = 2\cdot60/40 = 3. We want an independent set (no edge inside it).

Pick a uniformly random ordering of all nn vertices, and keep a vertex vv if it appears earlier in the order than every one of its neighbors (a "local minimum"). If two kept vertices were adjacent, the later one in the order would have an earlier neighbor and could not have been kept — so the kept vertices always form an independent set II.

A vertex vv of degree dvd_v is kept exactly when it is first among itself and its dvd_v neighbors in the random order, which happens with probability 1/(dv+1)1/(d_v+1). By linearity of expectation, E[∣I∣]=∑v1dv+1\mathbb{E}[|I|] = \sum_v \dfrac{1}{d_v+1}, and since x↦1/(x+1)x\mapsto 1/(x+1) is convex, this sum is minimized (by Jensen's inequality) when every dvd_v equals the average degree dd, giving E[∣I∣]≥nd+1\mathbb{E}[|I|] \ge \dfrac{n}{d+1}.

Plugging in the numbers, E[∣I∣]≥403+1=10\mathbb{E}[|I|] \ge \dfrac{40}{3+1} = 10. Since ∣I∣|I| is an integer-valued random variable, some ordering must achieve ∣I∣≥10|I| \ge 10, giving the desired interference-free set of transmitters.

Events A1,A2,A3A_1, A_2, A_3 (possibly dependent) each have Pr⁡[Ai]=0.3\Pr[A_i] = 0.3. Let X=∑i=131[Ai]X = \sum_{i=1}^3 \mathbb{1}[A_i] count how many occur. What is E[X]\mathbb{E}[X]?

For k=4k=4, evaluate E[X]=(n4)⋅21−(42)\mathbb{E}[X] = \binom{n}{4}\cdot 2^{1-\binom{4}{2}} at n=4n=4. (Recall (44)=1\binom{4}{4}=1 and (42)=6\binom{4}{2}=6.)

A network engineer models a network as a graph with m=50m=50 links. Using the probabilistic method (random bipartition and linearity of expectation), what cut size can always be guaranteed?

The first-moment method shows E[X]<1\mathbb{E}[X] < 1 for the number of monochromatic kk-cliques under a random 2-coloring of KnK_n. What can we correctly conclude?

References

  1. Noga Alon, Joel H. Spencer (2016). The Probabilistic Method
  2. Marcelo Campos, Simon Griffiths, Robert Morris, Julian Sahasrabudhe (2023). Towards fully exponential bounds for the diagonal Ramsey numbers · arXiv:2303.09521 [preprint, not peer-reviewed]
  3. Reinhard Diestel (2017). Graph Theory