The core toolkit for proving inequalities in competition mathematics: AM–GM–HM na1+⋯+an≥na1⋯an, Cauchy–Schwarz (∑ai2)(∑bi2)≥(∑aibi)2 and its companion Titu's Lemma ∑biai2≥∑bi(∑ai)2, Rearrangement, Chebyshev, Jensen, and Schur's inequality ar(a−b)(a−c)+br(b−a)(b−c)+cr(c−a)(c−b)≥0. We give full proofs of Cauchy–Schwarz via the discriminant of ∑(ait−bi)2≥0 and of Schur's inequality for r=1, then apply these tools to signal-to-noise ratio bounds and Kullback–Leibler divergence.
IntuitionWhy Averages Behave the Way They Do
Take two positive numbers, say 4 and 9. Their arithmetic mean is 24+9=6.5, but their geometric mean is 4⋅9=6. The geometric mean is always smaller (or equal, when the numbers are equal) — squeezing two unequal numbers together to multiply them "loses" more than adding them does. This single observation, generalized to n numbers and combined with a handful of companion inequalities (Cauchy–Schwarz, Rearrangement, Chebyshev, Jensen, Schur), is the entire toolkit competition mathematicians use to prove that one algebraic expression is always at least as large as another — turning what looks like a search over infinitely many cases into a few lines of clean algebra.
Function plot visualizing the AM-GM gap as a downward parabola
The gap between arithmetic mean 6.5 and geometric mean 6 of 4,9 traced as a curve: adjust to see how f(x)=−x2+13 visualizes the AM–GM gap (2a+b)2−ab=(2a−b)2≥0.
SchoolAM–GM–HM and Cauchy–Schwarz
Definition: Three Means Compared
For positive reals a1,…,an, the arithmetic mean is na1+⋯+an, the geometric mean is na1⋯an, and the harmonic mean is a11+⋯+an1n. The AM–GM–HM chain states arithmetic ≥ geometric ≥ harmonic, with equality throughout exactly when a1=⋯=an.
na1+⋯+an≥na1⋯an≥a11+⋯+an1n
Cauchy–Schwarz sharpens this idea to dot products: (∑ai2)(∑bi2)≥(∑aibi)2. A direct corollary, Titu's Lemma (Engel form), is often more convenient for competition fractions: ∑biai2≥∑bi(∑ai)2, obtained by substituting ai→ai/bi and bi→bi into Cauchy–Schwarz.
∑biai2≥∑bi(∑ai)2
Which inequality to reach for
Tool
Best for
AM–GM
Products vs. sums, fixed-sum optimization
Cauchy–Schwarz / Titu
Sums of fractions, dot-product bounds
Rearrangement / Chebyshev
Sums of products of ordered sequences
Jensen
Convex/concave function of an average
Schur
Symmetric three-variable inequalities
UndergraduateFull Proofs: Cauchy–Schwarz and Schur
For real numbers a1,…,an and b1,…,bn: (∑ai2)(∑bi2)≥(∑aibi)2, with equality iff the sequences are proportional.
Why is it true?
This single inequality (and its Engel-form corollary, Titu's Lemma) is the single most useful tool in olympiad inequality problems, converting sums of fractions or products into bounds that are easy to manipulate.
Proof
Step 1: Set up an auxiliary quadratic. Consider the real variable t and the expression ∑i=1n(ait−bi)2. Since it is a sum of squares of real numbers, it is always ≥0 for every real t: ∑(ait−bi)2≥0.
**Step 2: Expand into a quadratic in t.** Expanding, ∑(ait−bi)2=t2∑ai2−2t∑aibi+∑bi2. Write A=∑ai2, B=∑aibi, C=∑bi2, so the expression is At2−2Bt+C≥0 for all real t.
Step 3: Handle the degenerate case. If A=0 then every ai=0, so both sides of the claimed inequality B2≤AC are 0, and the inequality holds trivially (with equality).
**Step 4: Use the discriminant when A>0.** A quadratic At2−2Bt+C with positive leading coefficient A that is ≥0 for every real t can have at most one real root, so its discriminant cannot be positive: (2B)2−4AC≤0, i.e. 4B2≤4AC, i.e. B2≤AC.
Step 5: Conclude. Substituting back, (∑aibi)2≤(∑ai2)(∑bi2), which is exactly (∑ai2)(∑bi2)≥(∑aibi)2. Equality holds exactly when the discriminant is zero, i.e. the quadratic has a real double root t0, i.e. ait0=bi for every i — the sequences (ai) and (bi) are proportional.
For nonnegative reals a,b,c: a(a−b)(a−c)+b(b−a)(b−c)+c(c−a)(c−b)≥0, with equality iff a=b=c or two of them are equal and the third is 0.
Why is it true?
Schur's inequality is the standard closing move for symmetric three-variable competition inequalities that resist AM–GM or Cauchy–Schwarz directly, especially those involving a+b+c, ab+bc+ca, abc simultaneously.
Proof
Step 1: Reduce by symmetry. The expression a(a−b)(a−c)+b(b−a)(b−c)+c(c−a)(c−b) is symmetric in a,b,c, so without loss of generality assume a≥b≥c≥0.
Step 2: Group the first two terms. Group a(a−b)(a−c)+b(b−a)(b−c)=(a−b)[a(a−c)−b(b−c)], factoring out the common factor (a−b) from both terms (note b(b−a)(b−c)=−(a−b)⋅b(b−c)).
Step 3: Simplify the bracket. Expand a(a−c)−b(b−c)=a2−ac−b2+bc=(a2−b2)−c(a−b)=(a−b)(a+b)−c(a−b)=(a−b)(a+b−c).
Step 4: Combine. Substituting back, the grouped terms equal (a−b)⋅(a−b)(a+b−c)=(a−b)2(a+b−c). So the full expression equals (a−b)2(a+b−c)+c(a−c)(b−c) (the last term is exactly the third original term, unchanged).
Step 5: Sign-check each piece. Since a≥b≥c≥0: (a−b)2≥0 always. For the sign of a+b−c: since a≥c, we have a−c≥0, and b≥0, so a+b−c=(a−c)+b≥0. Hence (a−b)2(a+b−c)≥0. For the second piece: c≥0, a−c≥0 (since a≥c), and b−c≥0 (since b≥c), so c(a−c)(b−c)≥0 as a product of three nonnegative numbers.
Step 6: Conclude. The full expression is a sum of two nonnegative terms, (a−b)2(a+b−c)+c(a−c)(b−c)≥0, proving Schur's inequality for r=1. Equality requires both pieces to vanish: either a=b (making the first term 0) together with c(a−c)(b−c)=0 (forced if additionally a=c, giving a=b=c, or c=0 giving a=b,c=0), matching the stated equality condition.
AdvancedReal-World Applications and Worked Examples
Cauchy–Schwarz is not just a competition trick: in signal processing, it bounds the correlation between a signal and a matched filter, giving the maximum achievable signal-to-noise ratio (SNR) of a matched-filter receiver. In information theory, Jensen's inequality (applied to the convex function −log) proves the Kullback–Leibler divergence DKL(P∥Q)=∑pilogqipi is always ≥0 (Gibbs' inequality), the foundational fact making KL divergence a valid (if asymmetric) measure of distance between probability distributions, central to machine learning loss functions like cross-entropy.
Example: Matched-Filter SNR Bound via Cauchy–Schwarz
A receiver observes yi=si+ni for i=1,…,n, where si is a known signal and ni is noise with ∑ni2≤N. The receiver computes the correlation ∑siyi. Use Cauchy–Schwarz to bound how much noise can corrupt this correlation, i.e. bound ∣∑sini∣.
Solution
Step 1: Apply Cauchy–Schwarz directly to the sequences (si) and (ni): (∑sini)2≤(∑si2)(∑ni2).
Step 2: Substitute the noise energy bound ∑ni2≤N and write Es=∑si2 for the signal energy: (∑sini)2≤Es⋅N.
Step 3: Take square roots: ∣∑sini∣≤EsN. Meanwhile the noiseless correlation is exactly ∑si2=Es, so the worst-case relative disturbance is EsEsN=N/Es — smaller when signal energy Es is large relative to noise energy N, which is exactly the intuitive statement that SNR (ratio Es/N) controls detection reliability, and Cauchy–Schwarz shows the matched filter si is in fact the optimal correlator (any other filter gives a weaker bound), by equality holding only when the noise happens to be proportional to si itself.
Example: Proving Non-Negativity of KL Divergence via Jensen
For probability distributions p1,…,pn and q1,…,qn (all positive, summing to 1), prove Gibbs' inequality DKL(P∥Q)=∑ipilogqipi≥0.
Solution
Step 1: Rewrite DKL(P∥Q)=−∑ipilogpiqi=∑ipi⋅(−logpiqi), recognizing this as an expectation Ep[−logpiqi] weighted by the pi.
Step 2: Since −log is a convex function, Jensen's inequality gives E[−logX]≥−logE[X] for any random variable X (here X=qi/pi with probability pi).
Step 3: Compute E[X]=∑ipi⋅piqi=∑iqi=1, since the qi form a probability distribution.
Step 4: Combining, DKL(P∥Q)=E[−logX]≥−logE[X]=−log1=0, proving DKL(P∥Q)≥0, with equality iff qi/pi is constant for all i (by the equality condition of Jensen for strictly convex −log), i.e. iff P=Q.
In the proof of Cauchy–Schwarz via the discriminant of ∑(ait−bi)2≥0, what property of the quadratic At2−2Bt+C is used to conclude B2≤AC?
For which values of a,b,c does Schur's inequality a(a−b)(a−c)+b(b−a)(b−c)+c(c−a)(c−b)≥0 hold with equality (besides a=b=c)?
Titu's Lemma ∑biai2≥∑bi(∑ai)2 is derived from Cauchy–Schwarz by which substitution?
In the Gibbs' inequality proof that DKL(P∥Q)≥0, which inequality is applied to the convex function −log?