The sample mean is unbiased
Statement
If are independent, identically distributed with for every , then the sample mean satisfies .
Why is it true?
Averaging removes systematic bias: on average, across many hypothetical samples, lands exactly on the true population mean , neither systematically too high nor too low.
Proof sketch
By definition, . Expectation is a linear operator, so it distributes over the sum and the constant factor : .
Since every comes from the same population, for each of the terms, so the sum collapses to .
Therefore for every sample size : the sample mean is unbiased no matter how small or large the sample is. This is a statement about the center of its sampling distribution only -- the spread of that distribution, , still shrinks as grows, which is what the confidence interval below uses.
Topics that use this theorem
Step-by-step proofs
No step-by-step proof yet for this theorem.
References
- NIST/SEMATECH (2013). Confidence Limits for the Mean
- Diez, D.; Cetinkaya-Rundel, M.; Barr, C. (2019). OpenIntro Statistics