Exported image

Dark blue is less than one standard deviation from the mean. For the normal distribution, this accounts for 68.27% of the set; while two standard deviations from the mean (medium and dark blue) account for 95.45%; and three standard deviations (light, medium, and dark blue) account for 99.73%.

Exported image

Prediction interval (on the y-axis) given from the standard score (on the x-axis). The y-axis is logarithmically compressed (but the values on it are not modified).

In statistics, the 68–95–99.7 rule, also known as the three-sigma rule or empirical rule, states that nearly all values lie within 3 standard deviations of the mean in a normal distribution.
About 68.27% of the values lie within 1 standard deviation of the mean. Similarly, about 95.45% of the values lie within 2 standard deviations of the mean. Nearly all (99.73%) of the values lie within 3 standard deviations of the mean.

In mathematical notation, these facts can be expressed as follows, where x is an observation from a normally distributed random variable, μ is the mean of the distribution, and σ is its standard deviation:

Exported image

Derivation

Exported image

Diagram showing the cumulative distribution function for the normal distribution with mean (µ) 0 and variance (σ_2) 1. The prediction interval for any standard score corresponds numerically to (1-(1-Φ_µ,σ_2(standard score))·2). For example, a standard score of x = 2 gives Φ_µ,_σ_2(2) = 0.97725 corresponding to a prediction interval of (1 − (1 − 0.97725)·2) = 0.9545 = 95.45%.

These numerical values come from the cumulative distribution function of the normal distribution. For example, Φ(2) ≈ 0.9772, or Pr(x ≤ μ + 2σ) ≈ 0.9772. Note that this is not a symmetrical interval – this is merely the probability that an observation is less than μ + 2σ. To compute the probability that an observation is within 2 standard deviations of the mean (small differences due to rounding):

Exported image

Statisticians might express these intervals as confidence intervals:

Exported image

is approximately a 95% confidence interval.

Uses
This rule is often used to quickly get a rough probability estimate of something, given its standard deviation, if the population is assumed normal, thus also as a simple test for outliers (if the population is assumed normal), and as a normality test (if the population is potentially not normal).

Recall that to pass from a sample to a number of standard deviations, one computes the deviation, either the error or residual (accordingly if one knows the population mean or only estimates it), and then either uses standardizing (dividing by the population standard deviation), if the population parameters are known, or studentizing (dividing by an estimate of the standard deviation), if the parameters are unknown and only estimated.

To use as a test for outliers or a normality test, one computes the size of deviations in terms of standard deviations, and compares this to expected frequency. Given a sample set, compute the studentized residuals and compare these to the expected frequency: points that fall more than 3 standard deviations from the norm are likely outliers (unless the sample size is significantly large, by which point one expects a sample this extreme), and if there are many points more than 3 standard deviations from the norm, one likely has reason to question the assumed normality of the distribution. This holds ever more strongly for moves of 4 or more standard deviations.

One can compute more precisely, approximating the number of extreme moves of a given magnitude or greater by a Poisson distribution, but simply, if one has multiple 4 standard deviation moves in a sample of size 1,000, one has strong reason to consider these outliers or question the assumed normality of the distribution.

Higher deviations
Because of the exponential tails of the normal distribution, odds of higher deviations decrease very quickly. From the Rules for normally distributed data:

RangePopulation in rangeExpected frequency outside rangeApprox. frequency for daily event
μ ± 1σ0.6826894921370861 in 3Twice a week
μ ± 1.5σ0.8663855974622841 in 7Weekly
μ ± 2σ0.9544997361036421 in 22Every three weeks
μ ± 2.5σ0.9875806693484481 in 81Quarterly
μ ± 3σ0.9973002039367401 in 370Yearly
μ ± 3.5σ0.9995347418419291 in 2149Every six years
μ ± 4σ0.9999366575163341 in 15,787Every 43 years (twice in a lifetime)
μ ± 4.5σ0.9999932046537511 in 147,160Every 403 years
μ ± 5σ0.9999994266968561 in 1,744,278Every 4,776 years (once in recorded history)
μ ± 5.5σ0.9999999620208751 in 26,330,254Every 72,090 years
μ ± 6σ0.9999999980268251 in 506,797,346Every 1.38 million years (history of humankind)
μ ± 6.5σ0.9999999999196801 in 12,450,197,393Every 34 million years
μ ± 7σ0.9999999999974401 in 390,682,215,445Every billion years
μ ± xσ
Exported image
1 in

Exported image
Every

Exported image


days

Thus for a daily process, a 6_σ_ event is expected to happen less than once in a million years. This gives a simple normality test: if one witnesses a 6_σ_ in daily data and significantly fewer than 1 million years have passed, then a normal distribution most likely does not provide a good model for the magnitude or frequency of large deviations in this respect. In The Black Swan, Nassim Nicholas Taleb gives the example of risk models for which the Black Monday crash was a 36-sigma event: the occurrence of such an event should instantly suggest a catastrophic flaw in a model.

Built with LogoFlowershow