Virtual laboratory/Mathematics/Probability/The Gaussian curve and the central limit theorem

The Gaussian curve and the central limit theorem

An extension of the topic of statistics, the mean and the standard deviation. The sum or average of many independent random factors settles into a "bell" — the normal distribution (the Gaussian curve) — regardless of the distribution of the individual terms. This is the central limit theorem. The normal distribution was described by Carl Friedrich Gauss (1809), and the general theorem was proved by Pierre-Simon Laplace (1810).

The Gaussian curve and the central limit theorem
Mathematics · Probability · The Gaussian curve and the central limit theorem (1810)
Number of summed dice rolls nn1 die
Summing many independent random events (e.g. dice rolls), we get a distribution…
dice n
1
mean μ
3.5
std. dev. σ
1.71
results within ±1σ
66.7%
🎯 Challenge: hit the normal rule
streak: 0

I’ll draw an interval ±1σ or ±2σ — increase n with the slider until the fraction of results in that interval hits the 68–95 rule.

What just happened?

A single die roll gives a uniform distribution — six outcomes 1–6 with equal chance 1/6. But when you sum many such independent rolls, the sum distribution stops being flat and ever more closely approximates the characteristic “bell” — the normal distribution (the Gaussian curve). The key point: this happens regardless of what distribution the terms had.

The central limit theorem (CLT)

When some quantity is a sum of many small, independent random factors, its distribution tends to the normal one. The normal distribution has the density:

f(x)=1σ2π e−(x−μ)22σ2f(x)=\dfrac{1}{\sigma\sqrt{2\pi}}\,e^{-\frac{(x-\mu)^2}{2\sigma^2}}

where μ\mu is the mean (center of the bell), and σ\sigma is the standard deviation (width of the bell). For the sum of n dice we compute them exactly: μ=3.5 n\mu = 3.5\,n and σ=3512 n\sigma = \sqrt{\tfrac{35}{12}\,n}.

The invariant: the 68–95–99.7 rule

For the normal distribution a constant fraction of results falls within successive intervals around the mean — regardless of μ and σ:

P(μ−σ≤X≤μ+σ)≈0.68P(\mu-\sigma \le X \le \mu+\sigma)\approx 0.68
P(μ−2σ≤X≤μ+2σ)≈0.95P(μ±3σ)≈0.997P(\mu-2\sigma \le X \le \mu+2\sigma)\approx 0.95 \qquad P(\mu\pm 3\sigma)\approx 0.997

The panel on the right shows how the actual fraction of sum results (computed from the exact distribution) converges to these values as n grows. This is a practical tool for interpreting the standard deviation.

A bit of history

The normal distribution was described mathematically by Carl Friedrich Gauss (1809), studying measurement errors in astronomy — hence the “Gaussian curve”. The general central limit theorem was proved by Pierre-Simon Laplace (1810). The CLT is one of the pillars of statistics: it explains why the “bell” appears everywhere in nature and measurements — people’s height, measurement errors, test scores — because each of these quantities is a sum of many small, independent influences.

Why you need this for the exam:

The normal distribution and the 68–95–99.7 rule let you quickly estimate how “typical” a given result is: we measure distance from the mean in units of σ. The trick: when a problem mentions a “sum/average of many trials”, expect a normal distribution — even if a single trial was completely different.

Remember: the sum of many independent random events gives a normal distribution (the Gaussian curve) — regardless of the distribution of the terms. About 68% of results fall within ±1σ, about 95% within ±2σ, around the mean μ.

Illustrative model · NexTutor Virtual laboratory

Enjoyed the experiment? Share it.

It's free — send it to friends from school.

Theory & formulas

The normal distribution

The density of the bell curve: f(x)=1σ2π  e−(x−μ)22σ2f(x)=\frac{1}{\sigma\sqrt{2\pi}}\;e^{-\frac{(x-\mu)^2}{2\sigma^2}}

The central limit theorem

The average (or sum) of many independent random factors has, in the limit, a normal distribution — regardless of the distributions of the individual terms.

The 68-95-99.7 rule

About 68%68\% of results fall within μ±σ\mu\pm\sigma, μ±2σ\mu\pm2\sigma — 95%95\%, μ±3σ\mu\pm3\sigma — 99.7%99.7\%.

Notation: μ\mu mean value, σ\sigma standard deviation, xx random variable.

Frequently asked questions

›

What distribution do we get by summing many independent events?

A bell shape — the normal distribution (the Gaussian curve), regardless of the distributions of the terms.

›

What does the 68-95-99.7 rule say?

About 68% of results fall within ±1 standard deviation of the mean, 95% within ±2σ, 99.7% within ±3σ.

›

Why is the normal distribution everywhere?

Because many quantities (height, measurement errors) are sums of many small independent random factors.

Teaching? Embed this experiment on your site.

Free widget — paste it on your school site, blog or notes. It links to the full version.

Teaching a class or tutoring? Guide students in NexTutor →