Slides 📊

Open the Chapter 6 slides in a new tab

The original PowerPoint slides remain available as a legacy download:

Download Chapter 6 slides (PPTX)

6.4. Normal Distribution

We now encounter the most important continuous distribution in all of statistics: the normal distribution.

Road Map 🧭

  • Understand the historical development and significance of the normal distribution.

  • Master the mathematical definition and properties of the normal PDF.

  • Explore how the parameters \(\mu\) and \(\sigma\) control location and shape.

  • Learn the famous empirical rule for quick probability estimates.

  • Understand why standardization is essential for normal computations.

6.4.1. The Historical Legacy: From Gauss to Modern Statistics

The normal distribution carries a rich mathematical heritage spanning over two centuries. While often called the “Gaussian distribution” in honor of Carl Friedrich Gauss (1777-1855), the distribution’s development involved several brilliant mathematicians who recognized patterns in natural variation.

Gauss and the Method of Least Squares

Carl Friedrich Gauss

Fig. 6.25 Carl Friedrich Gauss (1777-1855)

In the late 1700s and early 1800s, Gauss was working on astronomical calculations and geodetic surveys—problems requiring precise measurements where small errors were inevitable. He sought to understand how these measurement errors behaved and how to optimally combine multiple measurements of the same quantity.

Gauss discovered that measurement errors followed a specific pattern: most errors were small and clustered around zero, with larger errors becoming increasingly rare. More importantly, he found that this error distribution had a particular exponential form with quadratic decay that optimized his least squares fitting procedure.

The Connection to Binomial Distributions

Gauss recognized that his continuous error distribution was closely connected to limiting behavior of discrete binomial distributions. When the number of trials becomes very large, with the expected numbers of both successes and failures sufficiently large, the jagged, discrete binomial distribution becomes increasingly well approximated by the smooth bell curve we now call the normal distribution.

This connection between discrete counting processes and continuous measurement errors revealed a profound unity in probability theory—the same mathematical structure appears whether we’re flipping coins or measuring stellar positions.

A Universal Pattern in Nature

What makes the normal distribution truly remarkable is its ubiquity. It describes not just measurement errors, but heights and weights of organisms, intelligence test scores, particle velocities in gases, and countless other natural phenomena. This universality isn’t coincidental—it emerges from a deep mathematical principle we’ll encounter later called the Central Limit Theorem.

6.4.2. The Mathematical Definition: Anatomy of the Bell Curve

Notation and Parameters

If a random variable \(X\) has a normal distribution, we write:

\[X \sim N(\mu, \sigma^2) \quad \text{or} \quad X \sim N(\mu, \sigma).\]

A normal random variable takes two parameters:

Parameter

Mean \(\mu\)

Standard Deviation \(\sigma\)

Possible values

\(\mu \in (-\infty, +\infty)\). It can be any real number.

\(\sigma >0\). It must be a positive value.

Interpretation

The location parameter. It represents the center of the distribution of \(X\).

The scale parameter. It represents how spread out the distribution of \(X\) is.

Effect on the appearance of the PDF

Slides the curve left or right, without changing the shape

Makes the graph tall and narrow (small \(\sigma\)) or wide and flat (large \(\sigma\)). It does not change the location of the center.

Variance or Standard Deviation?

It is standard to describe a normal distribution using either variance or standard deviation, but we must be explicit about which we’re using.

The constraints and interpretations of standard deviation transfer almost directly to variance. Variance must be a positive number, and it controls how wide the distribution is. The only difference is their scale—variance is in the squared scale, while standard deviation is on the same scale as \(X\).

Normal pdfs for different sets of parameters mu and sigma

Fig. 6.26 How different values of μ and σ affect the normal distribution’s appearance

Describe this figure in detail

A three-by-three grid of normal density curves under the title “Change in normal PDFs by different parameters.” The rows are labeled σ=0.5 (top), σ=1 (middle) and σ=2 (bottom); the columns are labeled μ=−1 (left), μ=0 (middle) and μ=1 (right). Every panel has the same axes: the horizontal axis runs from about −7.5 to 7.5 with ticks at −5, 0 and 5, and the vertical axis runs from 0 to 0.8. A gray dashed vertical line marks x = 0 in each panel. The curves are orange in the μ=−1 column, blue in the μ=0 column and green in the μ=1 column.

In each column the peak sits at that column’s μ: just left of the dashed line for μ=−1, on it for μ=0, and just right of it for μ=1. Within a row the three curves have the same shape and height. Going down the rows the curves get lower and wider: the peak is at about 0.8 on the density axis for σ=0.5, about 0.4 for σ=1 and about 0.2 for σ=2. In the σ=0.5 row each curve is close to 0 beyond about 1.5 units from its center; in the σ=2 row the curves spread across most of the axis and come close to 0 only near its ends.

The Normal PDF

The PDF of a normal random variable \(X\) takes the form:

\[f_X(x) = \frac{1}{\sigma\sqrt{2\pi}} e^{-\frac{1}{2}\left(\frac{x-\mu}{\sigma}\right)^2} \quad \text{for all } x \in \mathbb{R}\]

This elegant formula contains several key components:

  • The normalizing constant \(\frac{1}{\sigma\sqrt{2\pi}}\) ensures the total area under the curve equals 1.

  • The exponential function \(e^{-(\cdot)}\) creates the smooth, continuous decay.

  • The quadratic expression \(\left(\frac{x-\mu}{\sigma}\right)^2\) in the exponent produces the symmetric, bell-shaped curve.

  • The parameters \(\mu\) and \(\sigma\) control the distribution’s location and spread.

Fundamental Properties

Regardless of its parameters, every normal distribution satisfies the following properties:

  1. It is symmetrical about the mean \(\mu\).

  2. It is unimodal with a single peak at \(x = \mu\).

  3. Since the distribution is perfectly symmetric, the mean equals the median: \(\mu = \tilde{\mu}\).

  4. It is bell-shaped with smooth, continuous curves.

  5. The two tails approach but never reach zero as \(x \to \pm\infty\). This implies that \(\text{supp}(X) = (-\infty, +\infty)\).

  6. The points where the normal curve changes from concave down to concave up (its inflection points) occur exactly at \(x = \mu - \sigma\) and \(x = \mu + \sigma\).

    Normal distribution showing inflection points at μ ± σ

    Fig. 6.27 The normal curve changes concavity at exactly one standard deviation from the mean

    Describe this figure in detail

    Normal density curve. The horizontal axis is marked μ − 3σ, μ − 2σ, μ − σ, μ, μ + σ, μ + 2σ and μ + 3σ; the vertical axis runs from 0.0 to 0.4. The curve peaks at about 0.4 above μ. The formula \(f_X(x) = \frac{1}{\sqrt{2\pi}\,\sigma} e^{-\frac{1}{2}\left(\frac{x-\mu}{\sigma}\right)^2}\) is printed at the upper right.

    The part of the curve between μ − σ and μ + σ is drawn in blue and labeled “Concave Down” above the peak. The two outer parts, left of μ − σ and right of μ + σ, are drawn in green and each is labeled “Concave Up”. Dotted vertical lines drop from the two points where the color changes, at a height of about 0.24, to the axis, and the tick labels μ − σ and μ + σ are circled in black.

6.4.3. The Empirical Rule: A Practical Tool

One of the most useful properties of normal distributions is that they all follow the same probability pattern, regardless of their specific parameter values. This universal pattern is called the empirical rule or 68-95-99.7 rule.

For any normal random variable \(X \sim N(\mu, \sigma)\),

  1. 68% of the probability lies within one standard deviation from the mean: \(P(\mu - \sigma < X < \mu + \sigma) \approx 0.68\)

  2. 95% of the probability lies within two standard deviations: \(P(\mu - 2\sigma < X < \mu + 2\sigma) \approx 0.95\)

  3. 99.7% of the probability lies within three standard deviations: \(P(\mu - 3\sigma < X < \mu + 3\sigma) \approx 0.997\)

Empirical rule showing 68-95-99.7 percentages

Fig. 6.28 The empirical rule provides quick probability estimates for any normal distribution

Describe this figure in detail

Normal density curve in blue. The vertical axis is labeled “Normal f_X(x)” and has no tick values; the horizontal axis is labeled x, with ticks at μ − 3σ, μ − 2σ, μ − σ, μ, μ + σ, μ + 2σ and μ + 3σ. A gray dashed vertical line rises from each tick. The curve peaks above μ and is close to 0 beyond μ − 3σ and μ + 3σ.

Three salmon-colored double-headed arrows are stacked below the peak. The top arrow, labeled 68%, spans μ − σ to μ + σ. The middle arrow, labeled 95%, spans μ − 2σ to μ + 2σ. The bottom arrow, labeled 99.7%, spans μ − 3σ to μ + 3σ.

Extended Breakdown of the Empirical Rule

  1. 34% of probability lies in each of \((\mu, \mu + \sigma)\) and \((\mu - \sigma, \mu)\)

    • Each interval is half of 68%.

  2. 13.5% of probability lies in each of \((\mu + \sigma, \mu + 2\sigma)\) and \((\mu - 2\sigma, \mu - \sigma)\)

    • Each interval is half of 95%, minus an interval from #1.

  3. 2.35% of probability lies in each of \((\mu + 2\sigma, \mu + 3\sigma)\) and \((\mu - 3\sigma, \mu - 2\sigma)\).

    • Each interval is half of 99.7%, minus an interval from #2 and an interval from #1.

  4. 0.15% of probability lies beyond \(\mu + 3\sigma\) and another 0.15% beyond \(\mu - 3\sigma\).

    • Each region is half of 100% - 99.7%.

Insights from the Empirical Rule

  • About 2/3 of values fall within one standard deviation of the mean.

  • About 19 out of 20 values fall within two standard deviations.

  • Nearly all values (99.7%) fall within three standard deviations.

Example💡: Computing Normal Probabilities Using Empirical Rules

A chemical lab reports that the amount of active ingredient in a single tablet of a medication is normally distributed with a mean of 500 mg and a standard deviation of 5 mg.

Q1. What is the probability that a tablet contains between 490 mg and 505 mg of active ingredient?

\(490 = \mu - 2\sigma \text{ and } 505 = \mu + \sigma\). Therefore, we are looking for

\[P(\mu -2\sigma \leq X \leq \mu + \sigma)\]

There are many different ways to solve this using the empirical rule. One way is to view the probability as

\[P(\mu -2\sigma \leq X \leq \mu + 2\sigma) - P(\mu+\sigma \leq X \leq \mu +2\sigma)\]

The first term is approximately 0.95 by the empirical rule, and the second term is approximately 0.135. Then finally,

\[P(\mu -2\sigma \leq X \leq \mu + \sigma) \approx 0.95 - 0.135 = 0.815\]

6.4.4. The Standard Normal Distribution: The Foundation of All Normal Computations

While normal distributions can have any mean and standard deviation, there’s one particular normal distribution that serves as the foundation for all normal probability calculations.

Definition of the Standard Normal Distribution

The standard normal distribution is the normal distribution with mean 0 and standard deviation 1. When a random variable follows the standard normal distribution, we denote it with \(Z\) and write:

\[Z \sim N(0, 1)\]

Its PDF is obtained by plugging in 0 and 1 for \(\mu\) and \(\sigma\), respectively, in the general form:

\[f_Z(z) = \frac{1}{\sqrt{2\pi}} e^{-\frac{z^2}{2}} \quad \text{for all } z \in \mathbb{R}\]

Because the standard normal is so important, it also gets special notations for its PDF and CDF:

  • PDF: \(\phi(z) = f_Z(z)\) (lowercase Greek letter phi)

  • CDF: \(\Phi(z) = P(Z \leq z)\) (uppercase Greek letter phi)

Standardization of Normal Random Variables

Any normal random variable can be converted to a standard normal random variable using the standardization formula:

\[Z = \frac{X - \mu}{\sigma}.\]

If \(X \sim N(\mu, \sigma)\), then \(Z \sim N(0, 1)\).

Why Standardization Works

  1. Standardization re-centers the distribution at 0 by subtracting the mean from \(X\) .

  2. It rescales the distribution to have unit variance by dividing \(X\) by its own standard deviation.

For a more concrete demonstration, we first need to know a special property of normal distribution:

  • When a normal random variable is multiplied or added by a constant, the resulting random variable will still be normal, just with a new set of mean and variance parameters.

Since \(\mu\) and \(\sigma\) are constants, the operation on \(X\) to get to \(Z\) leaves us with another normal random variable. Also,

  • \(E[Z] = E\left[\frac{X-\mu}{\sigma}\right]= \frac{E[X]-\mu}{\sigma} = \frac{\mu - \mu}{\sigma}=0\).

  • \(\sigma^2[Z] = \text{Var}(Z) = \text{Var}\left(\frac{X-\mu}{\sigma}\right) = \frac{\text{Var}(X)}{\sigma^2}= \frac{\sigma^2}{\sigma^2} =1\).

Why Do We Standardize?

The fundamental problem with normal distributions is that their CDFs cannot be expressed in terms of elementary functions. There’s no simple formula for:

\[P(X\leq x) = \int_{-\infty}^{x} \frac{1}{\sigma\sqrt{2\pi}} e^{-\frac{1}{2}\left(\frac{t-\mu}{\sigma}\right)^2} dt\]

However, we can numerically approximate these integrals for the standard normal distribution and tabulate the results. Instead of creating tables of approximations for all possible pairs of parameters—which would be impossible—we standardize, so that we can refer to one table for any normal random variables.

6.4.5. Forward Problems: \(x\) to Probability

Now that we understand the theoretical foundation, let’s learn how to actually compute probabilities for normal distributions. Since we cannot integrate the normal PDF analytically, we rely on numerical approximations tabulated in standard normal tables.

The Standard Normal Table (Z-Table)

Statisticians have computed high-precision numerical approximations for the standard normal CDF \(\Phi(z) = P(Z \leq z)\) and compiled them into tables. These tables typically provide probabilities accurate to four decimal places for z-values given to two decimal places.

For example, if we want to find \(P(Z \leq -1.38)\), first locate \(-1.3\) from the row labels. Then find the column with the label \(0.08\). The intersection of the row and the column gives the desired probability. \(P(Z \leq -1.38)=0.0838\).

Half of the Z-table for negative z values
Describe this figure in detail

Standard normal table (Z-table) for z from −3.49 to 0.00. Each entry is the cumulative probability Φ(z) = P(Z ≤ z), given to four decimal places. The rows are labeled with z to one decimal place, from −3.4 at the top down to 0.0 at the bottom; the columns are labeled 0.00 through 0.09 and give the second decimal place of z. Row −1.3, column 0.08 is z = −1.38, with entry 0.0838. Moving down a column the entries increase; moving right along a row they decrease or stay the same. The last row, labeled 0.0, runs from 0.5000 at column 0.00 to 0.4641 at column 0.09.

Each row’s ten entries follow, in column order from 0.00 to 0.09.

Row −3.4: 0.0003, 0.0003, 0.0003, 0.0003, 0.0003, 0.0003, 0.0003, 0.0003, 0.0003, 0.0002.

Row −3.3: 0.0005, 0.0005, 0.0005, 0.0004, 0.0004, 0.0004, 0.0004, 0.0004, 0.0004, 0.0003.

Row −3.2: 0.0007, 0.0007, 0.0006, 0.0006, 0.0006, 0.0006, 0.0006, 0.0005, 0.0005, 0.0005.

Row −3.1: 0.0010, 0.0009, 0.0009, 0.0009, 0.0008, 0.0008, 0.0008, 0.0008, 0.0007, 0.0007.

Row −3.0: 0.0013, 0.0013, 0.0013, 0.0012, 0.0012, 0.0011, 0.0011, 0.0011, 0.0010, 0.0010.

Row −2.9: 0.0019, 0.0018, 0.0018, 0.0017, 0.0016, 0.0016, 0.0015, 0.0015, 0.0014, 0.0014.

Row −2.8: 0.0026, 0.0025, 0.0024, 0.0023, 0.0023, 0.0022, 0.0021, 0.0021, 0.0020, 0.0019.

Row −2.7: 0.0035, 0.0034, 0.0033, 0.0032, 0.0031, 0.0030, 0.0029, 0.0028, 0.0027, 0.0026.

Row −2.6: 0.0047, 0.0045, 0.0044, 0.0043, 0.0041, 0.0040, 0.0039, 0.0038, 0.0037, 0.0036.

Row −2.5: 0.0062, 0.0060, 0.0059, 0.0057, 0.0055, 0.0054, 0.0052, 0.0051, 0.0049, 0.0048.

Row −2.4: 0.0082, 0.0080, 0.0078, 0.0075, 0.0073, 0.0071, 0.0069, 0.0068, 0.0066, 0.0064.

Row −2.3: 0.0107, 0.0104, 0.0102, 0.0099, 0.0096, 0.0094, 0.0091, 0.0089, 0.0087, 0.0084.

Row −2.2: 0.0139, 0.0136, 0.0132, 0.0129, 0.0125, 0.0122, 0.0119, 0.0116, 0.0113, 0.0110.

Row −2.1: 0.0179, 0.0174, 0.0170, 0.0166, 0.0162, 0.0158, 0.0154, 0.0150, 0.0146, 0.0143.

Row −2.0: 0.0228, 0.0222, 0.0217, 0.0212, 0.0207, 0.0202, 0.0197, 0.0192, 0.0188, 0.0183.

Row −1.9: 0.0287, 0.0281, 0.0274, 0.0268, 0.0262, 0.0256, 0.0250, 0.0244, 0.0239, 0.0233.

Row −1.8: 0.0359, 0.0351, 0.0344, 0.0336, 0.0329, 0.0322, 0.0314, 0.0307, 0.0301, 0.0294.

Row −1.7: 0.0446, 0.0436, 0.0427, 0.0418, 0.0409, 0.0401, 0.0392, 0.0384, 0.0375, 0.0367.

Row −1.6: 0.0548, 0.0537, 0.0526, 0.0516, 0.0505, 0.0495, 0.0485, 0.0475, 0.0465, 0.0455.

Row −1.5: 0.0668, 0.0655, 0.0643, 0.0630, 0.0618, 0.0606, 0.0594, 0.0582, 0.0571, 0.0559.

Row −1.4: 0.0808, 0.0793, 0.0778, 0.0764, 0.0749, 0.0735, 0.0721, 0.0708, 0.0694, 0.0681.

Row −1.3: 0.0968, 0.0951, 0.0934, 0.0918, 0.0901, 0.0885, 0.0869, 0.0853, 0.0838, 0.0823.

Row −1.2: 0.1151, 0.1131, 0.1112, 0.1093, 0.1075, 0.1056, 0.1038, 0.1020, 0.1003, 0.0985.

Row −1.1: 0.1357, 0.1335, 0.1314, 0.1292, 0.1271, 0.1251, 0.1230, 0.1210, 0.1190, 0.1170.

Row −1.0: 0.1587, 0.1562, 0.1539, 0.1515, 0.1492, 0.1469, 0.1446, 0.1423, 0.1401, 0.1379.

Row −0.9: 0.1841, 0.1814, 0.1788, 0.1762, 0.1736, 0.1711, 0.1685, 0.1660, 0.1635, 0.1611.

Row −0.8: 0.2119, 0.2090, 0.2061, 0.2033, 0.2005, 0.1977, 0.1949, 0.1922, 0.1894, 0.1867.

Row −0.7: 0.2420, 0.2389, 0.2358, 0.2327, 0.2296, 0.2266, 0.2236, 0.2206, 0.2177, 0.2148.

Row −0.6: 0.2743, 0.2709, 0.2676, 0.2643, 0.2611, 0.2578, 0.2546, 0.2514, 0.2483, 0.2451.

Row −0.5: 0.3085, 0.3050, 0.3015, 0.2981, 0.2946, 0.2912, 0.2877, 0.2843, 0.2810, 0.2776.

Row −0.4: 0.3446, 0.3409, 0.3372, 0.3336, 0.3300, 0.3264, 0.3228, 0.3192, 0.3156, 0.3121.

Row −0.3: 0.3821, 0.3783, 0.3745, 0.3707, 0.3669, 0.3632, 0.3594, 0.3557, 0.3520, 0.3483.

Row −0.2: 0.4207, 0.4168, 0.4129, 0.4090, 0.4052, 0.4013, 0.3974, 0.3936, 0.3897, 0.3859.

Row −0.1: 0.4602, 0.4562, 0.4522, 0.4483, 0.4443, 0.4404, 0.4364, 0.4325, 0.4286, 0.4247.

Row 0.0: 0.5000, 0.4960, 0.4920, 0.4880, 0.4840, 0.4801, 0.4761, 0.4721, 0.4681, 0.4641.

The other half of the Z-table for positive z- values
Describe this figure in detail

Standard normal table (Z-table) for z from 0.00 to 3.49. Each entry is the cumulative probability Φ(z) = P(Z ≤ z), given to four decimal places. The rows are labeled with z to one decimal place, from 0.0 at the top down to 3.4 at the bottom; the columns are labeled 0.00 through 0.09 and give the second decimal place of z, so row 1.2, column 0.05 is z = 1.25, with entry 0.8944. Moving down a column or right along a row the entries increase or stay the same, from 0.5000 at the top left to 0.9998 at the bottom right.

Each row’s ten entries follow, in column order from 0.00 to 0.09.

Row 0.0: 0.5000, 0.5040, 0.5080, 0.5120, 0.5160, 0.5199, 0.5239, 0.5279, 0.5319, 0.5359.

Row 0.1: 0.5398, 0.5438, 0.5478, 0.5517, 0.5557, 0.5596, 0.5636, 0.5675, 0.5714, 0.5753.

Row 0.2: 0.5793, 0.5832, 0.5871, 0.5910, 0.5948, 0.5987, 0.6026, 0.6064, 0.6103, 0.6141.

Row 0.3: 0.6179, 0.6217, 0.6255, 0.6293, 0.6331, 0.6368, 0.6406, 0.6443, 0.6480, 0.6517.

Row 0.4: 0.6554, 0.6591, 0.6628, 0.6664, 0.6700, 0.6736, 0.6772, 0.6808, 0.6844, 0.6879.

Row 0.5: 0.6915, 0.6950, 0.6985, 0.7019, 0.7054, 0.7088, 0.7123, 0.7157, 0.7190, 0.7224.

Row 0.6: 0.7257, 0.7291, 0.7324, 0.7357, 0.7389, 0.7422, 0.7454, 0.7486, 0.7517, 0.7549.

Row 0.7: 0.7580, 0.7611, 0.7642, 0.7673, 0.7704, 0.7734, 0.7764, 0.7794, 0.7823, 0.7852.

Row 0.8: 0.7881, 0.7910, 0.7939, 0.7967, 0.7995, 0.8023, 0.8051, 0.8078, 0.8106, 0.8133.

Row 0.9: 0.8159, 0.8186, 0.8212, 0.8238, 0.8264, 0.8289, 0.8315, 0.8340, 0.8365, 0.8389.

Row 1.0: 0.8413, 0.8438, 0.8461, 0.8485, 0.8508, 0.8531, 0.8554, 0.8577, 0.8599, 0.8621.

Row 1.1: 0.8643, 0.8665, 0.8686, 0.8708, 0.8729, 0.8749, 0.8770, 0.8790, 0.8810, 0.8830.

Row 1.2: 0.8849, 0.8869, 0.8888, 0.8907, 0.8925, 0.8944, 0.8962, 0.8980, 0.8997, 0.9015.

Row 1.3: 0.9032, 0.9049, 0.9066, 0.9082, 0.9099, 0.9115, 0.9131, 0.9147, 0.9162, 0.9177.

Row 1.4: 0.9192, 0.9207, 0.9222, 0.9236, 0.9251, 0.9265, 0.9279, 0.9292, 0.9306, 0.9319.

Row 1.5: 0.9332, 0.9345, 0.9357, 0.9370, 0.9382, 0.9394, 0.9406, 0.9418, 0.9429, 0.9441.

Row 1.6: 0.9452, 0.9463, 0.9474, 0.9484, 0.9495, 0.9505, 0.9515, 0.9525, 0.9535, 0.9545.

Row 1.7: 0.9554, 0.9564, 0.9573, 0.9582, 0.9591, 0.9599, 0.9608, 0.9616, 0.9625, 0.9633.

Row 1.8: 0.9641, 0.9649, 0.9656, 0.9664, 0.9671, 0.9678, 0.9686, 0.9693, 0.9699, 0.9706.

Row 1.9: 0.9713, 0.9719, 0.9726, 0.9732, 0.9738, 0.9744, 0.9750, 0.9756, 0.9761, 0.9767.

Row 2.0: 0.9772, 0.9778, 0.9783, 0.9788, 0.9793, 0.9798, 0.9803, 0.9808, 0.9812, 0.9817.

Row 2.1: 0.9821, 0.9826, 0.9830, 0.9834, 0.9838, 0.9842, 0.9846, 0.9850, 0.9854, 0.9857.

Row 2.2: 0.9861, 0.9864, 0.9868, 0.9871, 0.9875, 0.9878, 0.9881, 0.9884, 0.9887, 0.9890.

Row 2.3: 0.9893, 0.9896, 0.9898, 0.9901, 0.9904, 0.9906, 0.9909, 0.9911, 0.9913, 0.9916.

Row 2.4: 0.9918, 0.9920, 0.9922, 0.9925, 0.9927, 0.9929, 0.9931, 0.9932, 0.9934, 0.9936.

Row 2.5: 0.9938, 0.9940, 0.9941, 0.9943, 0.9945, 0.9946, 0.9948, 0.9949, 0.9951, 0.9952.

Row 2.6: 0.9953, 0.9955, 0.9956, 0.9957, 0.9959, 0.9960, 0.9961, 0.9962, 0.9963, 0.9964.

Row 2.7: 0.9965, 0.9966, 0.9967, 0.9968, 0.9969, 0.9970, 0.9971, 0.9972, 0.9973, 0.9974.

Row 2.8: 0.9974, 0.9975, 0.9976, 0.9977, 0.9977, 0.9978, 0.9979, 0.9979, 0.9980, 0.9981.

Row 2.9: 0.9981, 0.9982, 0.9982, 0.9983, 0.9984, 0.9984, 0.9985, 0.9985, 0.9986, 0.9986.

Row 3.0: 0.9987, 0.9987, 0.9987, 0.9988, 0.9988, 0.9989, 0.9989, 0.9989, 0.9990, 0.9990.

Row 3.1: 0.9990, 0.9991, 0.9991, 0.9991, 0.9992, 0.9992, 0.9992, 0.9992, 0.9993, 0.9993.

Row 3.2: 0.9993, 0.9993, 0.9994, 0.9994, 0.9994, 0.9994, 0.9994, 0.9995, 0.9995, 0.9995.

Row 3.3: 0.9995, 0.9995, 0.9995, 0.9996, 0.9996, 0.9996, 0.9996, 0.9996, 0.9996, 0.9997.

Row 3.4: 0.9997, 0.9997, 0.9997, 0.9997, 0.9997, 0.9997, 0.9997, 0.9997, 0.9997, 0.9998.

The Strategy for Non-standard Normal RVs

We said we would apply the standardization technique to use the Z-table for any normal distributions. How will this work? The key steps are the following:

  1. Recognize that subtracting the same value on both sides or multiplying by the same positive value on both sides does not change the truth of an (in)equality. It follows that the probability of the (in)equality also remains unchanged.

  2. Using #1,

    \[P(X \leq a) = P\left(\frac{X-\mu}{\sigma} \leq \frac{a-\mu}{\sigma}\right) = P\left(Z \leq \frac{a-\mu}{\sigma}\right) = \Phi\left(\frac{a-\mu}{\sigma}\right).\]
    • \(\frac{a-\mu}{\sigma}\), the value obtained by standardizing \(a\), is called the z-score of \(a\).

The Strategy for Probabilities Which Do Not Match the CDF

We are often interested in probabilities which are not in the form \(\Phi(z) = P(Z \leq z)\).

  • For “greater than” probabilities, use the complement rule: \(P(Z > z) = 1 - \Phi(z)\).

  • For probabilities of intervals, use \(P(a < Z < b) = \Phi(b) - \Phi(a)\)

  • Because the standard normal distribution is symmetric around zero, we have an additional tool: \(\Phi(-z) = 1 - \Phi(z)\) (Fig. 6.29).

Special property of standard normal CDF due to symmetry around 0

Fig. 6.29 Due to symmetry around zero, the two gray regions have equal probability.

Describe this figure in detail

Standard normal density curve. The horizontal axis runs from −4 to 4 with a label at each integer; the vertical axis has tick marks but no labels. The curve peaks above 0. Two vertical lines stand at matching distances on either side of 0, at about −1.45 and about 1.45. The area under the curve to the left of the left line is shaded gray, and an arrow from the label Φ(−z) points into it. The area under the curve to the right of the right line is shaded gray, and an arrow from the label 1 − Φ(z) points into it. The two shaded tails are mirror images of each other about 0.

Forward Problems

When a problem gives a value in the support and asks for a related probability, we call it a forward problem. The systematic approach is:

  1. Identify the desired probability in correct probability notation. Sketch the region on a normal PDF plot if needed.

  2. Standardize by converting \(x\) values to \(z\)-scores using \(z = \frac{x-\mu}{\sigma}\).

  3. Modify the probability statement to an expression involving \(P(Z \leq z)\) so the Z-table can be used directly.

  4. Round the z-score to two decimal places and look it up in the table.

  5. Write your conclusion in the context of the problem.

Example💡: Systolic Blood Pressure

Systolic blood pressure readings for healthy adults, in mmHg, follow a normal distribution with \(\mu=112\) and \(\sigma^2= 100\). Find the probability that a randomly selected adult has blood pressure between 90 and 134 mmHg.

Sketch of the probability P(90 < X < 134).

Fig. 6.30 A sketch of \(P(90 < X < 134)\)

Describe this figure in detail

Normal density curve with no vertical axis values. The horizontal axis has three labeled ticks, 90, 112 and 134, so 90 and 134 are each 22 units from 112. A dotted vertical line runs from the axis up to the peak at 112. The area under the curve between 90 and 134 is shaded purple and labeled P(90 < X < 134); the two thin tails below 90 and above 134 are unshaded.

  • Step 1: Write the random variable and its distribution in correct notation

    Let \(X\) be the blood pressure readings for healthy adults. \(X \sim N(\mu=112, \sigma^2=100)\).

  • Step 2: Find the correct probability statement

    We are looking for

    \[P(90 < X < 134) = P(X < 134) - P(X < 90).\]

    We need to find \(z_1\) and \(z_2\) such that \(P(X < 134) = P(Z< z_2)\) and \(P(X< 90)=P(Z< z_1)\).

  • Step 3: Standardize to find \(z_1\) and \(z_2\)

    Note that the spread parameter is given as variance. We must use \(\sigma = \sqrt{100} = 10\) for standardization.

    \[z_1 = \frac{90 - 112}{10} = \frac{-22}{10} = -2.2 \text{ and } z_2 = \frac{134 - 112}{10} = \frac{22}{10} = 2.2\]
  • Step 4: Convert to standard normal probability

    \[P(90 < X < 134) = P(Z< z_2) - P(Z< z_1) = \Phi(2.2) - \Phi(-2.2)\]
  • Step 5: Use symmetry to simplify

    We can look up the CDF values for \(z_1=-2.2\) and \(z_2=2.2\) separately, but when the two \(z\)-scores are negatives of each other, we can also simplify the search step using \(\Phi(-2.2) = 1 - \Phi(2.2)\).

    \[P(-2.2 < Z < 2.2) = \Phi(2.2) - (1 - \Phi(2.2)) = 2\Phi(2.2) - 1\]
  • Step 6: Look up in the Z-table and calculate the final answer

    From the Z-table: \(\Phi(2.2) = 0.9861\). Finally,

    \[P(90 < X < 134) = 2(0.9861) - 1 = 0.9722\]

    There is approximately 0.9722 probability that a randomly selected healthy adult will have systolic blood pressure between 90 and 134 mmHg.

6.4.6. Backward Problems: Probability to \(x\) (Percentile)

Backward problems reverse the process: given a probability, we must find the corresponding value (percentile) in the support.

Walkthrough of a Backward Problem

Consider a typical backward question:

  • The gas price on a fixed date in State A follows normal distribution with mean $3.30 and standard deviation $0.12. If Gas Station B has a price higher than 63% of all gas stations in the state that day, what is the gas price in Gas Station B?

In this problem, a probability is given (63% or 0.63), and we are asked for the cutoff whose left region under the PDF has an area of 0.63. This cutoff is the 63rd percentile of the gas price distribution.

To solve for this type of problems, we begin by setting up the correct probability statement.

\[P(X \leq x_{0.63}) = 0.63.\]

Standardize to get a probability statement in terms of \(Z\):

\[P(Z \leq \frac{x_{0.63}-\mu}{\sigma})=0.63.\]

The right-hand side of the inequality above now fits the definition of the 63rd percentile of a standard normal random variable. That is,

\[z_{0.63} = \frac{x_{0.63}-\mu}{\sigma}.\]

We will look for \(z_{0.63}\) and convert back to \(x_{0.63}\) using this relationship.

To find \(z_{0.63}\), we locate 0.63 (or the value closest to it) in the main body of the table, then obtain the \(z\)- score from its margins. 0.6293 is the value closest to 0.63 in the main body, and its margins give us \(z_{0.63}=0.33\).

Converting back, \(x_{0.63} = \sigma z_{0.63} +\mu = (0.12)(0.33) + 3.3 = 3.3396\).

Finally, the price at Gas Station B is around $3.34.

Summary of the Key Steps

  1. Identify the value you need to find using correct probability notation. Sketch the region if needed.

  2. Find the z-score by first locating the probability in the body of the Z-table then going to its margins.

  3. Convert the z-score to the original scale using \(x = \sigma z + \mu\).

  4. Write your conclusion in the correct context.

Points That Require Special Attention

  • Depending on the problem, the probability given may correspond to a right (upper) region rather than a left (lower) one under the PDF. Since percentiles are always defined in terms of the lower region, you need to make adjustments accordingly. For example, if Gas Station C has a price lower than 23 % of all other gas stations in the state, its price corresponds to the (100 – 23)th percentile.

  • If the given probability does not have an exact match in the table, take the z-value for the closest entry. If it is exactly in the middle of two values on the table, take the average between the z-scores of the two entries.

Example💡: Systolic Blood Pressure, Continued

Continue with the RV of blood pressure measurements: \(X \sim N(\mu = 112, \sigma^2 = 100)\).

  1. find the 95th percentile.

    We want to find \(x_{0.95}\) such that \(P(X \leq x_{0.95}) = 0.95\) First, find \(z_{0.95}\) such that \(\Phi(z_{0.95}) = 0.95\)

    In the body of the Z-table, we find that 0.9495 and 0.9505 are the closest to 0.95. Since 0.95 is exactly halfway between these values, we average the corresponding z-scores:

    \[z_{0.95} = \frac{1.64 + 1.65}{2} = 1.645.\]

    Converting to the original scale,

    \(x_{0.95} = \mu + \sigma z_{0.95} = 112 + 10(1.645) = 128.45\).

    Conclusion: The 95th percentile of systolic blood pressure is 128.45 mmHg. This means that 95% of healthy adults have blood pressure at or below this value.

  2. Find the cutoffs for the middle 50% of blood pressure measurements. Using the cutoffs, also compute the interquartile range.

    Sketch of the cutoffs for middle 50%

    Fig. 6.31 A sketch of problem 2

    Describe this figure in detail

    Normal density curve with no vertical axis values. The horizontal axis is labeled x₁, μ and x₂, with μ under the peak and x₁ and x₂ equally far to its left and right. Bold vertical lines rise from x₁ and x₂ to the curve. The area under the curve between x₁ and x₂ is shaded purple and labeled 0.5. The unshaded area left of x₁ is labeled 0.25, and the unshaded area right of x₂ is labeled 0.25.

    We need to find two cutoffs: the 25th percentile and the 75th percentile.

    For the 25th percentile:

    • \(\Phi(z_{0.25}) = 0.25\)

    • From the table: \(z_{0.25} = -0.67\)

    • \(x_{0.25} = 112 + 10(-0.67) = 105.3\) mmHg

    For the 75th percentile:

    • \(\Phi(z_{0.75}) = 0.75\)

    • From the table (or using symmetry): \(z_{0.75} = 0.67\)

    • \(x_{0.75} = 112 + 10(0.67) = 118.7\) mmHg

    Conclusion: The middle 50% of systolic blood pressure readings fall between 105.3 and 118.7 mmHg. The interquartile range is \(118.7 - 105.3 = 13.4\) mmHg.

6.4.7. Proving the Theoretical Properties of Normal Distribution

Validity of the PDF

To establish that a normal PDF is legitimate, we must verify that it satisfies the two fundamental requirements for any probability density function.

Property 1: Non-Negativity

We need to show that \(f_X(x) \geq 0\) for all \(x\).

Since \(\sigma > 0\), we have \(\frac{1}{\sigma\sqrt{2\pi}} > 0\). The exponential function \(e^{-\frac{1}{2}\left(\frac{x-\mu}{\sigma}\right)^2}\) is always positive because:

  • The exponent \(-\frac{1}{2}\left(\frac{x-\mu}{\sigma}\right)^2\) is always negative (or zero).

  • \(e^{\text{negative number}}\) is always positive.

  • \(e^0 = 1 > 0\).

Therefore, \(f_X(x) > 0\) for all \(x \in \mathbb{R}\). ✓

Property 2: Integration to Unity

We must prove that \(\int_{-\infty}^{\infty} f_X(x) \, dx = 1\).

Step 1: Change of Variables

Let \(z = \frac{x - \mu}{\sigma}\), so \(x = \sigma z + \mu\) and \(dx = \sigma \, dz\).

\(z = -\infty\) when \(x = -\infty\), and \(z = +\infty\) when \(x = +\infty\). The integral becomes:

\[I = \int_{-\infty}^{\infty} \frac{1}{\sigma\sqrt{2\pi}} e^{-\frac{1}{2}\left(\frac{x-\mu}{\sigma}\right)^2} dx = \int_{-\infty}^{\infty} \frac{1}{\sqrt{2\pi}} e^{-\frac{z^2}{2}} dz\]

Step 2: The Squaring Trick

This integral has no elementary antiderivative, so we use a clever approach. Let’s compute \(I^2\):

\[I^2 = \left(\int_{-\infty}^{\infty} \frac{1}{\sqrt{2\pi}} e^{-\frac{z^2}{2}} dz\right)\left(\int_{-\infty}^{\infty} \frac{1}{\sqrt{2\pi}} e^{-\frac{v^2}{2}} dv\right)\]

Since the integrals converge absolutely, we can rewrite this as a double integral:

\[I^2 = \int_{-\infty}^{\infty} \int_{-\infty}^{\infty} \frac{1}{2\pi} e^{-\frac{1}{2}(z^2 + v^2)} \, dz \, dv\]

Step 3: Polar Coordinate Transformation

Let:

  • \(z = r\cos\theta\)

  • \(v = r\sin\theta\)

  • \(z^2 + v^2 = r^2\)

  • \(dz \, dv = r \, dr \, d\theta\)

The integration limits become:

  • \(r\): from 0 to \(\infty\)

  • \(\theta\): from 0 to \(2\pi\)

Therefore:

\[I^2 = \int_0^{2\pi} \int_0^{\infty} \frac{1}{2\pi} e^{-\frac{r^2}{2}} \cdot r \, dr \, d\theta\]

Step 4: Separating the Integrals

\[I^2 = \frac{1}{2\pi} \int_0^{2\pi} d\theta \int_0^{\infty} r e^{-\frac{r^2}{2}} dr\]

The first integral gives us \(2\pi\). For the second integral, use substitution \(u = \frac{r^2}{2}\), so \(du = r \, dr\):

\[\int_0^{\infty} r e^{-\frac{r^2}{2}} dr = \int_0^{\infty} e^{-u} du = \left[-e^{-u}\right]_0^{\infty} = 0 - (-1) = 1\]

Step 5: Final Result

\[I^2 = \frac{1}{2\pi} \cdot 2\pi \cdot 1 = 1\]

Since \(I > 0\) (the integrand is positive), we have \(I = 1\). ✓

This completes the proof that the normal PDF is a valid probability density function.

The Parameter Relationships: Expected Value and Variance

To complete our theoretical understanding, we must prove that the parameters \(\mu\) and \(\sigma^2\) are indeed the mean and variance of the distribution.

Theorem: The Expected Value is μ

For \(X \sim N(\mu, \sigma)\), \(E[X] = \mu\).

Proof:

\[E[X] = \int_{-\infty}^{\infty} x \cdot \frac{1}{ \sigma\sqrt{2\pi}} e^{-\frac{1}{2}\left(\frac{x-\mu}{\sigma}\right)^2} dx\]

Using the standardization substitution \(z = \frac{x-\mu}{\sigma}\), we have \(x = \sigma z + \mu\) and \(dx = \sigma \, dz\).

\[E[X] = \int_{-\infty}^{\infty} (\sigma z + \mu) \cdot \frac{1}{\sqrt{2\pi}} e^{-\frac{z^2}{2}} dz\]

Distributing the integral,

\[E[X] = \sigma \int_{-\infty}^{\infty} z \cdot \frac{1}{\sqrt{2\pi}} e^{-\frac{z^2}{2}} dz + \mu \int_{-\infty}^{\infty} \frac{1}{\sqrt{2\pi}} e^{-\frac{z^2}{2}} dz\]

The second integral equals 1 since it’s the integral of the standard normal PDF. For the first integral, note that \(z \phi(z)\) is an odd function, and we’re integrating over a symmetric interval, so:

\[\int_{-\infty}^{\infty} z \cdot \phi(z) \, dz = 0\]

Therefore, \(E[X] = \sigma \cdot 0 + \mu \cdot 1 = \mu\). ✓

Theorem: The Variance is \(\sigma^2\)

For \(X \sim N(\mu, \sigma)\), \(\text{Var}(X) = \sigma^2\) .

Proof:

Using the standardization \(Z = \frac{X-\mu}{\sigma}\), we know that \(X = \sigma Z + \mu\). By the properties of variance:

\[\text{Var}(X) = \text{Var}(\sigma Z + \mu) = \sigma^2 \text{Var}(Z)\]

So we need to show that \(\text{Var}(Z) = 1\) for the standard normal.

\[\text{Var}(Z) = E[Z^2] - (E[Z])^2 = E[Z^2] - 0^2 = E[Z^2]\]
\[E[Z^2] = \int_{-\infty}^{\infty} z^2 \cdot \frac{1}{\sqrt{2\pi}} e^{-\frac{z^2}{2}} dz\]

Using integration by parts with \(u = z\) and \(dv = z e^{-\frac{z^2}{2}} dz\), we have \(du = dz\) and \(v = -e^{-\frac{z^2}{2}}\). Then:

\[\int z^2 e^{-\frac{z^2}{2}} dz = z(-e^{-\frac{z^2}{2}}) - \int (-e^{-\frac{z^2}{2}}) dz = -ze^{-\frac{z^2}{2}} + \int e^{-\frac{z^2}{2}} dz\]

The boundary term \(\left[-ze^{-\frac{z^2}{2}}\right]_{-\infty}^{\infty} = 0\) since exponential decay dominates linear growth. Therefore,

\[E[Z^2] = \frac{1}{\sqrt{2\pi}} \int_{-\infty}^{\infty} e^{-\frac{z^2}{2}} dz = \frac{1}{\sqrt{2\pi}} \cdot \sqrt{2\pi} = 1\]

Thus \(\text{Var}(Z) = 1\) and \(\text{Var}(X) = \sigma^2\). ✓

6.4.8. Assessing Normality in Practice: Why It Matters

In statistical practice, we frequently need to determine whether observed data comes from a normal distribution. This assessment is crucial because many statistical procedures—confidence intervals, t-tests, ANOVA, and regression—assume normality or rely on estimators whose sampling distributions are approximately normal.

While we’ve established the theoretical foundation of the normal distribution, real data is messy. Heights, weights, test scores, and measurement errors may approximately follow normal patterns, but we need systematic methods to evaluate how close our data comes to this idealized mathematical model.

The Challenge of Real-World Assessment

Unlike our theoretical examples with known parameters, real data presents several challenges:

  • We don’t know the true population parameters \(\mu\) and \(\sigma\).

  • Sample sizes are finite, introducing sampling variability.

  • Real phenomena may deviate from perfect normality in subtle ways.

  • We need to distinguish between minor departures that don’t affect our analyses and serious violations that require different approaches.

A Multi-Faceted Approach

Assessing normality requires multiple complementary methods because no single approach provides complete information. We combine:

  1. Visual methods that reveal patterns and deviations at a glance,

  2. Numerical checks that quantify adherence to normal distribution properties, and

  3. Formal statistical tests that provide rigorous hypothesis testing frameworks.

6.4.9. Visual Assessments for Normality

A. Histograms with Overlaid Curves

The most intuitive approach overlays three elements on a histogram of the data:

  • The histogram itself, showing the actual distribution of observations,

  • A kernel density estimate (smooth red curve) that traces the data’s shape without assuming any particular distribution, and

  • A normal density curve (blue curve) fitted using the sample mean and standard deviation.

Histogram with kernel density and normal curve overlay

Fig. 6.32 Comparing actual data distribution (purple histogram) with its smooth estimate (red) and fitted normal curve (blue)*

Describe this figure in detail

Histogram of a data set with two curves drawn over it; the axes have no labels or tick values. The purple bars form a single peak in the middle and get steadily shorter on both sides, with very short bars in both tails, so the shape is close to symmetric. The red curve (kernel density estimate) and the blue curve (normal density using the sample mean and standard deviation) almost coincide over the whole range and follow the tops of the bars. The only visible difference is at the peak: the red curve is flat across the tops of the tallest bars, and the blue curve rises slightly above it.

When data follows a normal distribution, these three elements align closely. Deviations reveal specific patterns:

  • Skewness: The red curve shifts away from the blue curve

  • Heavy tails: The red curve extends further than the blue curve

  • Light tails: The red curve falls short of the blue curve’s extent

  • Multimodality: The red curve shows multiple peaks while the blue curve shows only one

B. Normal Probability Plots: A Sophisticated Diagnostic

Normal probability plots (also called QQ-plots for “quantile-quantile plots”) provide a more sensitive method for detecting departures from normality. These plots directly compare the quantiles of our data with the quantiles we would expect if the data truly came from a normal distribution.

Steps of Constructing a QQ-Plot

  1. Order the Data

    Arrange the \(n\) observations from smallest to largest: \(x_{(1)} \leq x_{(2)} \leq \cdots \leq x_{(n)}\).

  2. Assign Theoretical Probabilities

    Each ordered observation \(x_{(i)}\) represents approximately the \(\frac{i-0.5}{n}\) quantile of the data distribution. The adjustment of \(-0.5\) centers each data point within its expected quantile interval, providing more accurate comparisons.

  3. Find Corresponding Normal Quantiles

    For each probability \(p_i = \frac{i-0.5}{n}\), find the z-value \(z_i\) such that \(\Phi(z_i) = p_i\). These are the theoretical quantiles we would expect if the data came from a standard normal distribution.

  4. Create the Plot

    Plot the ordered data values \(x_{(i)}\) (y-axis) against the theoretical quantiles \(z_i\) (x-axis).

  5. Add a Reference Line

    The reference line \(y = \bar{x} + s \cdot z\) shows where points would fall if the data perfectly matched a normal distribution with the sample’s mean and standard deviation.

Interpreting QQ-Plots

The power of QQ-plots lies in how different departures from normality create characteristic patterns.

Consistent with Normality: Points lie approximately along the reference line without a clear curved pattern. Some scatter is expected from random sampling, even when the population is normal.

Histogram, boxplot and normal quantile plot of symmetric data; the quantile plot points lie along the reference line.

Fig. 6.33 Normal probability plot consistent with a normal distribution

Describe this figure in detail

Three panels side by side for one large data set: a histogram, a boxplot and a normal quantile plot.

Left, histogram: the horizontal axis is Values, from about −20 to 20; the vertical axis is Density, from 0 to 0.095. The purple bars form one peak near 0 and fall off evenly on both sides; the tallest bar, just left of 0, reaches about 0.084, and the data run from about −19 to about 20. A smooth purple density curve follows the bars and peaks at about 0.079. A dashed vertical line near 0 carries the labels M and x̄.

Middle, boxplot on a vertical axis from −20 to 20: the box runs from about −3.3 to about 3.4, with the median (orange line) at about 0. The whiskers reach about −13.5 and about 13.6, and individual points lie beyond both whiskers, up to about 20.4 and down to about −19.

Right, “Normal Quantile Plot”: the horizontal axis is Theoretical Quantiles, from −4 to 4; the vertical axis is Ordered Values, from −20 to 20. The blue points form a dense band along a red reference line that runs from about −19 at −3.8 to about 19 at 3.8. Only at the two ends do a few points separate slightly from the line: several of the lowest points, between theoretical quantiles −3.6 and −3.3, sit a little below it, and the highest point, about 20.4 at 3.8, sits a little above it.

Long Tails: Points begin below the line but curves above for larger values.

  • Data has more extreme values than a normal distribution would predict

  • The lower tail extends further left, upper tail extends further right

  • Common in financial data, measurement errors with occasional large mistakes

Histogram, boxplot and normal quantile plot of long-tailed data; points fall below the line at left, above it at right.

Fig. 6.34 Normal probability plot for long-tailed data

Describe this figure in detail

Three panels side by side for one large data set: a histogram, a boxplot and a normal quantile plot.

Left, histogram: the horizontal axis is Values, from about −90 to 85, with ticks every 10 from −90 to 80; the vertical axis is Density, with ticks from 0.000 to 0.035. The bars form a tall, narrow peak at about 0; the tallest bar rises above the top tick to about 0.044. The bars drop quickly within about 20 units of 0 on each side and then continue as long, low tails: short bars are still visible near −50 and near 45, and the smooth purple density curve stays just above 0 out to about −90 and about 85. Dashed and dotted vertical lines, almost on top of each other at about 0, carry the labels M and x̄.

Middle, boxplot on a vertical axis from about −90 to 85: the box runs from about −7 to about 7, with the median (orange line) at about 0. The whiskers reach about −28 and about 27. Beyond both whiskers there are many individual points, packed densely out to about −50 and 50 and then more spread out, down to about −90 and up to about 84.

Right, “Normal Quantile Plot”: the horizontal axis is Theoretical Quantiles, from −4 to 4; the vertical axis is Ordered Values, with ticks from −75 to 75. The red reference line runs from about −53 at −3.8 to about 53 at 3.8. Between theoretical quantiles of about −1.6 and 1.7 the points stay close to the line, a little above it from about −1.5 to 0 and a little below it from about 0 to 1.6. Below −1.6 the points fall farther and farther below the line, reaching about −89 at −3.8. Above 1.7 they rise farther and farther above it, with a jump from about 50 to about 60 near 3, reaching about 84 at 3.8.

Short Tails: Points begin above the line but curves below for larger values.

  • Data is more concentrated around the center than normal

  • Fewer extreme values than expected

  • Sometimes seen in truncated or bounded measurements

Histogram, boxplot and normal quantile plot of short-tailed data; points level off above the line at left, below it at right.

Fig. 6.35 Normal probability plot for short-tailed data

Describe this figure in detail

Three panels side by side for one large data set: a histogram, a boxplot and a normal quantile plot.

Left, histogram: the horizontal axis is Values, with ticks at −0.85, 9.15 and 19.15, and the bars cover about 0 to 25; the vertical axis is Density, from 0 to 0.095. The bar heights climb from about 0.003 at the left end, roughly along a straight line with some jagged steps, to a peak of about 0.078 near 13, then fall the same way to about 0.003 at the right end, so the outline is close to a triangle. The smooth purple density curve peaks at about 0.076 near 13 and ends at both sides close to the height of the end bars. A dashed and a dotted vertical line, almost on top of each other at about 12.5, carry the labels M and x̄.

Middle, boxplot on a vertical axis with ticks at −0.85, 9.15 and 19.15: the box runs from about 8.8 to about 16.1, with the median (orange line) at about 12.6. The whiskers reach about 0.3 and about 24.8, and there are no individual points beyond them.

Right, “Normal Quantile Plot”: the horizontal axis is Theoretical Quantiles, from −4 to 4; the vertical axis is Ordered Values, with ticks from −5 to 30. The red reference line runs from about −7 at −3.8 to about 32 at 3.8. Between theoretical quantiles of about −1.8 and 1.8 the points stay within about 1 unit of the line. Below −1.8 they flatten out above the line and level off near 0; the lowest point is about 0.2 at −3.8, where the line is at about −7. Above 1.8 they flatten out below the line and level off near 25; the highest point is about 24.8 at 3.8, where the line is at about 32.

Right (Positive) Skewness: Concave-up curve

Histogram, boxplot and normal quantile plot of right-skewed data; the quantile plot points bend upward away from the line.

Fig. 6.36 Normal probability plot for right-skewed data

Describe this figure in detail

Three panels side by side for one large data set: a histogram, a boxplot and a normal quantile plot.

Left, histogram: the horizontal axis is Values, with ticks every 10 from −23.6 to 86.4; the vertical axis is Density, from 0 to 0.035. The bars rise steeply from about −23 on the left to a peak of about 0.0355 near −1, then decline more gradually to the right: they are near 0.0035 at about 36 and are still visible out to about 56, and the smooth purple density curve stays just above 0 out to about 91. A dotted vertical line at about 4 has the label M just to its right, and a dashed vertical line at about 6 has the label x̄ just to its right.

Middle, boxplot on a vertical axis with ticks every 10 from −23.6 to 86.4: the box runs from about −3.3 to about 12.3, with the median (orange line) at about 3.9, so the part of the box above the median is a little longer. The lower whisker reaches about −23 and the upper whisker about 36. Above the upper whisker there are many individual points, packed densely up to about 56 and then more spread out up to about 91; there are no points below the lower whisker.

Right, “Normal Quantile Plot”: the horizontal axis is Theoretical Quantiles, from −4 to 4; the vertical axis is Ordered Values, with ticks from −40 to 80. The red reference line runs from about −41 at −3.8 to about 53 at 3.8. The points follow a curve that bends upward. Below theoretical quantile −1 they lie above the line and flatten out; the lowest point is about −22 at −3.8, where the line is at about −41. Between −1 and 1.2 they lie slightly below the line. Above 1.2 they rise farther and farther above the line, with a jump from about 55 to about 68 near 3, reaching about 91 at 3.8.

Left (Negative) Skewness: Concave-down curve

Histogram, boxplot and normal quantile plot of left-skewed data; the quantile plot points bend downward away from the line.

Fig. 6.37 Normal probability plot for left-skewed data

Describe this figure in detail

Three panels side by side for one large data set: a histogram, a boxplot and a normal quantile plot.

Left, histogram: the horizontal axis is Values, with ticks every 10 from −97 to 23; the vertical axis is Density, with ticks from 0.000 to 0.035. The bars rise gradually from the left to a peak of about 0.038 near 2, then drop steeply to the right edge of the data at about 22. On the left the bars form a long, low tail: they are visible from about −67, and the smooth purple density curve stays just above 0 out to about −97. A dashed vertical line at about −6 has the label x̄ just to its right, and a dotted vertical line at about −3.6 has the label M just to its right.

Middle, boxplot on a vertical axis with ticks every 10 from −97 to 23: the box runs from about −12.8 to about 3, with the median (orange line) at about −3.4, so the part of the box below the median is longer. The upper whisker reaches about 22 and the lower whisker about −36.5. Below the lower whisker there are many individual points, packed densely down to about −55 and then more spread out down to about −96; there are no points above the upper whisker.

Right, “Normal Quantile Plot”: the horizontal axis is Theoretical Quantiles, from −4 to 4; the vertical axis is Ordered Values, with ticks from −100 to 40. The red reference line runs from about −53 at −3.8 to about 42 at 3.8. The points follow a curve that bends downward. Below theoretical quantile −1 they fall farther and farther below the line, in widening steps, reaching about −96 at −3.8. Between −1 and 0.7 they lie slightly above the line. Above 0.7 they lie below the line and flatten out near 20; the highest point is about 22 at 3.8, where the line is at about 42.

Bimodality: S-shaped curve with plateaus

  • Points cluster in the middle region of the plot

  • Suggests the data might come from a mixture of two populations

Histogram, boxplot and normal quantile plot of bimodal data; the quantile plot points form an S shape around the line.

Fig. 6.38 Normal probability plot for bimodal data

Describe this figure in detail

Three panels side by side for one large data set: a histogram, a boxplot and a normal quantile plot.

Left, histogram: the horizontal axis is Values, with ticks every 10 from −30.88 to 29.12, and the bars cover about −30 to 30; the vertical axis is Density, from 0 to 0.095. The bars form two separate humps of similar size: the left hump is centered near −13 with its tallest bar at about 0.040, and the right hump is centered near 13.5 with its tallest bar at about 0.041. Between the humps, from about −2 to 2, the bars are nearly 0, and the smooth purple density curve dips to about 0.002 near 0. A dashed vertical line at about 0.2, in the gap, is labeled x̄, and a dotted vertical line at about 3.3, at the foot of the right hump, is labeled M.

Middle, boxplot on a vertical axis with ticks every 10 from −30.88 to 29.12: the box is wide, running from about −13 to about 13.6, with the median (orange line) at about 3.3. The whiskers reach about −30 and about 30, and there are no individual points beyond them.

Right, “Normal Quantile Plot”: the horizontal axis is Theoretical Quantiles, from −4 to 4; the vertical axis is Ordered Values, with ticks from −40 to 40. The red reference line runs from about −51 at −3.8 to about 52 at 3.8. The points form three parts. From theoretical quantile −3.8 to just below 0 they rise slowly, from about −30 to about −8. At 0 they jump almost straight up, from about −5 to about 5. From just above 0 to 3.8 they again rise slowly, from about 8 to about 30. As a result the points lie above the line below −1.3, below it from −1.3 to 0, above it from 0 to 1.2, and below it above 1.2.

6.4.10. Numerical Assessments for Normality

While visual methods provide intuitive insights, numerical methods offer precise, quantifiable assessments of normality.

A. The Empirical Rule in Reverse

Instead of using the 68-95-99.7 rule to predict probabilities, we can use it in reverse to check whether our data behaves as a normal distribution should:

For truly normal data,

  • Approximately 68% of observations should fall within one standard deviation: \(\bar{x} \pm s\).

  • Approximately 95% should fall within two standard deviations: \(\bar{x} \pm 2s\).

  • Approximately 99.7% should fall within three standard deviations: \(\bar{x} \pm 3s\).

Implementation Steps

  1. Calculate the sample mean \(\bar{x}\) and sample standard deviation \(s\).

  2. Count observations within each interval.

  3. Compare observed proportions to expected proportions (0.68, 0.95, 0.997).

  4. Large deviations suggest non-normality.

B. The IQR-to-Standard Deviation Ratio

For normal distributions, there’s a consistent relationship between the interquartile range and the standard deviation. This relationship arises from the fixed positions of quantiles in any normal distribution.

For any normal distribution \(N(\mu, \sigma)\):

  • The first quartile (25th percentile) occurs at \(\mu - 0.674\sigma\).

  • The third quartile (75th percentile) occurs at \(\mu + 0.674\sigma\).

  • Therefore: \(IQR = Q_3 - Q_1 = 1.348\sigma\).

  • The ratio \(\frac{IQR}{\sigma} \approx 1.35\) (often rounded to 1.4).

Implementation Steps

  1. Calculate the sample IQR and sample standard deviation \(s\).

  2. Compute the ratio \(\frac{IQR}{s}\).

  3. Values close to 1.35 suggest normality.

  4. Values substantially different indicate departures from normality.

6.4.11. Formal Statistical Tests for Assessing Normality

While visual and numerical methods provide insights, formal statistical tests such as Shapiro-Wilk Test and variants of the Kolmogorov-Smirnov Test offer rigorous hypothesis testing frameworks for normality. These tests are covered in more advanced statistics courses.

6.4.12. Bringing It All Together

Key Takeaways 📝

  1. The normal distribution emerged from Gauss’s work on measurement errors and has become the most important continuous distribution in statistics.

  2. The PDF \(f_X(x) = \frac{1}{\sigma\sqrt{2\pi}} e^{-\frac{1}{2}\left(\frac{x-\mu}{\sigma}\right)^2}\) is completely determined by two parameters: location \(\mu\) and scale \(\sigma\).

  3. All normal distributions are symmetric, unimodal, and bell-shaped, with inflection points at \(\mu \pm \sigma\).

  4. The empirical rule (68-95-99.7) provides quick probability estimates and applies to every normal distribution regardless of parameters.

  5. Mathematical rigor: We proved the normal PDF is valid through polar coordinate integration and confirmed that \(E[X] = \mu\) and \(\text{Var}(X) = \sigma^2\).

  6. The standard normal distribution \(N(0,1)\) serves as the foundation for all normal computations. The standardizing transformation \(Z = \frac{X-\mu}{\sigma}\) links any normal distribution to the standard one.

  7. Assessing normality requires multiple approaches: visual methods (histograms, QQ-plots), numerical checks (empirical rule, IQR ratios), and formal tests (Shapiro-Wilk, Kolmogorov-Smirnov variants).

6.4.13. Exercises

These exercises develop your skills in working with normal distributions, including applying the empirical rule, standardization, computing probabilities (forward problems), finding percentiles (backward problems), and assessing normality.

Notation Convention

In this course, we write \(X \sim N(\mu, \sigma^2)\) where the second parameter is the variance. Always extract \(\sigma = \sqrt{\sigma^2}\) before standardizing. When using Z-tables, round z-scores to two decimal places. If a probability falls exactly between two table entries, average the corresponding z-values.

Exercise 1: Empirical Rule Applications

A semiconductor manufacturer produces microprocessors with clock speeds that follow a normal distribution with mean \(\mu = 3.2\) GHz and variance \(\sigma^2 = 0.0225\) GHz².

  1. State the intervals containing approximately 68%, 95%, and 99.7% of clock speeds.

  2. What percentage of processors have clock speeds between 2.9 GHz and 3.5 GHz?

  3. A processor is considered “premium grade” if its clock speed exceeds 3.5 GHz. Approximately what percentage qualifies?

  4. Quality control flags processors with clock speeds below 2.75 GHz as defective. Approximately what percentage is flagged?

Solution

Let \(X\) = clock speed (GHz), where \(X \sim N(\mu = 3.2, \sigma^2 = 0.0225)\).

First, extract the standard deviation: \(\sigma = \sqrt{0.0225} = 0.15\) GHz.

Part (a): Empirical rule intervals

  • 68% interval: \(\mu \pm \sigma = 3.2 \pm 0.15 = (3.05, 3.35)\) GHz

  • 95% interval: \(\mu \pm 2\sigma = 3.2 \pm 0.30 = (2.90, 3.50)\) GHz

  • 99.7% interval: \(\mu \pm 3\sigma = 3.2 \pm 0.45 = (2.75, 3.65)\) GHz

Empirical rule intervals for processor clock speeds

Fig. 6.39 The 68-95-99.7 rule applied to processor clock speeds.

Describe this figure in detail

Normal density curve titled “Empirical Rule: 68-95-99.7” with the subtitle “Processor Clock Speeds ~ N(3.2, 0.15)”. The horizontal axis is labeled Clock Speed (GHz), but its ticks are labeled μ − 3σ through μ + 3σ, without GHz values; the vertical axis is Density, from 0 to about 2.7. The dark blue curve peaks at about 2.66 on the density axis above μ, where a red dashed vertical line is drawn.

The area under the curve is shaded in three bands. The darkest band, between μ − σ and μ + σ, is labeled 68%. Lighter teal bands extend it out to μ − 2σ and μ + 2σ, with the label 95% on the left teal band. The lightest green bands extend out to μ − 3σ and μ + 3σ, with the label 99.7% on the right green band. Beyond μ − 3σ and μ + 3σ the curve is unshaded and close to 0.

Part (b): P(2.9 < X < 3.5)

Note that \(2.9 = \mu - 2\sigma\) and \(3.5 = \mu + 2\sigma\).

By the empirical rule, \(P(\mu - 2\sigma < X < \mu + 2\sigma) \approx 0.95\) or 95%.

Part (c): P(X > 3.5)

Since \(3.5 = \mu + 2\sigma\), we need \(P(X > \mu + 2\sigma)\).

From the empirical rule, 95% falls within \(\pm 2\sigma\), leaving 5% in both tails combined.

By symmetry, \(P(X > \mu + 2\sigma) \approx \frac{0.05}{2} = 0.025\) or 2.5%.

Part (d): P(X < 2.75)

Since \(2.75 = \mu - 3\sigma\), we need \(P(X < \mu - 3\sigma)\).

From the empirical rule, 99.7% falls within \(\pm 3\sigma\), leaving 0.3% in both tails.

By symmetry, \(P(X < \mu - 3\sigma) \approx \frac{0.003}{2} = 0.0015\) or 0.15%.


Exercise 2: Standardization and Z-Scores

The tensile strength of a carbon fiber composite follows a normal distribution with \(\mu = 600\) MPa and \(\sigma^2 = 1600\) MPa².

  1. Find the z-score for a specimen with tensile strength 680 MPa. Interpret this value.

  2. Find the z-score for a specimen with tensile strength 520 MPa. Interpret this value.

  3. A specimen has a z-score of -0.75. What is its tensile strength?

  4. Which is more unusual: a specimen with strength 700 MPa or one with strength 500 MPa? Justify using z-scores.

  5. The specification requires tensile strength within 2 standard deviations of the mean. Express this requirement in terms of the original units (MPa).

Solution

Let \(X\) = tensile strength (MPa), where \(X \sim N(\mu = 600, \sigma^2 = 1600)\).

First, extract the standard deviation: \(\sigma = \sqrt{1600} = 40\) MPa.

Part (a): Z-score for x = 680

\[z = \frac{x - \mu}{\sigma} = \frac{680 - 600}{40} = \frac{80}{40} = 2.0\]

Interpretation: A tensile strength of 680 MPa is 2 standard deviations above the mean. This is an unusually high value—only about 2.5% of specimens exceed this strength.

Part (b): Z-score for x = 520

\[z = \frac{520 - 600}{40} = \frac{-80}{40} = -2.0\]

Interpretation: A tensile strength of 520 MPa is 2 standard deviations below the mean. This is an unusually low value.

Part (c): Tensile strength for z = -0.75

Solve for \(x\): \(x = \mu + z\sigma = 600 + (-0.75)(40) = 600 - 30 = 570\) MPa.

Part (d): Compare unusualness

For \(x = 700\): \(z = \frac{700 - 600}{40} = 2.5\)

For \(x = 500\): \(z = \frac{500 - 600}{40} = -2.5\)

Both have \(|z| = 2.5\), so they are equally unusual—each is 2.5 standard deviations from the mean.

Z-scores showing symmetric unusualness

Fig. 6.40 Both values are equally far from the mean in terms of standard deviations.

Describe this figure in detail

Normal density curve titled “Equally Unusual Values (Symmetric Z-Scores)” with the subtitle “Tensile Strength ~ N(600, 40)”. The horizontal axis is Tensile Strength (MPa), from about 440 to 760, with ticks at 500, 600 and 700; the vertical axis is Density, from 0 to 0.0100. The curve, with the area under it lightly shaded, peaks at 0.0100 on the density axis at 600, where a black dashed vertical line is labeled μ = 600.

Red vertical lines mark 500, labeled “x = 500” and “z = −2.5”, and 700, labeled “x = 700” and “z = +2.5”. At both lines the curve is close to 0, at about 0.0004. Two purple arrows at a density of about 0.004 run from 500 to 600 and from 600 to 700, and each is labeled 2.5σ.

Part (e): Specification in original units

Within 2 standard deviations: \(\mu \pm 2\sigma = 600 \pm 80 = (520, 680)\) MPa.

The specification requires tensile strength between 520 and 680 MPa.


Exercise 3: Forward Problem — Computing Probabilities

Response times for a web application follow a normal distribution with mean \(\mu = 250\) ms and variance \(\sigma^2 = 1225\) ms².

  1. Find the probability that a randomly selected response takes less than 200 ms.

  2. Find the probability that a response takes more than 300 ms.

  3. Find the probability that a response takes between 220 and 280 ms.

  4. The service level agreement (SLA) specifies that responses exceeding 320 ms are unacceptable. What proportion of responses violate the SLA?

Solution

Let \(X\) = response time (ms), where \(X \sim N(\mu = 250, \sigma^2 = 1225)\).

First, extract the standard deviation: \(\sigma = \sqrt{1225} = 35\) ms.

Part (a): P(X < 200)

P(X < 200) shaded region

Fig. 6.41 Shaded region represents P(X < 200).

Describe this figure in detail

Normal density curve titled “P(X < 200)”. The horizontal axis is Response Time (ms), from about 110 to 390, with ticks at 100, 200, 300 and 400; the vertical axis is Density, with ticks at 0.000, 0.003, 0.006 and 0.009. The curve peaks at about 0.0114 on the density axis at 250. A red dashed vertical line at 200 is labeled z = −1.43 and meets the curve at about 0.004. The area under the curve to the left of 200 is shaded blue and labeled P(X < 200); the rest of the area under the curve is unshaded.

Step 1: Standardize.

\[z = \frac{200 - 250}{35} = \frac{-50}{35} = -1.43\]

Step 2: Use Z-table.

\[P(X < 200) = P(Z < -1.43) = \Phi(-1.43) = 0.0764\]

Part (b): P(X > 300)

Step 1: Standardize.

\[z = \frac{300 - 250}{35} = \frac{50}{35} = 1.43\]

Step 2: Use complement rule.

\[P(X > 300) = P(Z > 1.43) = 1 - \Phi(1.43) = 1 - 0.9236 = 0.0764\]

Note: By symmetry, P(X < 200) = P(X > 300) since both are 1.43 standard deviations from the mean.

Part (c): P(220 < X < 280)

P(220 < X < 280) shaded region

Fig. 6.42 Shaded region represents P(220 < X < 280).

Describe this figure in detail

Normal density curve titled “P(220 < X < 280)”. The horizontal axis is Response Time (ms), from about 110 to 390, with ticks at 100, 200, 300 and 400; the vertical axis is Density, with ticks at 0.000, 0.003, 0.006 and 0.009. The curve peaks at about 0.0114 on the density axis at 250. Red dashed vertical lines at 220, labeled z = −0.86, and at 280, labeled z = 0.86, meet the curve at about 0.008. The area under the curve between 220 and 280 is shaded blue and labeled P(220 < X < 280); the two tails are unshaded.

Step 1: Standardize both bounds.

\[z_1 = \frac{220 - 250}{35} = -0.86 \quad \text{and} \quad z_2 = \frac{280 - 250}{35} = 0.86\]

Step 2: Use interval formula.

\[P(220 < X < 280) = \Phi(0.86) - \Phi(-0.86)\]

Step 3: Apply symmetry: \(\Phi(-0.86) = 1 - \Phi(0.86)\).

\[P(220 < X < 280) = \Phi(0.86) - (1 - \Phi(0.86)) = 2\Phi(0.86) - 1\]

Step 4: Look up and compute.

\[P(220 < X < 280) = 2(0.8051) - 1 = 0.6102\]

Part (d): P(X > 320)

Step 1: Standardize.

\[z = \frac{320 - 250}{35} = 2.0\]

Step 2: Compute.

\[P(X > 320) = 1 - \Phi(2.0) = 1 - 0.9772 = 0.0228\]

Approximately 2.28% of responses violate the SLA.


Exercise 4: Backward Problem — Finding Percentiles

The fuel efficiency of a hybrid vehicle model follows a normal distribution with mean \(\mu = 52\) mpg and variance \(\sigma^2 = 16\) mpg².

  1. Find the 90th percentile of fuel efficiency.

  2. Find the fuel efficiency value such that only 5% of vehicles perform worse (lower mpg).

  3. Find the cutoffs for the middle 80% of fuel efficiency values.

  4. A vehicle is classified as “high efficiency” if it ranks in the top 10%. What is the minimum fuel efficiency for this classification?

Solution

Let \(X\) = fuel efficiency (mpg), where \(X \sim N(\mu = 52, \sigma^2 = 16)\).

First, extract the standard deviation: \(\sigma = \sqrt{16} = 4\) mpg.

Part (a): 90th percentile

We seek \(x_{0.90}\) such that \(P(X \leq x_{0.90}) = 0.90\).

Step 1: Find \(z_{0.90}\) from Z-table by locating 0.90 in the body.

From the table: \(\Phi(1.28) = 0.8997\) and \(\Phi(1.29) = 0.9015\).

Since \(|0.90 - 0.8997| = 0.0003 < |0.90 - 0.9015| = 0.0015\), we use \(z_{0.90} = 1.28\).

Step 2: Convert to original scale.

\[x_{0.90} = \mu + z_{0.90} \cdot \sigma = 52 + 1.28(4) = 52 + 5.12 = 57.12 \text{ mpg}\]
90th percentile visualization

Fig. 6.43 The 90th percentile: 90% of vehicles have fuel efficiency at or below 57.12 mpg.

Describe this figure in detail

Normal density curve titled “90th Percentile” with the subtitle “Fuel Efficiency ~ N(52, 4)”. The horizontal axis is Fuel Efficiency (mpg), from about 36 to 68, with ticks at 40, 50 and 60; the vertical axis is Density, from 0 to 0.100. The curve peaks at about 0.100 on the density axis at 52. A red vertical line at about 57.1 is labeled “x₀.₉₀ = 57.13” and meets the curve at about 0.044. The area under the curve to the left of the line is shaded blue and labeled 90%; the unshaded right tail is labeled 10%.

Part (b): 5th percentile

We seek \(x_{0.05}\) such that \(P(X \leq x_{0.05}) = 0.05\).

Step 1: Find \(z_{0.05}\) from the Z-table.

From the table: \(\Phi(-1.64) = 0.0505\) and \(\Phi(-1.65) = 0.0495\).

Since 0.05 is exactly halfway between 0.0495 and 0.0505, we average the z-values:

\[z_{0.05} = \frac{-1.64 + (-1.65)}{2} = -1.645\]

Step 2: Convert.

\[x_{0.05} = 52 + (-1.645)(4) = 52 - 6.58 = 45.42 \text{ mpg}\]

Only 5% of vehicles have fuel efficiency below 45.42 mpg.

Part (c): Middle 80% cutoffs

The middle 80% leaves 10% in each tail, so we need \(x_{0.10}\) and \(x_{0.90}\).

For the 10th percentile:

From the table: \(\Phi(-1.28) = 0.1003 \approx 0.10\), so \(z_{0.10} = -1.28\).

\(x_{0.10} = 52 + (-1.28)(4) = 46.88\) mpg

For the 90th percentile: \(z_{0.90} = 1.28\) (from part a).

\(x_{0.90} = 57.12\) mpg

The middle 80% falls between 46.88 and 57.12 mpg.

Part (d): Top 10% cutoff

“Top 10%” means \(P(X > x) = 0.10\), which is equivalent to \(P(X \leq x) = 0.90\).

This is the 90th percentile: 57.12 mpg (same as part a).


Exercise 5: Combined Forward and Backward Problems

Battery life for a laptop model follows a normal distribution with mean \(\mu = 8.5\) hours and variance \(\sigma^2 = 1.44\) hours².

  1. What proportion of laptops have battery life between 7 and 10 hours?

  2. The manufacturer wants to advertise a “minimum guaranteed battery life” that 95% of laptops will meet or exceed. What value should they advertise?

  3. If 1000 laptops are sold, approximately how many will have battery life exceeding 11 hours?

  4. A laptop’s battery life is at the 70th percentile. How many hours does it last?

  5. Two laptops have battery lives of 6.5 hours and 10.5 hours. Which is more unusual relative to the distribution?

Solution

Let \(X\) = battery life (hours), where \(X \sim N(\mu = 8.5, \sigma^2 = 1.44)\).

First, extract the standard deviation: \(\sigma = \sqrt{1.44} = 1.2\) hours.

Part (a): P(7 < X < 10) — Forward problem

Standardize: \(z_1 = \frac{7 - 8.5}{1.2} = -1.25\) and \(z_2 = \frac{10 - 8.5}{1.2} = 1.25\).

From the Z-table: \(\Phi(1.25) = 0.8944\) and \(\Phi(-1.25) = 0.1056\).

\[P(7 < X < 10) = \Phi(1.25) - \Phi(-1.25) = 0.8944 - 0.1056 = 0.7888\]

Approximately 78.88% of laptops have battery life between 7 and 10 hours.

Part (b): 5th percentile — Backward problem

We need \(x_{0.05}\) such that 95% exceed this value (i.e., 5% fall below).

From the Z-table: \(\Phi(-1.64) = 0.0505\) and \(\Phi(-1.65) = 0.0495\).

Since 0.05 is exactly halfway, we average: \(z_{0.05} = \frac{-1.64 + (-1.65)}{2} = -1.645\).

\[x_{0.05} = 8.5 + (-1.645)(1.2) = 8.5 - 1.974 = 6.526 \text{ hours}\]

Under the model, approximately 95% of laptops exceed 6.53 hours. For a conservative marketing claim, the manufacturer should advertise 6.5 hours (rounded down to ensure the guarantee is met).

Part (c): Number exceeding 11 hours — Forward problem with application

Standardize: \(z = \frac{11 - 8.5}{1.2} = 2.08\).

\[P(X > 11) = 1 - \Phi(2.08) = 1 - 0.9812 = 0.0188\]

Expected number: \(1000 \times 0.0188 \approx 19\) laptops.

Part (d): 70th percentile — Backward problem

From the Z-table, we locate 0.70 in the body: \(\Phi(0.52) = 0.6985\) and \(\Phi(0.53) = 0.7019\).

Since \(|0.70 - 0.6985| = 0.0015 < |0.70 - 0.7019| = 0.0019\), we use \(z_{0.70} = 0.52\).

\[x_{0.70} = 8.5 + 0.52(1.2) = 8.5 + 0.624 = 9.12 \text{ hours}\]

Part (e): Compare unusualness

For \(x = 6.5\): \(z = \frac{6.5 - 8.5}{1.2} = -1.67\)

For \(x = 10.5\): \(z = \frac{10.5 - 8.5}{1.2} = 1.67\)

Both have \(|z| = 1.67\), so they are equally unusual.


Exercise 6: Parameter Identification

A normal distribution has specific characteristics. Use these to find the parameters \(\mu\) and \(\sigma\).

  1. The inflection points of the PDF occur at \(x = 42\) and \(x = 58\). Find \(\mu\) and \(\sigma\).

  2. The 16th percentile is 28 and the 84th percentile is 52. Find \(\mu\) and \(\sigma\).

  3. The distribution has \(P(X < 70) = 0.90\) and \(P(X < 40) = 0.20\). Find \(\mu\) and \(\sigma\).

Solution

Part (a): Using inflection points

The inflection points of a normal PDF occur at \(\mu - \sigma\) and \(\mu + \sigma\).

\[\mu - \sigma = 42 \quad \text{and} \quad \mu + \sigma = 58\]

Adding: \(2\mu = 100 \implies \mu = 50\)

Subtracting: \(2\sigma = 16 \implies \sigma = 8\)

Answer: \(\mu = 50\), \(\sigma = 8\).

Normal distribution with inflection points marked

Fig. 6.44 Inflection points occur exactly at μ ± σ.

Describe this figure in detail

Normal density curve titled “Inflection Points at μ ± σ”. The horizontal axis is x, from about 18 to 82, with ticks at 20, 40, 60 and 80; the vertical axis is Density, with ticks at 0.00, 0.02 and 0.04. The curve, with the area under it lightly shaded, peaks at about 0.050 on the density axis at 50, where a black dashed vertical line is labeled μ = 50. Red dots on the curve at 42 and 58, at a density of about 0.030, are labeled “μ − σ = 42” and “μ + σ = 58”. A purple double-headed arrow between the two dots is labeled 2σ = 16.

Part (b): Using symmetric percentiles

Note that the 16th and 84th percentiles are symmetric about the mean.

From the Z-table: \(\Phi(-0.99) = 0.1611\) and \(\Phi(-1.00) = 0.1587\).

Since \(|0.16 - 0.1611| = 0.0011 < |0.16 - 0.1587| = 0.0013\), we use \(z_{0.16} = -0.99\).

By symmetry, \(z_{0.84} = 0.99\).

This gives us:

\[\mu - 0.99\sigma = 28 \quad \text{and} \quad \mu + 0.99\sigma = 52\]

Adding: \(2\mu = 80 \implies \mu = 40\)

Subtracting: \(1.98\sigma = 24 \implies \sigma = 12.12\)

Answer: \(\mu = 40\), \(\sigma \approx 12.1\) (or \(\sigma^2 \approx 147\)).

Part (c): Using two probability statements

From \(P(X < 70) = 0.90\): Looking up 0.90 in the Z-table, \(\Phi(1.28) = 0.8997 \approx 0.90\), so \(z = 1.28\).

From \(P(X < 40) = 0.20\): Looking up 0.20, \(\Phi(-0.84) = 0.2005 \approx 0.20\), so \(z = -0.84\).

Setting up equations:

\[\frac{70 - \mu}{\sigma} = 1.28 \implies 70 - \mu = 1.28\sigma\]
\[\frac{40 - \mu}{\sigma} = -0.84 \implies 40 - \mu = -0.84\sigma\]

Subtracting the second from the first:

\[30 = 1.28\sigma + 0.84\sigma = 2.12\sigma \implies \sigma = \frac{30}{2.12} = 14.15\]

Substituting back: \(\mu = 70 - 1.28(14.15) = 70 - 18.11 = 51.89\)

Answer: \(\mu \approx 51.9\), \(\sigma \approx 14.2\) (or \(\sigma^2 \approx 200\)).


Exercise 7: Assessing Normality — Visual Methods

A materials engineer collects 50 measurements of yield strength (MPa) for aluminum alloy specimens. The sample statistics are \(\bar{x} = 275.3\) MPa and \(s = 12.8\) MPa.

The histogram and QQ-plot are shown below.

Histogram and QQ-plot for yield strength data

Fig. 6.45 Left: Histogram with kernel density (red) and normal curve (blue). Right: Normal QQ-plot.

Describe this figure in detail

Two panels for the 50 yield strength measurements.

Left, “Histogram with Density Curves”: the horizontal axis is Yield Strength (MPa), from about 240 to 310, with ticks at 240, 260, 280 and 300; the vertical axis is Density, from 0 to about 0.036. Nine gray bars of equal width cover about 243 to 308 MPa. From left to right their heights are about 0.003, 0.005, 0.019, 0.036, 0.025, 0.025, 0.011, 0.008 and 0.005 on the density axis, so the tallest bar is the fourth, from about 265 to 272 MPa, and there are three bars left of it and five to its right. The blue curve (normal density) is symmetric and peaks at about 0.031 near 275 MPa. The red curve (kernel density estimate) peaks at about 0.030 near 268 MPa, left of the blue peak. The red curve lies above the blue one from the left end to about 270 MPa, below it from about 270 to 297 MPa, where it has a flat shoulder at about 0.026, and above it again from about 297 MPa to the right end, where it ends at about 0.004 and the blue curve at about 0.002.

Right, “Normal Q-Q Plot”: the horizontal axis is Theoretical Quantiles, from about −2.3 to 2.3; the vertical axis is Sample Quantiles, with ticks at 260, 280 and 300, and the points run from about 249 to 307 MPa. A red reference line runs from about 246 at −2.3 to about 303 at 2.3. Between theoretical quantiles of about −0.8 and 1.2 the points lie within about 2 MPa of the line, slightly below it from −0.7 to 0, with a step up from about 273 to about 277 just right of 0. From −2.3 to −0.8 the points lie 1 to 3 MPa above the line; the lowest point, about 249, is 3 MPa above it. The five highest points, at theoretical quantiles from about 1.3 to 2.3 (about 296 to 307 MPa), all lie above the line by about 4 to 5 MPa.

  1. Based on the histogram, does the data appear approximately normal? Comment on the alignment of the kernel density curve and the fitted normal curve.

  2. Interpret the QQ-plot. Do the points follow the reference line reasonably well?

  3. Identify any specific departures from normality visible in either plot.

  4. Overall, would you conclude the normality assumption is reasonable for this data?

Solution

Part (a): Histogram interpretation

The histogram shows a roughly symmetric, unimodal distribution. The kernel density curve (red) and fitted normal curve (blue) align reasonably well, with both showing a bell-shaped pattern centered near 275 MPa. There is some minor roughness in the kernel density due to sampling variation with n=50, but no obvious skewness (neither tail appears systematically longer than the other).

Part (b): QQ-plot interpretation

The QQ-plot shows points that generally follow the reference line from the lower-left to upper-right. Most points fall close to or on the line, suggesting the data quantiles match the theoretical normal quantiles well. There is no systematic curvature (which would indicate skewness) or S-shape (which would indicate heavy/light tails).

Part (c): Specific departures

Examining the plots for specific features:

  • Skewness: No evidence—both tails appear similar in length.

  • Outliers: No points in the QQ-plot are dramatically far from the line.

  • Tail behavior: The extreme points in the QQ-plot do not show systematic curvature at either end.

Minor deviations are expected with n=50 due to sampling variability.

Part (d): Conclusion

Based on both visual assessments, the normality assumption appears reasonable for this data. The histogram is approximately symmetric and bell-shaped, and the QQ-plot shows points close to the reference line with no systematic patterns of departure.


Exercise 8: Assessing Normality — Numerical Methods

For the aluminum alloy data from Exercise 7 (\(n = 50\), \(\bar{x} = 275.3\) MPa, \(s = 12.8\) MPa), additional sample statistics are provided:

  • Sample IQR: 17.1 MPa

  • Observations within \(\bar{x} \pm s\): 34 out of 50

  • Observations within \(\bar{x} \pm 2s\): 48 out of 50

  • Observations within \(\bar{x} \pm 3s\): 50 out of 50

  1. Apply the empirical rule check. Compare the observed proportions to the expected 68-95-99.7 values.

  2. Compute the IQR-to-standard deviation ratio. Compare to the theoretical value for normal distributions.

  3. Based on these numerical checks, does the data appear consistent with a normal distribution?

Solution

Part (a): Empirical rule check

Interval

Observed Count

Observed %

Expected %

Difference

\(\bar{x} \pm 1s\)

34/50

68%

68%

0%

\(\bar{x} \pm 2s\)

48/50

96%

95%

+1%

\(\bar{x} \pm 3s\)

50/50

100%

99.7%

+0.3%

The observed proportions are remarkably close to the expected values.

Note on sampling variability: With n=50 observations from a true normal distribution, the count within \(\pm 2\sigma\) follows approximately a Binomial(50, 0.95) distribution. The standard deviation of this count is \(\sqrt{50 \times 0.95 \times 0.05} \approx 1.5\), so observing 48 instead of the expected 47.5 is well within normal sampling variation.

Part (b): IQR-to-SD ratio

\[\frac{\text{IQR}}{s} = \frac{17.1}{12.8} = 1.336\]

For a normal distribution, the theoretical ratio is approximately 1.35.

The observed ratio (1.336) is very close to the expected value, indicating consistency with normality.

Part (c): Conclusion

Yes, the numerical checks strongly support normality:

  • Empirical rule proportions match almost exactly (68%, 96%, 100% vs. 68%, 95%, 99.7%)

  • IQR/SD ratio (1.336) is very close to the theoretical 1.35

Combined with the visual assessments from Exercise 7, we have some evidence that the normality assumption is appropriate.


Exercise 9: Identifying Non-Normal Distributions

Four datasets have been analyzed with QQ-plots shown below. Match each QQ-plot pattern to the appropriate description of the underlying distribution.

Four normal QQ-plots labeled (A) to (D), each showing sample points against a red reference line.

Fig. 6.46 Four QQ-plots: (A) upper-left, (B) upper-right, (C) lower-left, (D) lower-right.

Describe this figure in detail

Four normal Q-Q plots in a two-by-two grid, titled (A) Pattern 1 (upper left), (B) Pattern 2 (upper right), (C) Pattern 3 (lower left) and (D) Pattern 4 (lower right). In every panel the horizontal axis is Theoretical, from about −2.6 to 2.6, the vertical axis is Sample, the points are black, and a straight red reference line rises from lower left to upper right.

  1. Pattern 1: the vertical axis runs from about −2.7 to 2.7, and the line runs from about −2.7 at the left edge to about 2.7 at the right edge. Between theoretical values of about −1 and 1.3 the points lie on or very close to the line. Below −1 the points level off near −1.2 between −1.5 and −1, and the lowest points lie above the line; the lowest is about −1.9 where the line is at about −2.7. Above 1.3 the points level off near 1.5 between 1.4 and 1.8 and lie below the line; the highest is about 2.1 where the line is at about 2.7.

  2. Pattern 2: the vertical axis runs from about −1 to 5.3, and the line runs from about −1.0 to about 2.5. The lowest points form a nearly flat row just above 0, from about 0.0 at −2.6 to about 0.2 at −1, above the line. Between about −0.8 and 1.0 the points lie close to the line, slightly below it between about −0.5 and 0.5. Above 1.0 the points climb steeply above the line in widening steps: about 2.4 at 1.4, 3.2 at 1.5, 4.4 at 1.95 and 5.3 at 2.6, where the line is at about 2.5.

  3. Pattern 3: the vertical axis runs from about −4.1 to 1.3, and the line runs from about −3.3 to about 1.3. The lowest points lie below the line: about −4.1 at −2.6 and about −3.5 at −2, rising steeply to meet the line near −0.8. Between about −0.5 and 0.5 the points lie slightly above the line. Above about 0.7 they flatten out below the line and level off just below 0; the highest points, from 1.5 to 2.6, are all at about 0, while the line reaches about 1.3.

  4. Pattern 4: the vertical axis runs from about −8.4 to 5, and the line runs from about −3.1 to about 2.7. Between about −0.7 and 0.6 the points lie on or very close to the line. Below −1.5 the points drop far below the line: about −3.3 at −1.6, −5.5 at −1.7, −6.2 at −1.95, −7.1 at −2.2 and −8.4 at −2.6, where the line is at about −3.1. Above about 0.7 the points lie slightly above the line, and the three highest rise farther above it: about 2.7 at 1.95, 3.1 at 2.2 and 4.7 at 2.6.

Match each plot (A, B, C, D) with one of these descriptions:

  1. Right-skewed distribution (long right tail)

  2. Left-skewed distribution (long left tail)

  3. Heavy-tailed distribution (more extreme values than normal)

  4. Approximately normal distribution

Solution

Plot A: Approximately normal distribution (Description 4)

The points fall close to the reference line throughout, indicating the sample quantiles match the theoretical normal quantiles well.

Plot B: Right-skewed distribution (Description 1)

The points curve upward (concave up) away from the reference line. This indicates:

  • Lower quantiles match well

  • Upper quantiles are larger than expected for a normal

  • The right tail is stretched out (right/positive skew)

Plot C: Left-skewed distribution (Description 2)

The points curve downward (concave down) away from the reference line. This indicates:

  • Lower quantiles are smaller than expected

  • Upper quantiles match reasonably

  • The left tail is stretched out (left/negative skew)

Plot D: Heavy-tailed distribution (Description 3)

The points form an S-shape:

  • Lower quantiles fall below the line (more extreme negative values than normal)

  • Upper quantiles rise above the line (more extreme positive values than normal)

  • Both tails are heavier than a normal distribution

Summary Table:

Plot

Pattern

Distribution Type

A

Points on line

Normal

B

Concave up (curved up)

Right-skewed

C

Concave down (curved down)

Left-skewed

D

S-shaped

Heavy-tailed


6.4.14. Additional Practice Problems

True/False Questions (1 point each)

  1. For any normal distribution, the mean equals the median.

    Ⓣ or Ⓕ

  2. If \(X \sim N(100, 25)\), then the standard deviation is 5.

    Ⓣ or Ⓕ

  3. A z-score of -1.5 indicates a value 1.5 standard deviations below the mean.

    Ⓣ or Ⓕ

  4. For a standard normal distribution, \(P(Z > 0) = 0.5\).

    Ⓣ or Ⓕ

  5. The inflection points of a normal PDF occur at \(\mu \pm 2\sigma\).

    Ⓣ or Ⓕ

  6. If \(X \sim N(\mu, \sigma^2)\), then \(P(X < \mu) = 0.5\).

    Ⓣ or Ⓕ

  7. A QQ-plot that curves upward indicates left-skewed data.

    Ⓣ or Ⓕ

  8. For normal distributions, the IQR is approximately 1.35 times the standard deviation.

    Ⓣ or Ⓕ

Multiple Choice Questions (2 points each)

  1. For \(X \sim N(50, 100)\), what is \(P(X < 60)\)?

    Ⓐ 0.6915

    Ⓑ 0.8413

    Ⓒ 0.9332

    Ⓓ 0.9772

  2. If \(Z \sim N(0, 1)\) and \(P(Z < z) = 0.75\), what is \(z\)?

    Ⓐ 0.25

    Ⓑ 0.67

    Ⓒ 0.75

    Ⓓ 1.15

  3. A normal distribution has \(\mu = 80\) and \(\sigma = 10\). What value has a z-score of -2?

    Ⓐ 60

    Ⓑ 70

    Ⓒ 78

    Ⓓ 100

  4. According to the empirical rule, approximately what percentage of values fall more than 2 standard deviations from the mean?

    Ⓐ 2.5%

    Ⓑ 5%

    Ⓒ 32%

    Ⓓ 95%

  5. For \(X \sim N(200, 400)\), what is the 95th percentile?

    Ⓐ 212.8

    Ⓑ 225.8

    Ⓒ 232.9

    Ⓓ 265.8

  6. Which QQ-plot pattern indicates heavy tails?

    Ⓐ Points curve upward (concave up)

    Ⓑ Points curve downward (concave down)

    Ⓒ S-shaped pattern (low points below line, high points above)

    Ⓓ Points fall exactly on the reference line

Answers to Practice Problems

True/False Answers:

  1. True — Normal distributions are perfectly symmetric, so mean = median.

  2. True — In the notation \(N(\mu, \sigma^2)\), the second parameter is variance. Since \(\sigma^2 = 25\), we have \(\sigma = \sqrt{25} = 5\).

  3. True — A z-score represents the number of standard deviations from the mean. Negative z-scores are below the mean.

  4. True — By symmetry around 0, exactly half the probability is above 0 and half below.

  5. False — Inflection points occur at \(\mu \pm \sigma\) (one standard deviation), not two.

  6. True — By symmetry, exactly 50% of the distribution falls below the mean.

  7. False — A QQ-plot that curves upward (concave up) indicates right-skewed data. Left-skewed data produces a concave-down pattern.

  8. True — For normal distributions, IQR ≈ 1.35σ (specifically, 1.348σ).

Multiple Choice Answers:

  1. Ⓑ — \(\sigma = \sqrt{100} = 10\), so \(z = \frac{60-50}{10} = 1.0\). From the table: \(\Phi(1.00) = 0.8413\).

  2. Ⓑ — Looking up 0.75 in the Z-table body: \(\Phi(0.67) = 0.7486\) and \(\Phi(0.68) = 0.7517\). Since 0.7486 is closer to 0.75, \(z \approx 0.67\).

  3. Ⓐ — \(x = \mu + z\sigma = 80 + (-2)(10) = 60\).

  4. Ⓑ — 95% fall within ±2σ, so 5% fall outside (more than 2 SD from mean).

  5. Ⓒ — \(\sigma = \sqrt{400} = 20\). For \(z_{0.95}\): \(\Phi(1.64) = 0.9495\) and \(\Phi(1.65) = 0.9505\). Since 0.95 is exactly halfway, \(z_{0.95} = 1.645\). Thus \(x_{0.95} = 200 + 1.645(20) = 232.9\).

  6. Ⓒ — Heavy tails produce an S-shaped pattern where both extremes deviate from the line in opposite directions.