Statistics & Probability · Lesson 16

Sampling Distributions

Sampling Distributions is a probability/statistics concept used to describe uncertainty.

ConceptWorked examplePracticeKnowledge check
Textbook walkthrough

What Sampling Distributions actually means

Sampling Distributions is a probability/statistics concept used to describe uncertainty. Probability models connect random outcomes to numerical summaries such as expectation, variance and conditional probability; inference uses the distribution of statistics across hypothetical samples to reason from a sample to a population.

Sampling Distributions matters because probability and statistics describe variation rather than just calculate point summaries. They provide the basis for uncertainty, sampling reasoning, hypothesis tests and probabilistic model interpretation.

Deeper walkthrough

Read Sampling Distributions as a mechanism, not a recipe

Treat this as a sequence of observable decisions rather than one opaque command. Stage 1: Define the random variable/event and probability model. Stage 2: Compute or estimate probabilities/statistics under the model. Stage 3: Distinguish a population parameter from a sample statistic. Final checkpoint: Quantify sampling uncertainty with an interval, posterior or other appropriate method.

Mechanism

Follow the transformation

Define the random variable/event and probability model.

Compute or estimate probabilities/statistics under the model.

Distinguish a population parameter from a sample statistic.

Evidence

Know what would convince you

  • Compute a tiny example by hand or simulate a simple case where the expected behaviour is known.
  • Check units, sample size, denominator and assumptions before interpreting the statistic.
Useful distinctionRandom variable: Maps outcomes to numerical values.
Visual demonstration of Sampling Distributions
Visual demonstration: use the diagram to trace the main objects and state changes involved in Sampling Distributions.
Click a stage to inspect what happens, what changes, and what should be checked before moving on.
Stage 1

Define the random variable/event and probability…

Define the random variable/event and probability model. This is an input-preparation stage for Sampling Distributions. Verify the relevant type, shape, units, keys, missingness or assumptions before later steps depend on them.

Input focus: confirm the data/object, units, type, shape and assumptions before the next operation depends on them.
How it works

Trace the mechanism step by step

  1. Define the random variable/event and probability model.
  2. Compute or estimate probabilities/statistics under the model.
  3. Distinguish a population parameter from a sample statistic.
  4. Use conditional probability when information changes what outcomes are plausible.
  5. Quantify sampling uncertainty with an interval, posterior or other appropriate method.
Worked demonstration

Make the concept concrete

Demonstration

Python example

# Step 1 — Import the module so its functions/classes are available to the rest of this example.
import random, statistics
# Step 2 — Compute the right-hand expression and store its result in `pop` for the next step.
pop=[1,2,3,4,5,6]
# Step 3 — Compute the right-hand expression and store its result in `means` for the next step.
means=[]
# Step 4 — Execute this statement and inspect how it changes the current value, object or program state.
random.seed(0)
# Step 5 — Iterate through the collection so the indented block is applied once for each item.
for _ in range(1000):
    # Step 6 — Execute this statement and inspect how it changes the current value, object or program state.
    means.append(statistics.mean(random.choices(pop,k=4)))
# Step 7 — Display the current value explicitly so the result/state can be inspected during execution.
print(round(statistics.mean(means),2), round(statistics.stdev(means),2))
Expected / illustrative result
The repeated sample means form a distribution that is narrower than the distribution of individual observations.
Interpret the result.

For Sampling Distributions, connect the displayed result to the specific input and mechanism above; independently verify one value/state change rather than treating successful execution as proof.

Distinctions & related ideas

Know what this is — and what it is not

Random variableMaps outcomes to numerical values.
ExpectationProbability-weighted long-run average.
VarianceExpected squared deviation from the mean.
Sampling distributionDistribution a statistic would have across repeated samples.
Bayes ruleUpdates a conditional probability by combining prior plausibility and likelihood of evidence.
Use deliberately

When it is appropriate

Use Sampling Distributions when the statistical quantity or inferential idea matches the variable type, sampling process and question being asked.

Boundary conditions

When to stop or reconsider

Do not interpret the result beyond the assumptions and design that support it; distinguish descriptive evidence, uncertainty and causal claims.

Common mistakes

Failure modes to recognise

  • Using a summary or test that does not match the variable scale, dependence structure or sampling design.
  • Treating a point estimate or p-value as a complete statement without effect size, uncertainty or context.
  • Confusing association with causation or sample behaviour with a guaranteed population truth.
Verification

How to check the result

  • Compute a tiny example by hand or simulate a simple case where the expected behaviour is known.
  • Check units, sample size, denominator and assumptions before interpreting the statistic.
  • Change one observation/assumption and predict how the estimate or uncertainty should respond.
Hands-on practice

Demonstrate understanding

Try this:

Build a tiny, inspectable example of Sampling Distributions. First define the random variable/event and probability model. Then compute or estimate probabilities/statistics under the model. Write the expected result before running it, and explain one condition that would make the result misleading or invalid.

Use a very small numeric/categorical example and calculate one quantity manually. Separate what is observed in the sample from what is inferred about a wider process.
Knowledge check

Check reasoning, not memorisation

Before trusting a result from Sampling Distributions, which check provides the strongest evidence that you understand and applied it correctly?

Quick reference

Keep the important distinctions visible

Step 1Define the random variable/event and probability model.
Step 2Compute or estimate probabilities/statistics under the model.
Step 3Distinguish a population parameter from a sample statistic.
Step 4Use conditional probability when information changes what outcomes are plausible.
Lesson summary

What to remember

  • Sampling Distributions is a probability/statistics concept used to describe uncertainty. Probability models connect random outcomes to numerical summaries such as expectation, variance and conditional probability; inference uses the distribution of statistics across hypothetical samples to reason from a sample to a population.
  • Define the random variable/event and probability model.
  • Using a summary or test that does not match the variable scale, dependence structure or sampling design.
  • Compute a tiny example by hand or simulate a simple case where the expected behaviour is known.