Mathematics · 9th Grade · Statistical Reasoning and Data · Weeks 10-18

Experimental Design

Understanding the principles of experimental design, including control groups, randomization, and blinding.

• Common Core State Standards
• CCSS.Math.Content.HSS.IC.B.3

About This Topic

Experimental design is a cornerstone of statistical reasoning in the US high school curriculum, introduced formally under the CCSS statistics standards. Students learn to distinguish between observational studies and controlled experiments, and to understand why structure matters when drawing causal conclusions. Key elements include the control group (a baseline that receives no treatment), random assignment of subjects to groups, and blinding or double-blinding to eliminate bias from participants or researchers.

At the 9th grade level, most students encounter experiments through science classes but rarely analyze the design itself. This topic asks them to slow down and ask: why does it matter how we set up an experiment? Real-world examples from clinical trials, agricultural testing, and psychology research make the concepts concrete and relevant.

Active learning works especially well here because students must make design decisions themselves. When they have to choose what to control and what to randomize in a scenario, the tradeoffs become visible in a way that a lecture cannot replicate.

Key Questions

1. Explain the role of a control group in an experiment.
2. Justify the importance of randomization and blinding in experimental design.
3. Design a simple experiment to test a hypothesis.

Learning Objectives

• Analyze the potential sources of bias in a given experimental scenario.
• Evaluate the effectiveness of different randomization techniques in minimizing bias.
• Design a simple experiment to test a hypothesis, including identifying control and experimental groups, and specifying randomization and blinding procedures.
• Explain the ethical considerations related to control groups in human or animal studies.

Before You Start

Formulating Hypotheses

Why: Students need to be able to state a testable prediction before they can design an experiment to test it.

Identifying Variables

Why: Understanding independent, dependent, and controlled variables is fundamental to setting up any experimental comparison.

Key Vocabulary

Control Group	A group in an experiment that does not receive the treatment or intervention being tested. It serves as a baseline for comparison.
Randomization	The process of assigning participants or subjects to different experimental groups by chance. This helps ensure groups are similar at the start of the experiment.
Blinding	A procedure where participants (single-blind) or both participants and researchers (double-blind) are unaware of which treatment or intervention is being administered.
Bias	A systematic error introduced into sampling or testing by selecting or encouraging one outcome or answer over others. Blinding and randomization help reduce bias.
Placebo	An inactive substance or treatment that looks like the real treatment but has no therapeutic effect. It is often given to the control group.

Watch Out for These Misconceptions

Common Misconception

A control group means doing nothing at all.

What to Teach Instead

The control group receives standard conditions or a placebo, not necessarily zero treatment. When students build their own experiments in small groups, they quickly see that 'doing nothing' is often ambiguous and must be defined carefully.

Common Misconception

Randomization just means making things fair or unbiased by choosing carefully.

What to Teach Instead

Randomization specifically means using a chance process to assign subjects to groups, which distributes unknown confounding variables across conditions. Deliberate careful selection is not randomization. Group design challenges help students see why chance assignment is more reliable than human judgment.

Common Misconception

Blinding is only relevant in medical studies.

What to Teach Instead

Any study where human judgment or behavior could be influenced by knowing the treatment condition benefits from blinding. This includes taste tests, grading studies, and behavioral research. Cross-subject examples in class discussions reveal the broader principle.

Active Learning Ideas

Think-Pair-Share: Flawed Experiment Analysis

Present students with three short experiment descriptions, each missing one key design element (e.g., no control group, no randomization). Students individually identify the flaw, then discuss with a partner before sharing with the class. The debrief focuses on what conclusions the flawed experiment cannot support.

20 min·Pairs

Gallery Walk: Real Experiment Critiques

Post six cards around the room, each describing a real or realistic experiment (from medicine, education, or agriculture). Student groups rotate and annotate each card with sticky notes identifying the control group, randomization method, and any blinding. Groups compare annotations when all have visited every station.

30 min·Small Groups

Design Challenge: Build Your Own Experiment

Small groups receive a simple testable question (e.g., 'Does listening to music improve memory?') and must design a complete experiment specifying subjects, treatment, control, randomization process, and blinding plan. Groups present their designs and the class votes on which design would be most trustworthy.

35 min·Small Groups

Real-World Connections

• Pharmaceutical companies, like Pfizer or Moderna, use rigorous experimental designs with control groups, randomization, and double-blinding to test the safety and efficacy of new vaccines and medications before they are approved by regulatory bodies like the FDA.
• Agricultural scientists at research institutions, such as the USDA's Agricultural Research Service, design field experiments to compare the yield of different crop varieties or the effectiveness of new fertilizers, using randomized block designs to account for variations in soil and sunlight.

Assessment Ideas

Quick Check

Present students with a scenario, such as testing a new fertilizer on plant growth. Ask them to identify: 1. The independent variable. 2. The dependent variable. 3. The control group. 4. How they would randomize plant assignments. 5. Whether blinding is necessary and why.

Discussion Prompt

Pose the question: 'Imagine a study testing a new teaching method for math. Why is it crucial to have a control group that continues with the traditional method, and how could randomization and blinding help ensure fair results?' Facilitate a class discussion on their responses.

Exit Ticket

Provide students with a brief description of a medical study. Ask them to write one sentence explaining the purpose of the control group and one sentence explaining how blinding would improve the study's validity.

Frequently Asked Questions

What is the purpose of a control group in an experiment?

A control group provides a baseline for comparison. Without it, you cannot tell whether an observed change was caused by the treatment or by something else. The control group experiences everything the experimental group does except the specific treatment being tested, isolating the treatment as the one variable that differs.

Why is randomization important in experimental design?

Randomization distributes confounding variables evenly across groups by chance rather than by human choice. This means any pre-existing differences between subjects are spread across all conditions, so differences in outcomes can more reliably be attributed to the treatment rather than to hidden variables.

What is the difference between single-blind and double-blind experiments?

In a single-blind study, subjects do not know which group they are in. In a double-blind study, neither the subjects nor the researchers collecting data know the group assignments. Double-blinding prevents both the placebo effect in subjects and unconscious bias in researchers from affecting the results.

How does active learning help students understand experimental design?

When students design their own experiments and evaluate each other's designs, they encounter the real tradeoffs firsthand. Deciding how to randomize or what the control should be in a realistic scenario requires deeper thinking than identifying those elements in a textbook example, and peer critique surfaces errors that lecture alone cannot.