Hypothesis Testing

Hypothesis testing is abstract and counterintuitive for many students, so active learning helps make uncertainty concrete. Students need to experience the tension between evidence and decision-making before they can internalize why we never ‘accept’ a null hypothesis and how p-values function conditionally.

• Year 12
• Mathematics
• 3 activities
• 20 min–45 min

Learning Objectives

1. Formulate null and alternative hypotheses for a given statistical problem.
2. Calculate the p-value for a binomial test and interpret its meaning in relation to a chosen significance level.
3. Compare the outcomes of one-tailed and two-tailed hypothesis tests for a specified scenario.
4. Critique the limitations of statistical hypothesis testing in definitively proving a hypothesis.
5. Evaluate whether observed data provides sufficient evidence to reject a null hypothesis at a given significance level.

Mock Trial

⏱ 45 min·Whole Class

Mock Trial: The 'Lady Tasting Tea'

Recreate the famous experiment where a person claims to tell if milk was added before or after tea. Students calculate the probability of her getting a certain number right by chance and 'judge' whether her claim is supported by the evidence.

Prepare & details

Explain the significance of the p-value in determining a statistical outcome?

Facilitation Tip: During the Mock Trial, assign clear roles (prosecutor, defense, statistician) to keep the analogy focused on evidence versus truth.

Setup: Desks rearranged into courtroom layout

Materials: Role cards, Evidence packets, Verdict form for jury

• Analyze
• Evaluate
• Create
• Decision-Making
• Social Awareness

Think-Pair-Share

⏱ 20 min·Pairs

Think-Pair-Share: One-Tailed vs Two-Tailed

Give students various research claims (e.g., 'this diet makes you lose weight' vs 'this coin is biased'). In pairs, they must decide if the test should be one-tailed or two-tailed and justify their choice based on the wording.

Prepare & details

Differentiate between a one-tailed and a two-tailed test, justifying the choice for a given scenario?

Facilitation Tip: During Think-Pair-Share, provide a shared handout with three scenarios so pairs can clearly mark which tail they would use and why.

Setup: Standard classroom seating; students turn to a neighbor

Materials: Discussion prompt (projected or printed), Optional: recording sheet for pairs

• Understand
• Apply
• Analyze
• Self-Awareness
• Relationship Skills

Inquiry Circle

⏱ 35 min·Small Groups

Inquiry Circle: Critical Region Mapping

Groups are given a significance level and a binomial distribution. They must use calculators to find the 'critical region', the set of outcomes that would lead to rejecting the null hypothesis, and present their boundaries to the class.

Prepare & details

Critique the statement that statistics can 'prove' a hypothesis is true.

Facilitation Tip: During Collaborative Investigation, give each group a large sheet of paper to map critical regions visually, ensuring all students can see and contribute to the decision boundaries.

Setup: Groups at tables with access to source materials

Materials: Source material collection, Inquiry cycle worksheet, Question generation protocol, Findings presentation template

• Analyze
• Evaluate
• Create
• Self-Management
• Self-Awareness

Teaching This Topic

Teachers often find that students grasp hypothesis testing better when it is taught as a legal process rather than a mathematical one. Research suggests emphasizing the conditional nature of p-values early and repeatedly, and avoiding language like ‘accept the null’ to prevent misconceptions. Use analogies such as courtroom decisions to reinforce that statistical decisions are about evidence thresholds, not absolute truths.

What to Expect

Successful learning looks like students confidently setting up H0 and H1 for real scenarios, calculating correct p-values, and explaining why failing to reject H0 does not mean H0 is true. They should also justify the choice between one-tailed and two-tailed tests based on the research question.

Watch Out for These Misconceptions

Common Misconception

During Mock Trial: 'The lady is correct, so the null hypothesis is proven true.'

What to Teach Instead

Remind students that during the Mock Trial, 'not guilty' means insufficient evidence against the null, not proof of innocence. Ask them to restate their verdict in terms of failing to reject H0 rather than accepting it.

Common Misconception

During Collaborative Investigation, students may say 'the p-value is the chance the null is true.'

What to Teach Instead

Use the Collaborative Investigation’s calculated p-values to explicitly restate that the p-value is the probability of the observed data assuming H0 is true, not the probability of H0 itself. Have students write this as a conditional sentence on their investigation sheets.

Assessment Ideas

Quick Check

After Mock Trial, present the coin-bias scenario and ask students to write H0, H1, and the p-value calculation steps on a mini whiteboard to check their setup before moving forward.

Discussion Prompt

After Think-Pair-Share, facilitate a class discussion where students use their understanding of one- versus two-tailed tests to argue whether a claim about bias requires a one-tailed test. Have them reference the scenarios discussed during the activity.

Exit Ticket

During Collaborative Investigation, distribute exit tickets with a new scenario asking students to identify the appropriate test type and justify their choice in one sentence based on the research question.

Extensions & Scaffolding

• Challenge students who finish early to design their own hypothesis test scenario and calculate the critical region for a given significance level.
• Scaffolding for struggling students: Provide pre-labeled binomial tables and color-coded critical regions on a number line to reduce calculation errors.
• Deeper exploration: Ask students to compare Type I and Type II error rates for different sample sizes and significance levels using a spreadsheet simulation.

Key Vocabulary

Null Hypothesis (H0)	A statement of no effect or no difference, representing the default assumption that we aim to test against.
Alternative Hypothesis (H1)	A statement that contradicts the null hypothesis, suggesting there is an effect or difference to be found.
Significance Level (α)	The probability threshold, typically 0.05, set before data collection, for deciding whether to reject the null hypothesis.
p-value	The probability of observing a test statistic as extreme as, or more extreme than, the one calculated from the sample data, assuming the null hypothesis is true.
Critical Region	The set of values for the test statistic that would lead to rejection of the null hypothesis.