The Statistical Cycle and Data Collection

Active learning works for this topic because students need to experience firsthand how subtle wording choices and sampling decisions shape results. When they rewrite biased questions or test sampling methods themselves, the impact of bias becomes concrete rather than abstract.

• Year 7
• Mathematics
• 4 activities
• 25 min–40 min

Learning Objectives

1. Design a survey to investigate a question about their school community, ensuring questions are unbiased and sampling methods are appropriate.
2. Compare the results of a biased survey question with an unbiased one, explaining the impact of wording on data.
3. Evaluate the reliability of data collected through different sampling methods, such as convenience sampling versus random sampling.
4. Explain how the size of a sample influences the generalizability of the data collected.
5. Critique potential sources of bias in real-world data collection scenarios, such as opinion polls or product reviews.

Case Study Analysis

⏱ 25 min·Pairs

Pairs: Fair Question Rewrite

Pairs identify leading questions from a list, such as 'Everyone hates maths homework, don't they?'. They rewrite each as fair versions and test both on classmates, recording response differences. Pairs share top examples with the class.

Prepare & details

Analyze what constitutes a 'fair' survey question versus a 'leading' one.

Facilitation Tip: For Fair Question Rewrite, provide two starter questions per pair and circulate to ask students to read each aloud, noting how tone shifts their imagined response.

Setup: Groups at tables with case materials

Materials: Case study packet (3-5 pages), Analysis framework worksheet, Presentation template

• Analyze
• Evaluate
• Create
• Decision-Making
• Self-Management

Case Study Analysis

⏱ 40 min·Small Groups

Small Groups: Sampling Method Trial

Groups receive class data on hobbies. They apply random, stratified, and convenience sampling to subsets, then compare results for accuracy against full data. Groups chart biases and present to class.

Prepare & details

Explain how the size and method of sampling affect data reliability.

Facilitation Tip: During Sampling Method Trial, give groups three sampling options and require them to justify which they would use for a real Year 7 class survey about lunches.

Setup: Groups at tables with case materials

Materials: Case study packet (3-5 pages), Analysis framework worksheet, Presentation template

• Analyze
• Evaluate
• Create
• Decision-Making
• Self-Management

Case Study Analysis

⏱ 30 min·Whole Class

Whole Class: Real Survey Critique

Display sample surveys from news or ads. Class votes thumbs up or down for fairness and bias, then discusses evidence. Tally votes to show collective judgement patterns.

Prepare & details

Critique the potential for bias in various data collection methods.

Facilitation Tip: In Real Survey Critique, assign each small group one flawed survey to present, then have the class vote on the single biggest source of bias in each sample.

Setup: Groups at tables with case materials

Materials: Case study packet (3-5 pages), Analysis framework worksheet, Presentation template

• Analyze
• Evaluate
• Create
• Decision-Making
• Self-Management

Case Study Analysis

⏱ 35 min·Individual

Individual: Mini Survey Plan

Each student plans a survey on a class topic, noting question wording and sampling method. They conduct it with five peers and note any issues encountered. Submit plans for peer review.

Prepare & details

Analyze what constitutes a 'fair' survey question versus a 'leading' one.

Facilitation Tip: For Mini Survey Plan, require a one-sentence research question, three data collection details, and one sentence explaining how the plan avoids bias.

Setup: Groups at tables with case materials

Materials: Case study packet (3-5 pages), Analysis framework worksheet, Presentation template

• Analyze
• Evaluate
• Create
• Decision-Making
• Self-Management

Teaching This Topic

Start with quick polls about class favorites to surface unconscious bias, then immediately contrast results from different sampling frames. Teachers should model how to rephrase questions by substituting neutral words and invite students to challenge their own wording. Keep the focus on process over perfection, emphasizing that even imperfect plans can be improved through reflection.

What to Expect

Successful learning looks like students identifying leading language in questions, justifying why small or non-random samples mislead, and proposing fairer alternatives. They apply these skills in short planning tasks and critiques, showing they can adjust methods to reduce bias.

Watch Out for These Misconceptions

Common Misconception

During Fair Question Rewrite, watch for students assuming that longer questions are always better or that adding 'please' removes bias.

What to Teach Instead

Ask pairs to underline the leading words in each starter question. Then prompt them to replace loaded terms with neutral alternatives and test both versions on two classmates before finalizing.

Common Misconception

During Sampling Method Trial, watch for students equating a larger sample size with fairness, ignoring how the sample is chosen.

What to Teach Instead

Provide three options: survey the first ten students in line, survey ten students from each Year 7 form class, and survey ten students chosen by a random number generator. Ask groups to collect a tiny set of mock data from each and compare how the sampling frames affect results.

Common Misconception

During Real Survey Critique, watch for students blaming biased responses on dishonesty rather than flawed methods.

What to Teach Instead

Have each group present one flaw in their assigned survey, then lead a class vote on whether the issue is in question wording or sampling. Ask students to suggest one concrete change to improve fairness.

Assessment Ideas

Exit Ticket

After Fair Question Rewrite, have students submit their revised question along with a one-sentence note on why the new wording is fairer.

Quick Check

During Sampling Method Trial, listen for groups explaining why a convenience sample misses diversity, then ask one volunteer to share their reasoning with the class.

Discussion Prompt

After Real Survey Critique, pose a quick discussion: 'Which sampling method do you trust most and why?' Call on three students to share in one sentence each, then ask for a counterpoint.

Extensions & Scaffolding

• Challenge: Ask students to design a two-question survey on a topic of their choice, then swap with a partner to test for bias and revise together.
• Scaffolding: Provide sentence stems like 'Which wording feels fairer, and why?' and 'How could we ask more students?' to guide planning.
• Deeper exploration: Have students compare class survey results with school-wide data (if available) and explain differences using sampling frames.

Key Vocabulary

Statistical Question	A question that can be answered by collecting and analyzing data, and which has variability in its answers.
Bias	A systematic error introduced into sampling or testing by selecting or encouraging any an outcome or answer in a particular direction. This can occur through question wording or sampling method.
Sampling Method	The technique used to select a subset of individuals or items from a larger population for data collection.
Convenience Sample	A sample composed of individuals or data that are easily accessible, which can often lead to biased results.
Random Sample	A sample where every member of the population has an equal chance of being selected, helping to reduce bias.