Mathematics · Year 12

Active learning ideas

Sampling and Data Bias

Active learning helps students confront sampling bias directly, where abstract definitions often fail to stick. When students manipulate sampling methods themselves, they see firsthand how convenience samples distort results, making the abstract concept of bias tangible and memorable.

• National Curriculum Attainment Targets
• A-Level: Mathematics - Statistical Sampling
• A-Level: Mathematics - Data Presentation and Interpretation

• 25–45 min
• Pairs → Whole Class
• 4 activities

Activity 01

• Simulation Game
• 30 min · Pairs

Simulation Game: Dice Roll Sampling

Assign students a population of 100 dice rolls (pre-generated data sheet). In pairs, they take simple random samples of size 20, then stratified by even/odd numbers. Compare means and discuss bias. Graph results for class share.

Explain why a truly random sample is often difficult to achieve in practice.

Facilitation Tip

During Dice Roll Sampling, have students record their results in a shared table to visibly compare biased versus random outcomes.

What to look for

Present students with two scenarios: one describing a survey of student lunch preferences conducted only in the cafeteria queue (convenience sample), and another describing a survey where students are randomly selected from each year group (stratified sample). Ask: 'Which method is more likely to produce biased results, and why? What specific groups might be over or underrepresented in the first scenario?'

• Apply
• Analyze
• Evaluate
• Create
• Social Awareness
• Decision-Making

Activity 02

• Case Study Analysis
• 45 min · Small Groups

Survey Station Rotation: Bias Hunt

Set up stations with mock surveys: convenience (near door), quota (fixed groups), and cluster (class sections). Small groups sample classmates on a topic like study habits, rotate, then analyze response distributions for bias indicators.

Analyze how the choice of sampling method introduces systematic bias into a study.

Facilitation Tip

In Survey Station Rotation, rotate student groups every 7 minutes so they encounter multiple examples of bias in a short time.

What to look for

Provide students with a brief description of a study, for example, 'A study on the impact of screen time on Year 12 students' exam performance used a sampling frame of students who opted into an after-school study club.' Ask them to identify the potential sampling bias and explain how it might affect the study's conclusions.

• Analyze
• Evaluate
• Create
• Decision-Making
• Self-Management

Activity 03

• Case Study Analysis
• 35 min · Whole Class

Case Study Debate: Real Polls

Provide excerpts from flawed polls (e.g., 1936 Literary Digest). Whole class divides into method critique teams, debates sampling errors, and proposes fixes like stratification. Vote on best justifications.

Justify when it is appropriate to use stratified sampling over simple random sampling.

Facilitation Tip

Use Population Jar Draw to physically demonstrate how simple random sampling works, letting students draw and immediately see the distribution in the sample.

What to look for

Ask students to write down one situation where stratified sampling would be clearly superior to simple random sampling. They should name the population, the strata, and briefly explain why stratification is necessary for valid conclusions.

• Analyze
• Evaluate
• Create
• Decision-Making
• Self-Management

Activity 04

• Case Study Analysis
• 25 min · Individual

Population Jar Draw: Hands-On Randomness

Fill jars with colored beads representing population subgroups. Individuals draw simple random vs. stratified samples, calculate proportions, and reflect on deviations from true values in journals.

Explain why a truly random sample is often difficult to achieve in practice.

Facilitation Tip

For Case Study Debate, assign roles (pollster, statistician, critic) to ensure all students engage with the material actively.

What to look for

Present students with two scenarios: one describing a survey of student lunch preferences conducted only in the cafeteria queue (convenience sample), and another describing a survey where students are randomly selected from each year group (stratified sample). Ask: 'Which method is more likely to produce biased results, and why? What specific groups might be over or underrepresented in the first scenario?'

• Analyze
• Evaluate
• Create
• Decision-Making
• Self-Management

A few notes on teaching this unit

Teachers should focus on two key moves: first, let students experience the failure of biased methods before introducing correct techniques, and second, require constant justification of choices. Research shows that when students predict and then test a biased sample, the contrast creates stronger retention than lectures alone. Avoid spending too much time on definitions without immediate application; students learn sampling by doing, not by memorizing terms.

Successful learning looks like students explaining why a biased method skews data, selecting appropriate sampling techniques for varied populations, and justifying their choices with evidence from simulations or case studies.

---

Watch Out for These Misconceptions

• During Dice Roll Sampling, watch for students who assume rolling dice many times removes bias because the sample is large.

  Pause the activity and ask groups to calculate the percentage of even numbers in their rolls versus the expected 50%. This reveals that size does not fix method flaws, prompting a shift to discussing systematic error.

• During Survey Station Rotation, watch for students who label any non-random method as 'bad' without considering context or population homogeneity.

  Prompt students to defend why a convenience sample might work for a homogeneous group, using examples from their station data to ground the discussion in evidence.

• During Case Study Debate, watch for students who argue that stratified sampling is always superior, regardless of population structure.

  Provide a case where stratified sampling introduces unnecessary complexity, then have students calculate the cost of stratification versus simple random sampling for that scenario, forcing them to weigh trade-offs.

---

Methods used in this brief

• Simulation Game
• Case Study Analysis