Random Sampling and Bias

Active learning replaces abstract definitions with concrete actions that make random sampling and bias tangible. When students physically draw tiles or debate survey trustworthiness, they experience firsthand why random processes matter and how bias creeps in. This kinesthetic and social engagement builds durable understanding beyond what a lecture alone can achieve.

• 7th Grade
• Mathematics
• 3 activities
• 15 min–30 min

Learning Objectives

1. Analyze given sampling methods to identify potential sources of bias.
2. Compare the results of random samples to voluntary response samples for a given population question.
3. Explain why random sampling is essential for making valid inferences about a population.
4. Evaluate the impact of sample size on the reliability of statistical inferences.
5. Design a simple random sampling plan for a specified scenario.

Ready-to-Use Activities

Simulation Game

⏱ 30 min·Small Groups

Simulation Game: Bag of Colored Tiles

Each group receives a bag with an unknown proportion of two colors of tiles. They draw 5-tile samples repeatedly, record results, and predict the full bag composition. Groups compare predictions and then reveal the true proportion to discuss sample size effects.

Prepare & details

What makes a sample representative of a population?

Facilitation Tip: During the Bag of Colored Tiles simulation, emphasize that students must close their eyes or use a randomizer before pulling each tile to prevent subtle bias in their selection process.

Setup: Flexible space for group stations

Materials: Role cards with goals/resources, Game currency or tokens, Round tracker

• Apply
• Analyze
• Evaluate
• Create
• Social Awareness
• Decision-Making

Think-Pair-Share

⏱ 15 min·Pairs

Think-Pair-Share: Is This Sample Random?

Present five sampling methods for a school-wide survey. Students individually classify each as random or biased, then discuss with a partner. Whole-class discussion focuses on the two or three cases where partners disagreed.

Prepare & details

Why is random sampling the best way to avoid bias in data collection?

Facilitation Tip: During the Think-Pair-Share, assign roles so one student explains and the other listens actively before switching, ensuring both voices contribute to the analysis.

Setup: Standard classroom seating; students turn to a neighbor

Materials: Discussion prompt (projected or printed), Optional: recording sheet for pairs

• Understand
• Apply
• Analyze
• Self-Awareness
• Relationship Skills

Formal Debate

⏱ 25 min·Small Groups

Formal Debate: Should We Trust This Survey?

Share a 'news story' reporting survey results based on a clearly described sample. Groups are assigned to argue either that the sample supports the conclusion or that it doesn't. After 5 minutes of prep, groups debate while the class votes on the most convincing argument.

Prepare & details

How much confidence can we have in an inference made from a small sample size?

Facilitation Tip: During the Debate, assign specific stances in advance and require each team to cite evidence from the simulation or historical examples in their opening statements.

Setup: Two teams facing each other, audience seating for the rest

Materials: Debate proposition card, Research brief for each side, Judging rubric for audience, Timer

• Analyze
• Evaluate
• Create
• Self-Management
• Decision-Making

Teaching This Topic

Teachers who anchor this topic in concrete simulations and real-world controversies see deeper retention than those who rely solely on definitions. Avoid rushing to abstract formulas; instead, let students confront their intuitive notions of fairness and then systematically dismantle them through evidence. Research shows that guided reflection after activity debriefs cements conceptual change more reliably than immediate corrective feedback.

What to Expect

By the end of these activities, students should confidently distinguish random from biased samples and justify their choices using evidence from simulations or debates. They should articulate why equal chance selection matters and identify real-world consequences when it is ignored. Look for clear explanations paired with precise terminology in their written work and discussions.

Watch Out for These Misconceptions

Common Misconception

During the Bag of Colored Tiles simulation, watch for students who believe simply pulling tiles without looking is random even if they peek occasionally or select multiple tiles at once.

What to Teach Instead

Pause the simulation after a few pulls and ask the class to describe the exact protocol they used. Highlight that any deviation from one tile at a time with eyes closed introduces predictability, and have them re-run the process with a strict no-peeking rule.

Common Misconception

During the Debate about survey trustworthiness, watch for the claim that 'more responses always mean less bias' when discussing high-response voluntary surveys.

What to Teach Instead

Reference the Literary Digest example and ask students to calculate response rates versus selection bias. Have them revise their arguments using data from the simulation where small biased samples produced distorted results.

Assessment Ideas

Quick Check

After the Bag of Colored Tiles simulation, present students with three sampling scenarios on a handout. Ask them to label each as convenience, voluntary, or random, and write one sentence explaining why the random sample avoids bias, collecting responses before discussion.

Discussion Prompt

During the Think-Pair-Share, circulate and listen for students to articulate at least one specific bias in the non-random scenarios before sharing out whole group, using their analysis to assess whether they can identify selection mechanisms that distort results.

Exit Ticket

After the Debate, give students a scenario where a 10-student sample is drawn from a 30-student class by surveying only those sitting in the back row. Ask them to write two sentences explaining two sources of bias in this method and how a random sample would correct them.

Extensions & Scaffolding

• Challenge: Ask students to design a biased sampling method that still looks random on the surface, then have peers identify the hidden flaw.
• Scaffolding: Provide sentence stems for the Think-Pair-Share such as, 'This sample appears random because... but it is actually biased because...'
• Deeper exploration: Have students research a historical polling failure, trace how convenience or voluntary response shaped the outcome, and present their findings to the class.

Key Vocabulary

Population	The entire group of individuals or objects that we want to study or draw conclusions about.
Sample	A subset of individuals or objects selected from a population to represent the entire group.
Random Sampling	A method of selecting a sample where every member of the population has an equal and independent chance of being chosen.
Bias	A systematic error introduced into sampling or testing by selecting or encouraging any one outcome or answer over others.
Sampling Variability	The natural variation in results that occurs when different samples are taken from the same population.