Misleading Statistics and Graphs

Active learning helps students see how easily statistics can mislead when they manipulate graphs or data collection. When they handle real examples, they notice patterns they might overlook in lectures. This approach builds skepticism and practical skills they can apply outside the classroom.

• Secondary 1
• Mathematics
• 4 activities
• 30 min–45 min

Learning Objectives

1. Analyze statistical claims presented in media to identify potential biases or distortions.
2. Evaluate the impact of sample size and sampling methods on the validity of statistical conclusions.
3. Critique the design of graphs and charts for misleading visual representations of data.
4. Formulate relevant questions to ask when encountering statistical data in reports or news articles.
5. Compare different graphical representations of the same data set to identify how visual choices can alter interpretation.

Gallery Walk

⏱ 45 min·Small Groups

Gallery Walk: Critique Media Graphs

Provide printouts of real-world graphs from news sources. In small groups, students label distortions like scale tricks or missing labels on sticky notes. The class tours the gallery, votes on the most misleading example, then discusses fixes as a whole.

Prepare & details

How does the sample size affect our confidence in a statistical conclusion?

Facilitation Tip: During the Gallery Walk, position yourself near one graph to overhear discussions and gently redirect groups that focus on aesthetics instead of data choices.

Setup: Wall space or tables arranged around room perimeter

Materials: Large paper/poster boards, Markers, Sticky notes for feedback

• Understand
• Apply
• Analyze
• Create
• Relationship Skills
• Social Awareness

Socratic Seminar

⏱ 30 min·Pairs

Graph Redesign Relay

Pairs receive a misleading graph and data set. One student sketches a corrected version while the partner explains changes verbally. Switch roles after 5 minutes, then share with the class for peer feedback.

Prepare & details

In what ways can data be cherry picked to support a specific bias?

Facilitation Tip: For the Graph Redesign Relay, provide rulers and graph paper so students practice precision when rebuilding fair scales.

Setup: Chairs arranged in two concentric circles

Materials: Discussion question/prompt (projected), Observation rubric for outer circle

• Analyze
• Evaluate
• Create
• Social Awareness
• Relationship Skills

Socratic Seminar

⏱ 40 min·Small Groups

Cherry-Pick Detective

Give small groups multiple data sets on a topic like phone sales. They create two graphs: one honest, one biased by selecting points. Groups present to justify choices and field class questions.

Prepare & details

What questions should we ask when presented with a new statistic in the news?

Facilitation Tip: In the Cherry-Pick Detective activity, assign each pair a different bias type to ensure all examples are covered during the full-class discussion.

Setup: Chairs arranged in two concentric circles

Materials: Discussion question/prompt (projected), Observation rubric for outer circle

• Analyze
• Evaluate
• Create
• Social Awareness
• Relationship Skills

Socratic Seminar

⏱ 35 min·Whole Class

Sample Size Simulation

Whole class simulates surveys with varying group sizes using dice rolls for 'opinions.' Compare results from small vs large samples on a shared board, noting confidence differences through repeated trials.

Prepare & details

How does the sample size affect our confidence in a statistical conclusion?

Setup: Chairs arranged in two concentric circles

Materials: Discussion question/prompt (projected), Observation rubric for outer circle

• Analyze
• Evaluate
• Create
• Social Awareness
• Relationship Skills

Teaching This Topic

Start with students’ own experiences reading news or social media to anchor the topic in relevance. Avoid teaching tricks or rules in isolation; instead, let students discover misleading techniques through guided analysis. Research shows that when students generate explanations for misleading graphs, their understanding transfers more effectively than when they only identify errors.

What to Expect

Students will confidently critique graphs and data claims by identifying misleading techniques and explaining why they distort meaning. They will ask targeted questions about sample size, graph design, and cherry-picked data. Written and verbal responses show clear reasoning about data reliability.

Watch Out for These Misconceptions

Common Misconception

During the Graph Redesign Relay, watch for students who assume any tall bar means a large increase without checking the y-axis start value.

What to Teach Instead

Have each pair present their redesigned graph and explain how the same data looks different when the y-axis starts at zero versus a higher value, using their own examples from the relay.

Common Misconception

During the Cherry-Pick Detective activity, watch for students who confuse correlation with causation when interpreting paired data.

What to Teach Instead

At the debate stations, require students to propose at least one alternative explanation for the observed relationship before accepting a causation claim.

Common Misconception

During the Sample Size Simulation, watch for students who believe a larger sample always guarantees accurate conclusions.

What to Teach Instead

Have groups compare their simulation results and discuss why even large samples can mislead if the sampling method is biased, using their collected data as evidence.

Assessment Ideas

Quick Check

After the Gallery Walk, provide two bar graphs of the same data, one with a truncated y-axis. Ask students to write one sentence explaining the difference in visual impact and one sentence identifying which graph is more misleading.

Discussion Prompt

During the Cherry-Pick Detective activity, present a news headline like '8 out of 10 dentists recommend our toothpaste!' Ask students to identify what questions they should ask about the sample to assess its reliability.

Exit Ticket

After the Sample Size Simulation, give each student a short data snippet about a school survey. Ask them to identify one potential issue with the sample size or sampling method and suggest one question they would ask the surveyors.

Extensions & Scaffolding

• Challenge: Students find a graph in the wild that uses at least two misleading techniques and prepare a 2-minute critique for the class.
• Scaffolding: Provide partially completed analyses with missing steps for students to fill in, focusing on one technique at a time.
• Deeper exploration: Compare official statistics from two countries, analyzing how different graphing conventions affect interpretation.

Key Vocabulary

Sample Size	The number of individuals or observations included in a statistical study. A larger sample size generally leads to more reliable results.
Sampling Bias	A systematic error introduced into sampling when some members of the population are less likely to be included than others, leading to unrepresentative results.
Truncated Axis	A graph where the vertical axis does not start at zero, which can exaggerate differences between values.
Cherry Picking	Selecting only the data that supports a particular argument while ignoring contradictory evidence.
Correlation vs. Causation	The mistaken belief that if two things are related (correlated), one must cause the other, when in fact there might be no direct link.