Data Collection Methods

Active learning works because students need to experience the consequences of biased or poorly designed data collection firsthand. When they collect real data from their own school community, they immediately see how sampling methods affect results, making abstract concepts about bias feel concrete and relevant. This direct engagement also builds the critical thinking skills needed to evaluate surveys and polls outside the classroom.

• Grade 9
• Mathematics
• 3 activities
• 30 min–50 min

Learning Objectives

1. Compare and contrast the methodologies of surveys, observations, and experiments, identifying the strengths and weaknesses of each for collecting specific types of data.
2. Analyze the advantages and disadvantages of using primary data sources versus secondary data sources in research, considering factors like cost, time, and accuracy.
3. Design a detailed data collection plan for a given research question, specifying the method, target population, sampling strategy, and instruments to be used.
4. Evaluate the potential sources of bias in different data collection methods and propose strategies to mitigate them.
5. Critique existing data collection instruments, such as questionnaires or observation protocols, for clarity, relevance, and potential bias.

Simulation Game

⏱ 35 min·Pairs

Simulation Game: The Bias Detective

Give students a set of survey questions about school life, some of which are 'loaded' or 'leading.' Students must identify the bias, explain how it would skew the results, and rewrite the questions to be neutral.

Prepare & details

Differentiate between various data collection methods and their appropriate uses.

Facilitation Tip: During the Bias Detective simulation, assign each student a specific role (e.g., surveyor, respondent, observer) to ensure everyone participates actively in the debrief about sources of bias.

Setup: Flexible space for group stations

Materials: Role cards with goals/resources, Game currency or tokens, Round tracker

• Apply
• Analyze
• Evaluate
• Create
• Social Awareness
• Decision-Making

Inquiry Circle

⏱ 50 min·Small Groups

Inquiry Circle: Sampling the School

Groups are tasked with finding the school's favorite music. One group uses convenience sampling (asking friends), another uses random sampling, and another uses stratified sampling (asking 5 people from each grade). They compare their results and discuss which is most valid.

Prepare & details

Analyze the advantages and disadvantages of primary versus secondary data sources.

Facilitation Tip: When Sampling the School, provide students with a mix of classroom and hallway locations to collect data, so they can compare convenience sampling to more systematic approaches.

Setup: Groups at tables with access to source materials

Materials: Source material collection, Inquiry cycle worksheet, Question generation protocol, Findings presentation template

• Analyze
• Evaluate
• Create
• Self-Management
• Self-Awareness

Formal Debate

⏱ 30 min·Small Groups

Formal Debate: Data Ethics

Present a case study where a company used biased data to make a decision. Students debate the ethical responsibility of the data collector and the potential impact on the community involved.

Prepare & details

Design a data collection plan for a specific research question.

Facilitation Tip: In the Structured Debate, assign half the class to defend a specific sampling method and the other half to critique it, forcing students to think from multiple perspectives.

Setup: Two teams facing each other, audience seating for the rest

Materials: Debate proposition card, Research brief for each side, Judging rubric for audience, Timer

• Analyze
• Evaluate
• Create
• Self-Management
• Decision-Making

Teaching This Topic

Teachers should emphasize that sampling is a deliberate process, not a random one. Avoid starting with definitions—instead, let students discover the need for structure through their own flawed attempts. Research shows that students retain concepts better when they design their own flawed surveys first, then revise them based on feedback.

What to Expect

Successful learning looks like students confidently explaining why certain sampling methods are appropriate for different scenarios and quickly identifying flaws in biased surveys. They should be able to justify their choices with clear reasoning and connect their understanding to real-world examples, such as census data or election polls.

Watch Out for These Misconceptions

Common Misconception

During the Bias Detective simulation, watch for students who assume a larger sample size automatically fixes bias. Redirect them by asking, 'If we only survey students in the library, will a larger sample size make the results more accurate?' Use the 'soup' analogy (a small spoonful of well-stirred soup tells you the flavor, but a whole bowl of unstirred soup might only give you the top layer) to clarify that method matters more than size.

What to Teach Instead

During the Sampling the School activity, watch for students who think convenience sampling is fine if they collect a large amount of data. Have them compare results from hallway surveys to classroom surveys to see how representation changes. Ask, 'Does the size of your sample fix the problem if you’re only surveying people who volunteer to stop and talk?'

Common Misconception

During the Structured Debate, watch for students who equate 'random' with 'chaotic' or 'unplanned.' Redirect them by asking, 'What would happen if you used a random number generator versus just picking people who looked friendly?' Have them compare the two methods using the activity’s data collection tools.

What to Teach Instead

During the Sampling the School activity, watch for students who equate 'random' with 'chaotic' or 'unplanned.' Redirect them by asking, 'What would happen if you used a random number generator versus just picking people who looked friendly?' Have them compare the two methods using the activity’s data collection tools.

Assessment Ideas

Discussion Prompt

After the Bias Detective simulation, present students with three scenarios: 1) Measuring student height in Grade 9, 2) Determining the most popular music genre among teenagers, 3) Testing the effectiveness of a new study technique. Ask: 'For each scenario, which data collection method (survey, observation, experiment) would be most appropriate and why? What are the potential advantages and disadvantages of your chosen method?' Use their responses to assess their ability to justify method choices and identify biases.

Quick Check

During the Sampling the School activity, provide students with a short questionnaire about school lunch preferences. Ask them to identify: 'Is this collecting primary or secondary data? What is one potential source of bias in these questions? How could you rephrase one question to make it less biased?' Collect their answers to assess their understanding of bias in real-time.

Exit Ticket

After the Structured Debate, distribute index cards and ask students to define one data collection method in their own words and provide one specific example of when it would be the best choice. They should also name one advantage and one disadvantage of that method. Use these to evaluate their ability to apply concepts and articulate trade-offs.

Extensions & Scaffolding

• Challenge early finishers to create a biased survey about a school-related topic, then have peers identify and fix the flaws in small groups.
• Scaffolding for strugglers: Provide sentence starters like, 'This survey is biased because...' and 'A better question would be...' to guide their analysis.
• Deeper exploration: Assign students to research how Indigenous communities are represented in Canadian census data and present one example of underrepresentation or misrepresentation.

Key Vocabulary

Survey	A method of collecting data by asking a set of questions to a group of individuals, either in person, by phone, mail, or online.
Observation	A data collection method involving systematically watching and recording behaviors, events, or characteristics in their natural setting.
Experiment	A controlled study where researchers manipulate one or more variables to determine their effect on another variable, often involving comparison between groups.
Primary Data	Information collected directly by the researcher for the specific purpose of their study, such as through surveys or experiments they conduct.
Secondary Data	Information that has already been collected by someone else for a different purpose, such as government statistics or published research.