Mathematics · Grade 9 · Data, Probability, and Decision Making · Term 3

Data Collection Methods

Students will explore different methods of data collection, including surveys, observations, and experiments.

• Ontario Curriculum Expectations
• CCSS.MATH.CONTENT.HSS.IC.B.3

About This Topic

Statistical Bias and Sampling is about the ethics and reliability of data. Students learn that how we collect data is just as important as the data itself. They explore different sampling methods, such as random, stratified, and convenience sampling, and identify sources of bias, including leading questions, non-response bias, and small sample sizes. This topic is essential for developing critical thinking In Canada, understanding sampling is vital for interpreting national census data, election polls, and public health information. It also touches on how different communities, including Indigenous and Francophone populations, are represented (or misrepresented) in data. Students grasp this concept faster through structured discussion and peer explanation, where they can critique real-world surveys and design their own 'unbiased' data collection plans.

Key Questions

1. Differentiate between various data collection methods and their appropriate uses.
2. Analyze the advantages and disadvantages of primary versus secondary data sources.
3. Design a data collection plan for a specific research question.

Learning Objectives

• Compare and contrast the methodologies of surveys, observations, and experiments, identifying the strengths and weaknesses of each for collecting specific types of data.
• Analyze the advantages and disadvantages of using primary data sources versus secondary data sources in research, considering factors like cost, time, and accuracy.
• Design a detailed data collection plan for a given research question, specifying the method, target population, sampling strategy, and instruments to be used.
• Evaluate the potential sources of bias in different data collection methods and propose strategies to mitigate them.
• Critique existing data collection instruments, such as questionnaires or observation protocols, for clarity, relevance, and potential bias.

Before You Start

Introduction to Data Analysis

Why: Students need a basic understanding of what data is and why it is collected before exploring different collection methods.

Types of Variables

Why: Understanding categorical and numerical variables is foundational for designing appropriate questions and observations.

Key Vocabulary

Survey	A method of collecting data by asking a set of questions to a group of individuals, either in person, by phone, mail, or online.
Observation	A data collection method involving systematically watching and recording behaviors, events, or characteristics in their natural setting.
Experiment	A controlled study where researchers manipulate one or more variables to determine their effect on another variable, often involving comparison between groups.
Primary Data	Information collected directly by the researcher for the specific purpose of their study, such as through surveys or experiments they conduct.
Secondary Data	Information that has already been collected by someone else for a different purpose, such as government statistics or published research.

Watch Out for These Misconceptions

Common Misconception

Students often think a larger sample is always better, even if it's biased.

What to Teach Instead

Using a 'soup' analogy (a small spoonful of well-stirred soup tells you the flavor, but a whole bowl of unstirred soup might only give you the top layer) helps students see that the method of sampling matters more than the size.

Common Misconception

The belief that 'random' means 'haphazard' or 'without a plan.'

What to Teach Instead

Engaging in a collaborative activity where students use a random number generator versus just 'picking people' helps them understand that true randomness requires a strict, unbiased process.

Active Learning Ideas

Simulation Game: The Bias Detective

Give students a set of survey questions about school life, some of which are 'loaded' or 'leading.' Students must identify the bias, explain how it would skew the results, and rewrite the questions to be neutral.

35 min·Pairs

Inquiry Circle: Sampling the School

Groups are tasked with finding the school's favorite music. One group uses convenience sampling (asking friends), another uses random sampling, and another uses stratified sampling (asking 5 people from each grade). They compare their results and discuss which is most valid.

50 min·Small Groups

Formal Debate: Data Ethics

Present a case study where a company used biased data to make a decision. Students debate the ethical responsibility of the data collector and the potential impact on the community involved.

30 min·Small Groups

Real-World Connections

• Market researchers for companies like Loblaw or Shoppers Drug Mart design surveys and conduct focus groups to understand consumer preferences for new products, influencing product development and advertising strategies.
• Public health officials in Ontario use observational studies and analyze existing health records (secondary data) to track disease outbreaks, identify risk factors, and implement preventative measures in communities.
• Environmental scientists conduct field experiments, manipulating variables like fertilizer levels in controlled plots, to study their impact on crop yields and soil health for agricultural organizations.

Assessment Ideas

Discussion Prompt

Present students with three scenarios: 1) Measuring student height in Grade 9, 2) Determining the most popular music genre among teenagers, 3) Testing the effectiveness of a new study technique. Ask: 'For each scenario, which data collection method (survey, observation, experiment) would be most appropriate and why? What are the potential advantages and disadvantages of your chosen method?'

Quick Check

Provide students with a short questionnaire. Ask them to identify: 'Is this collecting primary or secondary data? What is one potential source of bias in these questions? How could you rephrase one question to make it less biased?'

Exit Ticket

On an index card, have students define one data collection method in their own words and provide one specific example of when it would be the best choice. They should also name one advantage and one disadvantage of that method.

Frequently Asked Questions

What is sampling bias?

Sampling bias occurs when the way data is collected causes some members of a population to be more or less likely to be included than others. This results in data that does not accurately represent the whole group, leading to false conclusions.

Why is random sampling the 'gold standard'?

Random sampling gives every individual in a population an equal chance of being selected. This minimizes bias and makes it much more likely that the sample will be a 'mini-version' of the whole population, allowing for more accurate predictions.

How can active learning help students understand statistical bias?

Active learning, like the 'Sampling the School' activity, allows students to experience the 'wrong' results that come from biased methods. When they see how much their 'friends-only' sample differs from a random sample, the concept of bias becomes a practical problem to solve rather than just a definition to memorize. This hands-on experience builds a healthy skepticism toward the data they encounter daily.

What is a leading question in a survey?

A leading question is phrased in a way that suggests a particular answer or influences the respondent's opinion. For example, 'Don't you agree that school lunches should be free?' is leading, whereas 'What is your opinion on school lunch pricing?' is neutral.