AI and Societal Inequality

Active learning turns abstract concerns about AI and inequality into tangible questions students can investigate themselves. When students analyze real cases, debate trade-offs, and redesign policies, they move beyond passive listening to see how technical choices shape human lives.

• 9th Grade
• Computer Science
• 4 activities
• 20 min–50 min

Learning Objectives

1. Analyze case studies to identify specific examples of how AI algorithms perpetuate or amplify existing societal inequalities related to race, gender, or socioeconomic status.
2. Evaluate the ethical implications of AI deployment in high-stakes decision-making processes, such as loan applications or criminal justice, by comparing outcomes for different demographic groups.
3. Design policy recommendations aimed at mitigating the negative impacts of AI on marginalized communities, considering factors like data bias and differential access.
4. Explain the technical and societal reasons behind disparities in AI performance across different demographic groups, citing examples like facial recognition accuracy.
5. Synthesize information from multiple sources to articulate the complex relationship between AI development and the exacerbation of societal inequalities.

Case Study Analysis

⏱ 45 min·Small Groups

Case Study Analysis: AI in High-Stakes Decisions

Provide three short case studies (e.g., COMPAS recidivism scoring, Amazon's hiring algorithm, facial recognition accuracy disparities). Groups analyze each using a structured template: What does the AI do? Who benefits? Who is harmed? What data was it trained on? Groups present findings and the class maps patterns across all three cases.

Prepare & details

Analyze how AI exacerbates existing inequalities in society.

Facilitation Tip: During the Case Study Analysis, assign each student a role (data scientist, community member, ethicist) so they must defend a perspective grounded in their role’s concerns.

Setup: Groups at tables with case materials

Materials: Case study packet (3-5 pages), Analysis framework worksheet, Presentation template

• Analyze
• Evaluate
• Create
• Decision-Making
• Self-Management

Structured Academic Controversy

⏱ 40 min·Pairs

Structured Academic Controversy: Is AI Making Inequality Worse?

Pairs are assigned a position (AI is widening inequality / AI is reducing inequality) and prepare arguments with provided readings. They argue their assigned side for 5 minutes each, then switch positions, then work together to write a nuanced joint statement. The goal is to hold complexity rather than win the debate.

Prepare & details

Predict the impact of AI on different socioeconomic groups.

Facilitation Tip: In the Structured Academic Controversy, require students to open by summarizing their opponents’ strongest point before stating their own.

Setup: Pairs of desks facing each other

Materials: Position briefs (both sides), Note-taking template, Consensus statement template

• Analyze
• Evaluate
• Create
• Social Awareness
• Relationship Skills

Think-Pair-Share

⏱ 20 min·Pairs

Think-Pair-Share: Who Designed This?

Show a series of AI product screenshots or feature descriptions. Students independently note who they imagine built it, who the intended user is, and whose needs might not have been considered. Partner discussion and whole-class debrief surfaces assumptions students had not noticed they were making about the default user.

Prepare & details

Design policy recommendations to mitigate AI's negative impact on inequality.

Facilitation Tip: For the Think-Pair-Share, ask students to first write their initial answers alone, then compare with a partner, and finally share out to reduce social pressure to conform.

Setup: Standard classroom seating; students turn to a neighbor

Materials: Discussion prompt (projected or printed), Optional: recording sheet for pairs

• Understand
• Apply
• Analyze
• Self-Awareness
• Relationship Skills

World Café

⏱ 50 min·Small Groups

Policy Design Workshop: Mitigating AI Inequality

Small groups are each assigned a sector (healthcare, education, hiring, criminal justice). They identify one specific inequality AI creates or worsens in that sector, then draft a policy recommendation with a rationale and at least one counterargument. Groups share proposals and receive structured feedback from peers.

Prepare & details

Analyze how AI exacerbates existing inequalities in society.

Facilitation Tip: In the Policy Design Workshop, give teams a limited number of sticky notes to force prioritization and trade-off thinking.

Setup: Small tables (4-5 seats each) spread around the room

Materials: Large paper "tablecloths" with questions, Markers (different colors per round), Table host instruction card

• Understand
• Apply
• Analyze
• Social Awareness
• Relationship Skills

Teaching This Topic

Teach this topic by keeping the focus on mechanisms, not moralizing. Guide students to trace how historical data choices, metric design, and deployment contexts create disparate impacts, rather than asking them to debate whether AI is ‘good’ or ‘bad.’ Use structured controversy to normalize disagreement while insisting on evidence. Research shows that when students articulate trade-offs early, they later design more inclusive solutions.

What to Expect

By the end of these activities, students will identify how data, algorithms, and deployment contexts produce unequal outcomes, and they will articulate specific fairness concerns in technical language. They will also propose design or policy changes that address those concerns.

Watch Out for These Misconceptions

Common Misconception

During Case Study Analysis, watch for students asserting that AI is objective because it uses data and math.

What to Teach Instead

Redirect them to the case study’s dataset description. Ask them to list the source, time period, and demographic breakdown of the data. Then guide them to connect those attributes to documented historical biases in that domain.

Common Misconception

During Structured Academic Controversy, watch for students equating ‘treating everyone the same’ with fairness.

What to Teach Instead

Have teams define their own fairness metric for the scenario, then compare how each metric affects different groups. Require them to present at least one equitable alternative to equal treatment.

Common Misconception

During Think-Pair-Share, watch for students assuming only direct users are affected by AI systems.

What to Teach Instead

Provide the prompt: ‘Describe one group that benefits from an AI loan approval system, and one group that may be harmed, even if they never interact with the interface.’ Use their responses to introduce the concept of indirect harms.

Assessment Ideas

Discussion Prompt

After the Case Study Analysis, present students with a revised version of the scholarship scenario. Ask them: ‘What potential biases could be embedded in this system? How might this AI affect students from different socioeconomic backgrounds differently? What questions should we ask before deploying it?’ Collect written responses and group them by theme to assess depth of analysis.

Quick Check

During the Structured Academic Controversy, display a short news clipping about AI in loan approvals. Ask students to identify one way the AI might exacerbate existing inequalities and one way it might benefit society. Have them write answers on index cards and exchange with a partner to read aloud before discussion.

Exit Ticket

After the Policy Design Workshop, ask students to write down one specific example of AI being used in a way that could create or worsen inequality. Then, ask them to propose one concrete step a developer or policymaker could take to address this specific issue. Collect tickets to identify patterns for the next lesson.

Extensions & Scaffolding

• Challenge: Ask students to locate and analyze a current news article about AI deployment in their city or state, noting which communities are likely affected and whether safeguards are proposed.
• Scaffolding: Provide sentence starters for fairness critiques, such as “This model may overlook _____ because the training data lacked examples of _____.”
• Deeper exploration: Invite a local data scientist or policy advocate to join a final discussion about how their professional roles address fairness in AI systems.

Key Vocabulary

Algorithmic Bias	Systematic and repeatable errors in a computer system that create unfair outcomes, such as privileging one arbitrary group of users over others.
Training Data Bias	When the data used to train an AI model does not accurately represent the diversity of the real world, leading the model to perform poorly or unfairly for certain groups.
Differential Access	Unequal availability of technology, resources, or AI tools across different socioeconomic groups or geographic locations, impacting who benefits from AI advancements.
High-Stakes Decision-Making	The use of AI systems in areas with significant consequences for individuals, such as hiring, college admissions, credit scoring, or judicial sentencing.
Algorithmic Transparency	The principle that the decision-making processes of AI algorithms should be understandable and explainable to users and affected individuals.