Sound and Performance in Time-Based Media

Active learning helps students grasp how sound shapes time-based media by engaging them directly with the materials. Listening, analyzing, and creating together builds understanding that static analysis alone cannot achieve.

• Secondary 4
• Art
• 4 activities
• 30 min–50 min

Learning Objectives

1. Analyze how specific sound design choices, such as reverb or distortion, alter a viewer's emotional response to visual content.
2. Differentiate between diegetic and non-diegetic sound by identifying examples in provided video art clips.
3. Construct a 60-second video piece where sound elements are the primary drivers of narrative progression.
4. Critique the effectiveness of sound and performance integration in a peer's time-based media artwork.
5. Explain the relationship between synchronized performance actions and audio cues in creating a cohesive new media piece.

Experiential Learning

⏱ 30 min·Pairs

Pair Analysis: Diegetic vs Non-Diegetic Clips

Pairs watch three short video art clips and log diegetic sounds, like footsteps in scene, versus non-diegetic, such as added music. They discuss how each alters visual meaning and present one example to the class. Extend by remixing a clip's audio.

Prepare & details

Analyze how sound can manipulate the viewer's interpretation of visual information.

Facilitation Tip: During Pair Analysis, assign each pair a clip with clear diegetic and non-diegetic elements to debate, ensuring evidence-based discussion.

Setup: Varies; may include outdoor space, lab, or community setting

Materials: Experience setup materials, Reflection journal with prompts, Observation worksheet, Connection-to-content framework

• Apply
• Analyze
• Evaluate
• Self-Awareness
• Self-Management
• Social Awareness

Experiential Learning

⏱ 50 min·Small Groups

Small Group: Sound-Driven Narrative Build

Groups film a 30-second silent visual sequence, then layer sounds to shift its story, prioritizing audio as driver. Record performances for sync, edit in software, and screen for class feedback on interpretation changes.

Prepare & details

Differentiate between diegetic and non-diegetic sound in video art.

Facilitation Tip: For Sound-Driven Narrative Build, provide a short silent clip so groups focus entirely on building narrative through sound choices.

Setup: Varies; may include outdoor space, lab, or community setting

Materials: Experience setup materials, Reflection journal with prompts, Observation worksheet, Connection-to-content framework

• Apply
• Analyze
• Evaluate
• Self-Awareness
• Self-Management
• Social Awareness

Experiential Learning

⏱ 45 min·Whole Class

Whole Class: Live Performance Soundscape

Class performs a collective scene with live sounds and music; half generate diegetic effects, half non-diegetic. Record, review playback to analyze impact, then vote on most effective elements for redesign.

Prepare & details

Construct a short video piece where sound is the primary narrative driver.

Facilitation Tip: In Live Performance Soundscape, assign roles: performers, sound operators, and audience to clarify responsibilities and deepen engagement.

Setup: Varies; may include outdoor space, lab, or community setting

Materials: Experience setup materials, Reflection journal with prompts, Observation worksheet, Connection-to-content framework

• Apply
• Analyze
• Evaluate
• Self-Awareness
• Self-Management
• Social Awareness

Experiential Learning

⏱ 40 min·Individual

Individual: Personal Sound Remix

Students select a familiar visual clip, compose original sound design emphasizing performance elements, and export a new version. Submit with reflection on narrative shifts caused by audio choices.

Prepare & details

Analyze how sound can manipulate the viewer's interpretation of visual information.

Facilitation Tip: For Personal Sound Remix, supply a simple digital audio workstation or loop station to reduce technical barriers and focus on creativity.

Setup: Varies; may include outdoor space, lab, or community setting

Materials: Experience setup materials, Reflection journal with prompts, Observation worksheet, Connection-to-content framework

• Apply
• Analyze
• Evaluate
• Self-Awareness
• Self-Management
• Social Awareness

Teaching This Topic

Teach this topic by starting with concrete examples before abstract rules. Use film clips students know to build prior knowledge, then introduce terminology only after they observe its relevance. Avoid overwhelming them with jargon early on. Research shows that repeated, focused listening exercises improve students' ability to articulate sound's role in media.

What to Expect

Successful learning looks like students confidently distinguishing sound types and explaining their narrative or emotional impact. They should also apply these concepts by remixing or composing their own soundscapes.

Watch Out for These Misconceptions

Common Misconception

During Pair Analysis: watch for students assuming all sounds in a clip come from the on-screen action. Redirect by asking them to find one sound that clearly doesn’t match the visuals and explain why it feels 'added.'

What to Teach Instead

During Pair Analysis: have pairs present their findings with timestamps to prove their claims, requiring concrete evidence rather than assumptions.

Common Misconception

During Sound-Driven Narrative Build: watch for students treating sound as secondary to visuals. Redirect by asking them to rebuild their narrative using only the audio track they created.

What to Teach Instead

During Sound-Driven Narrative Build: ask groups to swap audio tracks and observe how the story changes, proving sound’s primary role.

Common Misconception

During Live Performance Soundscape: watch for students underestimating music’s active role. Redirect by asking them to perform without it, then add layers to see how mood shifts.

What to Teach Instead

During Live Performance Soundscape: have performers explain their sound choices to the audience, linking each layer to an intended emotional effect.

Assessment Ideas

Exit Ticket

After Pair Analysis, provide two short video clips. Ask students to write: 1. Identify one instance of diegetic sound and one of non-diegetic sound in Clip A. 2. Describe how the sound in Clip B influenced their emotional response.

Peer Assessment

After Sound-Driven Narrative Build, have students present their short video pieces to a small group. Peers use a checklist to assess: Is the sound clearly driving the narrative? Are there at least two distinct sound elements used effectively? Is the performance element integrated with the sound?

Discussion Prompt

During Live Performance Soundscape, display a still image from a film or video art piece. Ask students to brainstorm in pairs: 'What diegetic sounds might be present in this scene?' and 'What non-diegetic music or sound effects could enhance its mood?' Have pairs share one idea each.

Extensions & Scaffolding

• Challenge students to create a 30-second silent film where sound tells the entire story, then add non-diegetic music to shift the mood.
• Scaffolding for Personal Sound Remix: Provide a pre-selected library of sounds grouped by mood (e.g., 'tense', 'hopeful') to help students narrow choices.
• Deeper exploration: Invite a local sound designer or composer to discuss their process, connecting classroom work to real-world practice.

Key Vocabulary

Diegetic Sound	Sound that originates from within the narrative world of the video, such as dialogue spoken by characters or the sound of a car engine.
Non-Diegetic Sound	Sound that is added to the video from outside the narrative world, like a musical score or a narrator's voice-over, used for mood or emphasis.
Soundscape	The complete auditory environment of a place or a piece of media, encompassing all sounds, both natural and artificial.
Foley Artistry	The reproduction of everyday sound effects that are added in post-production to enhance audio quality, such as footsteps or the rustling of clothes.
Performance Art	An art form where the artist's actions or the artist's own body becomes the medium, often presented live and integrated with other media.