JR

Copyright © 2024 Framer University.

All rights reserved.

Lets get connect with me!

Jaron.rehkop.ux@gmail.com

01

Making Captions More Inclusive and Immersive

Making Captions More Inclusive and Immersive

Making Captions More

Inclusive and Immersive

UX/UI

UX/UI

UX/UI

Research

Research

Research

Accessibility

Accessibility

Accessibility

About

About

This case study explores how enhanced captions—featuring emotional tone, music cues, and environmental sounds—can improve comprehension and immersion for Deaf and Hard of Hearing (DHH) viewers. Participants compared standard vs. enhanced captions across three well-known film clips.

This case study explores how enhanced captions—featuring emotional tone, music cues, and environmental sounds—can improve comprehension and immersion for Deaf and Hard of Hearing (DHH) viewers. Participants compared standard vs. enhanced captions across three well-known film clips.

This case study explores how enhanced captions—featuring emotional tone, music cues, and environmental sounds—can improve comprehension and immersion for Deaf and Hard of Hearing (DHH) viewers. Participants compared standard vs. enhanced captions across three well-known film clips.

Problem / Statement

Problem / Statement

Standard captions often lack emotional tone, music cues, and background sounds—making it harder for Deaf and Hard of Hearing (DHH) viewers to fully connect with the content. This missing context reduces immersion and emotional clarity during key moments in film and TV.

Standard captions often lack emotional tone, music cues, and background sounds—making it harder for Deaf and Hard of Hearing (DHH) viewers to fully connect with the content. This missing context reduces immersion and emotional clarity during key moments in film and TV.

Standard captions often lack emotional tone, music cues, and background sounds—making it harder for Deaf and Hard of Hearing (DHH) viewers to fully connect with the content. This missing context reduces immersion and emotional clarity during key moments in film and TV.

Goal / Objective

Goal / Objective

The goal was to explore whether Enhanced Captions—those with emotion, music, and sound details—could improve comprehension and engagement for DHH viewers, and to show why this richer captioning experience should be more widely available.

The goal was to explore whether Enhanced Captions—those with emotion, music, and sound details—could improve comprehension and engagement for DHH viewers, and to show why this richer captioning experience should be more widely available.

The goal was to explore whether Enhanced Captions—those with emotion, music, and sound details—could improve comprehension and engagement for DHH viewers, and to show why this richer captioning experience should be more widely available.

Research Methods

Research Methods

We conducted a comparison study using short film clips, asking participants to watch both standard and enhanced caption versions. Feedback was collected through surveys measuring clarity, emotional impact, and overall preference.

We conducted a comparison study using short film clips, asking participants to watch both standard and enhanced caption versions. Feedback was collected through surveys measuring clarity, emotional impact, and overall preference.

We conducted a comparison study using short film clips, asking participants to watch both standard and enhanced caption versions. Feedback was collected through surveys measuring clarity, emotional impact, and overall preference.

Take a look at both caption styles to see
how enhanced captions improve clarity and immersion.

Take a look at both caption styles to see
how enhanced captions improve clarity and immersion.

Take a look at both caption styles to see
how enhanced captions improve clarity and immersion.

Standard Captions

Standard Captions

Standard Captions

Enhanced Captions

Enhanced Captions

Enhanced Captions

Harry Potter and the Sourcer's Stone (2001) - Excitement

Harry Potter and the Sourcer's Stone (2001) - Excitement

Harry Potter and the Sourcer's Stone (2001) - Excitement

Enhanced Captions

Standard Captions

Twilight: New Moon (2009) - Dark and Melancholic

Twilight: New Moon (2009) - Dark and Melancholic

Twilight: New Moon (2009) - Dark and Melancholic

Enhanced Captions

Standard Captions

The Strangers (2008) - Horror

The Strangers (2008) - Horror

The Strangers (2008) - Horror

Standard Captions

Enhanced Captions

Key Findings

Key Findings

Participants overwhelmingly preferred Enhanced Captions over Standard Captions across all video clips.

➡ 85% of participants preferred Enhanced Captions over standard ones.

Enhanced Captions were rated “Very Clear” by 22 users, while only 5 said the same for Standard Captions.

Users said Enhanced Captions made scenes more engaging, especially in emotional or dramatic moments.

➡ 79.3% said Enhanced Captions are “Extremely Important” for streaming platforms.

The same 79.3% want Enhanced Captions to be widely available.

No one rated Enhanced Captions below “Neutral.”

Participants overwhelmingly preferred Enhanced Captions over Standard Captions across all video clips.

➡ 85% of participants preferred Enhanced Captions over standard ones.

Enhanced Captions were rated “Very Clear” by 22 users, while only 5 said the same for Standard Captions.

Users said Enhanced Captions made scenes more engaging, especially in emotional or dramatic moments.

➡ 79.3% said Enhanced Captions are “Extremely Important” for streaming platforms.

The same 79.3% want Enhanced Captions to be widely available.

No one rated Enhanced Captions below “Neutral.”

Participants overwhelmingly preferred Enhanced Captions over Standard Captions across all video clips.

➡ 85% of participants preferred Enhanced Captions over standard ones.

Enhanced Captions were rated “Very Clear” by 22 users, while only 5 said the same for Standard Captions.

Users said Enhanced Captions made scenes more engaging, especially in emotional or dramatic moments.

➡ 79.3% said Enhanced Captions are “Extremely Important” for streaming platforms.

The same 79.3% want Enhanced Captions to be widely available.

No one rated Enhanced Captions below “Neutral.”

Full Research Report

Full Research Report

Full Research Report

JR

Copyright © Jaron Rehkop

All rights reserved.

Lets get connect with me!

Jaron.rehkop.ux@gmail.com

JR

Copyright © Jaron Rehkop

All rights reserved.

Lets get connect with me!

Jaron.rehkop.ux@gmail.com