Deaf and Hard of Hearing Viewers’ Preference for Speaker Identifier Type in Live TV Programming

Akher Al Amin, Joseph Mendis, Raja Kushalnagar, Christian Vogler, Sooyeon Lee, Matt Huenerfauth

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

When there are multiple people shown onscreen at one time, people who are Deaf and Hard of Hearing (DHH) viewing captions may find it challenging to determine who the current speaker is, especially when speakers interrupt each other abruptly or when there is a lot of turn-taking. Prior research has proposed several methods of indicating speakers, including in-text methods and methods in which the caption is dynamically located onscreen. However, prior work has not examined the effectiveness of various speaker-identifier methods for conveying who is speaking when the number of speakers on the screen increases. To determine which speaker-identifier methods are effective for DHH viewers, as the number of speakers on screen varies, we have conducted an empirical study with 31 DHH participants. We observed DHH viewers preference for speaker-identifier types, for videos that vary in the number of speakers shown onscreen. Determining the relationship between DHH viewers’ preference for speaker-identifier methods and the number of onscreen speakers can guide broadcasters to select appropriate speaker-identifier methods based on the number of speakers that appear on the screen.

Original languageEnglish (US)
Title of host publicationUniversal Access in Human-Computer Interaction. Novel Design Approaches and Technologies - 16th International Conference, UAHCI 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Proceedings
EditorsMargherita Antona, Constantine Stephanidis
PublisherSpringer Science and Business Media Deutschland GmbH
Pages200-211
Number of pages12
ISBN (Print)9783031050275
DOIs
StatePublished - 2022
Externally publishedYes
Event16th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2022 Held as Part of the 24th HCI International Conference, HCII 2022 - Virtual, Online
Duration: Jun 26 2022Jul 1 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13308 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference16th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2022 Held as Part of the 24th HCI International Conference, HCII 2022
CityVirtual, Online
Period6/26/227/1/22

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • General Computer Science

Keywords

  • Caption
  • Live-TV
  • Speaker-identifier

Fingerprint

Dive into the research topics of 'Deaf and Hard of Hearing Viewers’ Preference for Speaker Identifier Type in Live TV Programming'. Together they form a unique fingerprint.

Cite this