Understanding How Deaf and Hard of Hearing Viewers Visually Explore Captioned Live TV News

Akhter Al Amin, Saad Hassan, Sooyeon Lee, Matt Huenerfauth

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Captions blocking visual information in live television news leads to dissatisfaction among Deaf and Hard of Hearing (DHH) viewers, who cannot see important information on the screen. Prior work has proposed generic guidelines for caption placement but not specifically for live television news, and important genre of television with dense placement of onscreen information regions, e.g., current news topic, scrolling news, etc. To understand DHH viewers' gaze behavior while watching television news, both spatially and temporally, we conducted an eye-Tracking study with 19 DHH participants. Participants' gaze behavior varied over time as measured by their proportional fixation time on information regions on the screen. An analysis of gaze behavior coupled with open-ended feedback revealed four thematic categories of information regions. Our work motivates considering the time dimension when considering caption placement, to avoid blocking information regions, as their importance varies over time.

Original languageEnglish (US)
Title of host publication20th International Web for All Conference, W4A 2023
PublisherAssociation for Computing Machinery
Number of pages12
ISBN (Electronic)9798400707483
StatePublished - Apr 30 2023
Event20th International Web for All Conference, W4A 2023 - Austin, United States
Duration: Apr 30 2023May 1 2023

Publication series

NameACM International Conference Proceeding Series


Conference20th International Web for All Conference, W4A 2023
Country/TerritoryUnited States

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software


  • Accessibility
  • Area of Interest
  • Attention
  • Caption


Dive into the research topics of 'Understanding How Deaf and Hard of Hearing Viewers Visually Explore Captioned Live TV News'. Together they form a unique fingerprint.

Cite this