AIGuide: An Augmented Reality Hand Guidance Application for People with Visual Impairments

Nelson Daniel Troncoso Aldas, Sooyeon Lee, Chonghan Lee, Mary Beth Rosson, John M. Carroll, Vijaykrishnan Narayanan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

22 Scopus citations

Abstract

Locating and grasping objects is a critical task in people's daily lives. For people with visual impairments, this task can be a daily struggle. The support of augmented reality frameworks in smartphones has the potential to overcome the limitations of current object detection applications designed for people with visual impairments. We present AIGuide, a self-contained offline smartphone application that leverages augmented reality technology to help users locate and pick up objects around them. We conducted a user study to validate its effectiveness at providing guidance, compare it to other assistive technology form factors, evaluate the use of multimodal feedback, and provide feedback about the overall experience. Our results show that AIGuide is a promising technology to help people with visual impairments locate and acquire objects in their daily routine.

Original languageEnglish (US)
Title of host publicationASSETS 2020 - 22nd International ACM SIGACCESS Conference on Computers and Accessibility
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450371032
DOIs
StatePublished - Oct 26 2020
Externally publishedYes
Event22nd International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2020 - Virtual, Online, Greece
Duration: Oct 26 2020Oct 28 2020

Publication series

NameASSETS 2020 - 22nd International ACM SIGACCESS Conference on Computers and Accessibility

Conference

Conference22nd International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2020
Country/TerritoryGreece
CityVirtual, Online
Period10/26/2010/28/20

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Hardware and Architecture
  • Human-Computer Interaction
  • Software

Keywords

  • assistive technology
  • augmented reality
  • mixed reality
  • mobile computing

Fingerprint

Dive into the research topics of 'AIGuide: An Augmented Reality Hand Guidance Application for People with Visual Impairments'. Together they form a unique fingerprint.

Cite this