Iterative Design and Prototyping of Computer Vision Mediated Remote Sighted Assistance

Jingyi Xie, Madison Reddie, Sooyeon Lee, Syed Masum Billah, Zihan Zhou, Chun Hua Tsai, John M. Carroll

Research output: Contribution to journalArticlepeer-review

7 Scopus citations

Abstract

Remote sighted assistance (RSA) is an emerging navigational aid for people with visual impairments (PVI). Using scenario-based design to illustrate our ideas, we developed a prototype showcasing potential applications for computer vision to support RSA interactions. We reviewed the prototype demonstrating real-world navigation scenarios with an RSA expert, and then iteratively refined the prototype based on feedback. We reviewed the refined prototype with 12 RSA professionals to evaluate the desirability and feasibility of the prototyped computer vision concepts. The RSA expert and professionals were engaged by, and reacted insightfully and constructively to the proposed design ideas. We discuss what we learned about key resources, goals, and challenges of the RSA prosthetic practice through our iterative prototype review, as well as implications for the design of RSA systems and the integration of computer vision technologies into RSA.

Original languageEnglish (US)
Article number36
JournalACM Transactions on Computer-Human Interaction
Volume29
Issue number4
DOIs
StatePublished - Aug 2022
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction

Keywords

  • 3D map
  • People with visual impairments
  • augmented reality
  • computer vision
  • navigation
  • remote sighted assistance
  • smartphone

Fingerprint

Dive into the research topics of 'Iterative Design and Prototyping of Computer Vision Mediated Remote Sighted Assistance'. Together they form a unique fingerprint.

Cite this