TY - GEN
T1 - Touch sensing on non-parametric rear-projection surfaces
T2 - IEEE Virtual Reality Conference, VR 2015
AU - Hochreiter, Jason
AU - Daher, Salam
AU - Nagendran, Arjun
AU - Gonzalez, Laura
AU - Welch, Greg
N1 - Publisher Copyright:
© 2015 IEEE.
PY - 2015/8/25
Y1 - 2015/8/25
N2 - We demonstrate a generalizable method for unified multitouch detection and response on a human head-shaped surface with a rear-projection animated 3D face. The method helps achieve hands-on touch-sensitive training with dynamic physical-virtual patient behavior. The method, which is generalizable to other non-parametric rear-projection surfaces, requires one or more infrared (IR) cameras, one or more projectors, IR light sources, and a rear-projection surface. IR light reflected off of human fingers is captured by cameras with matched IR pass filters, allowing for the localization of multiple finger touch events. These events are tightly coupled with the rendering system to produce auditory and visual responses on the animated face displayed using the projector(s), resulting in a responsive, interactive experience. We illustrate the applicability of our physical prototype in a medical training scenario.
AB - We demonstrate a generalizable method for unified multitouch detection and response on a human head-shaped surface with a rear-projection animated 3D face. The method helps achieve hands-on touch-sensitive training with dynamic physical-virtual patient behavior. The method, which is generalizable to other non-parametric rear-projection surfaces, requires one or more infrared (IR) cameras, one or more projectors, IR light sources, and a rear-projection surface. IR light reflected off of human fingers is captured by cameras with matched IR pass filters, allowing for the localization of multiple finger touch events. These events are tightly coupled with the rendering system to produce auditory and visual responses on the animated face displayed using the projector(s), resulting in a responsive, interactive experience. We illustrate the applicability of our physical prototype in a medical training scenario.
KW - H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems - Animations, Artificial, Augmented, and Virtual Realities
KW - I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism - Virtual Reality
KW - I.3.8 [Computer Graphics]: Applications
UR - http://www.scopus.com/inward/record.url?scp=84954496838&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84954496838&partnerID=8YFLogxK
U2 - 10.1109/VR.2015.7223326
DO - 10.1109/VR.2015.7223326
M3 - Conference contribution
AN - SCOPUS:84954496838
T3 - 2015 IEEE Virtual Reality Conference, VR 2015 - Proceedings
SP - 69
EP - 74
BT - 2015 IEEE Virtual Reality Conference, VR 2015 - Proceedings
A2 - Swan, J. Edward
A2 - Lecuyer, Anatole
A2 - Hollerer, Tobias
A2 - Interrante, Victoria
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 23 March 2015 through 27 March 2015
ER -