TY - GEN
T1 - Augmented reality anatomy visualization for surgery assistance with hololens
T2 - 2021 ACM International Conference on Interactive Media eXperiences, IMX 2021
AU - Castelan, Enrique
AU - Vinnikov, Margarita
AU - Alex Zhou, Xianlian
N1 - Publisher Copyright:
© 2021 Owner/Author.
PY - 2021/6/21
Y1 - 2021/6/21
N2 - Immediate care for trauma wounded patients in austere or remote settings makes medical knowledge, skills, and efficiency of the on-duty medical professional paramount. For wounds that extend deep into internal anatomy, proper visualization of internal anatomy can enable more efficient and effective evaluation when presented to medical providers positioned close to the point of injury (POI). In this paper, a conceptual Augmented Reality (AR) surgical tool is presented to provide visualization of internal human anatomy, superimposed on the view of a patient, to assist medical providers for immediate casualty care. This AR surgical tool can play a role in 3D surgery or treatment planning as a navigational aid in preparing medical interventions and enhancing surgery or treatment procedures by displaying otherwise obscured anatomy and nearby vessels. Critical software and hardware components are integrated to construct a prototype AR system for the portable AR surgical visualization tool. The system uses a Microsoft HoloLens 1 and an Azure Kinect camera for simultaneous body-tracking and anatomy overlay to demonstrate the overall concept. Future extension of this work will aim to create a more accurate and compact prototype system that utilizes HoloLens 2 with an embedded Kinect camera for laboratory and field tests of its use in surgery assistance. Such an AR tool can also serve as a training tool for medical caregivers, applied with a human subject or a medical manikin.
AB - Immediate care for trauma wounded patients in austere or remote settings makes medical knowledge, skills, and efficiency of the on-duty medical professional paramount. For wounds that extend deep into internal anatomy, proper visualization of internal anatomy can enable more efficient and effective evaluation when presented to medical providers positioned close to the point of injury (POI). In this paper, a conceptual Augmented Reality (AR) surgical tool is presented to provide visualization of internal human anatomy, superimposed on the view of a patient, to assist medical providers for immediate casualty care. This AR surgical tool can play a role in 3D surgery or treatment planning as a navigational aid in preparing medical interventions and enhancing surgery or treatment procedures by displaying otherwise obscured anatomy and nearby vessels. Critical software and hardware components are integrated to construct a prototype AR system for the portable AR surgical visualization tool. The system uses a Microsoft HoloLens 1 and an Azure Kinect camera for simultaneous body-tracking and anatomy overlay to demonstrate the overall concept. Future extension of this work will aim to create a more accurate and compact prototype system that utilizes HoloLens 2 with an embedded Kinect camera for laboratory and field tests of its use in surgery assistance. Such an AR tool can also serve as a training tool for medical caregivers, applied with a human subject or a medical manikin.
KW - Anatomy visualization
KW - HoloLens
KW - Pose estimation
KW - Surgery assistance
UR - http://www.scopus.com/inward/record.url?scp=85110072119&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85110072119&partnerID=8YFLogxK
U2 - 10.1145/3452918.3468005
DO - 10.1145/3452918.3468005
M3 - Conference contribution
AN - SCOPUS:85110072119
T3 - IMX 2021 - Proceedings of the 2021 ACM International Conference on Interactive Media Experiences
SP - 329
EP - 331
BT - IMX 2021 - Proceedings of the 2021 ACM International Conference on Interactive Media Experiences
PB - Association for Computing Machinery, Inc
Y2 - 21 June 2021 through 23 June 2021
ER -