TY - JOUR
T1 - Augmented reality collaborative medical displays (ARC-MeDs) for multi-user surgical planning and intra-operative communication
AU - Song, Tianyu
AU - Yu, Kevin
AU - Eck, Ulrich
AU - Navab, Nassir
N1 - Publisher Copyright:
© 2022 Informa UK Limited, trading as Taylor & Francis Group.
PY - 2023
Y1 - 2023
N2 - Digital Displays are integral to modern systems and serve as the primary visual human-computer interface. A physical monitor is a typical example for showing computer-generated information to a person–as long they are located directly in front of them. In an operating room, however, people may be unable to move freely or communicate only based on verbal communication due to noise pollution. Furthermore, mobile and connected editing and sharing of the same content on the go is currently not readily available. Therefore, we propose Augmented Reality Collaborative Medical Displays for duplicating any displayed content as a virtual monitor hovering in space in the real world. Our method replicates any user input on the virtual representation onto the original physical monitor. We put forward a use case in planning a surgical intervention of the abdomen with intra-operative CT imaging. Moreover, we demonstrate how a medical immersive teleconsultation system utilises our method for meaningful interactions. Finally, we evaluate our method with multiple display resolutions. Based on our observations from the use cases and quantitative evaluation, we believe our proposed concept facilitates the integration of future collaborative medical applications.
AB - Digital Displays are integral to modern systems and serve as the primary visual human-computer interface. A physical monitor is a typical example for showing computer-generated information to a person–as long they are located directly in front of them. In an operating room, however, people may be unable to move freely or communicate only based on verbal communication due to noise pollution. Furthermore, mobile and connected editing and sharing of the same content on the go is currently not readily available. Therefore, we propose Augmented Reality Collaborative Medical Displays for duplicating any displayed content as a virtual monitor hovering in space in the real world. Our method replicates any user input on the virtual representation onto the original physical monitor. We put forward a use case in planning a surgical intervention of the abdomen with intra-operative CT imaging. Moreover, we demonstrate how a medical immersive teleconsultation system utilises our method for meaningful interactions. Finally, we evaluate our method with multiple display resolutions. Based on our observations from the use cases and quantitative evaluation, we believe our proposed concept facilitates the integration of future collaborative medical applications.
KW - Multi-display system
KW - co-located collaboration
KW - mixed reality
KW - surgical planning
UR - http://www.scopus.com/inward/record.url?scp=85143242392&partnerID=8YFLogxK
U2 - 10.1080/21681163.2022.2150892
DO - 10.1080/21681163.2022.2150892
M3 - Article
AN - SCOPUS:85143242392
SN - 2168-1163
VL - 11
SP - 1042
EP - 1049
JO - Computer Methods in Biomechanics and Biomedical Engineering: Imaging and Visualization
JF - Computer Methods in Biomechanics and Biomedical Engineering: Imaging and Visualization
IS - 4
ER -