TY - GEN
T1 - [POSTER] Augmenting mobile C-arm fluoroscopes via stereo-RGBD sensors for multimodal visualization
AU - Habert, Severine
AU - Meng, Ma
AU - Kehl, Wadim
AU - Wang, Xiang
AU - Tombari, Federico
AU - Fallavollita, Pascal
AU - Navab, Nassir
N1 - Publisher Copyright:
© 2015 IEEE.
PY - 2015/11/11
Y1 - 2015/11/11
N2 - Fusing intraoperative X-ray data with real-time video in a common reference frame is not trivial since both modalities have to be acquired from the same viewpoint. The goal of this work is to design a flexible system comprising two RGBD sensors that can be attached to any mobile C-arm, with the objective of synthesizing projective color images from the X-ray source viewpoint. To achieve this, we calibrate the RGBD sensors to the X-ray source with a 3D calibration object. Then, we synthesize the projective color image from the X-ray viewpoint by applying a volumetric-based rendering method. Finally, the X-ray image is overlaid on the projective image without any further registration, offering a multimodal visualization of X-ray and color images. In this paper we present the different steps of development (i.e. hardware setup, calibration and rendering algorithm) and discuss clinical applications for the new video augmented C-arm. By placing X-ray markers on a hand patient and a spine model, we show that the overlay accuracy between the X-ray image and the synthetized image is in average 1.7 mm.
AB - Fusing intraoperative X-ray data with real-time video in a common reference frame is not trivial since both modalities have to be acquired from the same viewpoint. The goal of this work is to design a flexible system comprising two RGBD sensors that can be attached to any mobile C-arm, with the objective of synthesizing projective color images from the X-ray source viewpoint. To achieve this, we calibrate the RGBD sensors to the X-ray source with a 3D calibration object. Then, we synthesize the projective color image from the X-ray viewpoint by applying a volumetric-based rendering method. Finally, the X-ray image is overlaid on the projective image without any further registration, offering a multimodal visualization of X-ray and color images. In this paper we present the different steps of development (i.e. hardware setup, calibration and rendering algorithm) and discuss clinical applications for the new video augmented C-arm. By placing X-ray markers on a hand patient and a spine model, we show that the overlay accuracy between the X-ray image and the synthetized image is in average 1.7 mm.
KW - Medical Augmented Reality
KW - Multi-modal Visualization
KW - Range Imaging
KW - X-ray imaging
UR - https://www.scopus.com/pages/publications/84962278409
U2 - 10.1109/ISMAR.2015.24
DO - 10.1109/ISMAR.2015.24
M3 - Conference contribution
AN - SCOPUS:84962278409
T3 - Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
SP - 72
EP - 75
BT - Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
A2 - Sakata, Nobuchika
A2 - Newcombe, Richard
A2 - Lindeman, Robert
A2 - Sandor, Christian
A2 - Mayol-Cuevas, Walterio
A2 - Teichrieb, Veronica
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
Y2 - 29 September 2015 through 3 October 2015
ER -