Adaptive Volumetric Anatomy Visualization in VR with Tangible Control

Constantin Kleinbeck; Max Smietana; Noah Lewis; Timo Teufel; Julian Kreimeier; Christoph Heinzl; Jürgen Steiner; Christoph Anthes; Daniel Roth

doi:10.1109/ISMAR-Adjunct60411.2023.00131

Adaptive Volumetric Anatomy Visualization in VR with Tangible Control

Constantin Kleinbeck, Max Smietana, Noah Lewis, Timo Teufel, Julian Kreimeier, Christoph Heinzl, Jürgen Steiner, Christoph Anthes, Daniel Roth

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

High-quality visualization of medical image data is essential for preoperative planning of complex and critical surgical procedures. Controllable 3D volume rendering in virtual reality (VR) is particularly useful to display depth and spatial relationships in volumetric data, and thus to identify specific anatomical landmarks and structural dependencies. However, intuitive control over the medical volume itself, the selection of sectional planes, transfer functions or the rotation or zooming has yet to be explored in depth. In this work, we demonstrate a real-time VR direct volume rendering application for medical images with tangible and intuitive interaction. Our system is real-time capable by the use of efficient volume rendering and foveated rendering techniques. We evaluated the system regarding its performance and gained first insight into the usefulness of a freely grabbable section slice in a preliminary user study.

Original language	English
Title of host publication	Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023
Editors	Gerd Bruder, Anne-Helene Olivier, Andrew Cunningham, Evan Yifan Peng, Jens Grubert, Ian Williams
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	613-614
Number of pages	2
ISBN (Electronic)	9798350328912
DOIs	https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00131
State	Published - 2023
Externally published	Yes
Event	2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023 - Sydney, Australia Duration: 16 Oct 2023 → 20 Oct 2023

Publication series

Name	Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023

Conference

Conference	2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023
Country/Territory	Australia
City	Sydney
Period	16/10/23 → 20/10/23

Keywords

Human computer interaction (HCI)
Human-centered computing
Interaction paradigms
Virtual reality

Access to Document

10.1109/ISMAR-Adjunct60411.2023.00131

Cite this

Kleinbeck, C., Smietana, M., Lewis, N., Teufel, T., Kreimeier, J., Heinzl, C., Steiner, J., Anthes, C., & Roth, D. (2023). Adaptive Volumetric Anatomy Visualization in VR with Tangible Control. In G. Bruder, A.-H. Olivier, A. Cunningham, E. Y. Peng, J. Grubert, & I. Williams (Eds.), Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023 (pp. 613-614). (Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00131

Kleinbeck, Constantin ; Smietana, Max ; Lewis, Noah et al. / Adaptive Volumetric Anatomy Visualization in VR with Tangible Control. Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023. editor / Gerd Bruder ; Anne-Helene Olivier ; Andrew Cunningham ; Evan Yifan Peng ; Jens Grubert ; Ian Williams. Institute of Electrical and Electronics Engineers Inc., 2023. pp. 613-614 (Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023).

@inproceedings{bc14a642edf84eee92300a768b1f05de,

title = "Adaptive Volumetric Anatomy Visualization in VR with Tangible Control",

abstract = "High-quality visualization of medical image data is essential for preoperative planning of complex and critical surgical procedures. Controllable 3D volume rendering in virtual reality (VR) is particularly useful to display depth and spatial relationships in volumetric data, and thus to identify specific anatomical landmarks and structural dependencies. However, intuitive control over the medical volume itself, the selection of sectional planes, transfer functions or the rotation or zooming has yet to be explored in depth. In this work, we demonstrate a real-time VR direct volume rendering application for medical images with tangible and intuitive interaction. Our system is real-time capable by the use of efficient volume rendering and foveated rendering techniques. We evaluated the system regarding its performance and gained first insight into the usefulness of a freely grabbable section slice in a preliminary user study.",

keywords = "Human computer interaction (HCI), Human-centered computing, Interaction paradigms, Virtual reality",

author = "Constantin Kleinbeck and Max Smietana and Noah Lewis and Timo Teufel and Julian Kreimeier and Christoph Heinzl and J{\"u}rgen Steiner and Christoph Anthes and Daniel Roth",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023 ; Conference date: 16-10-2023 Through 20-10-2023",

year = "2023",

doi = "10.1109/ISMAR-Adjunct60411.2023.00131",

language = "English",

series = "Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "613--614",

editor = "Gerd Bruder and Anne-Helene Olivier and Andrew Cunningham and Peng, {Evan Yifan} and Jens Grubert and Ian Williams",

booktitle = "Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023",

}

Kleinbeck, C, Smietana, M, Lewis, N, Teufel, T, Kreimeier, J, Heinzl, C, Steiner, J, Anthes, C & Roth, D 2023, Adaptive Volumetric Anatomy Visualization in VR with Tangible Control. in G Bruder, A-H Olivier, A Cunningham, EY Peng, J Grubert & I Williams (eds), Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023. Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023, Institute of Electrical and Electronics Engineers Inc., pp. 613-614, 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023, Sydney, Australia, 16/10/23. https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00131

Adaptive Volumetric Anatomy Visualization in VR with Tangible Control. / Kleinbeck, Constantin; Smietana, Max; Lewis, Noah et al.
Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023. ed. / Gerd Bruder; Anne-Helene Olivier; Andrew Cunningham; Evan Yifan Peng; Jens Grubert; Ian Williams. Institute of Electrical and Electronics Engineers Inc., 2023. p. 613-614 (Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Adaptive Volumetric Anatomy Visualization in VR with Tangible Control

AU - Kleinbeck, Constantin

AU - Smietana, Max

AU - Lewis, Noah

AU - Teufel, Timo

AU - Kreimeier, Julian

AU - Heinzl, Christoph

AU - Steiner, Jürgen

AU - Anthes, Christoph

AU - Roth, Daniel

PY - 2023

Y1 - 2023

N2 - High-quality visualization of medical image data is essential for preoperative planning of complex and critical surgical procedures. Controllable 3D volume rendering in virtual reality (VR) is particularly useful to display depth and spatial relationships in volumetric data, and thus to identify specific anatomical landmarks and structural dependencies. However, intuitive control over the medical volume itself, the selection of sectional planes, transfer functions or the rotation or zooming has yet to be explored in depth. In this work, we demonstrate a real-time VR direct volume rendering application for medical images with tangible and intuitive interaction. Our system is real-time capable by the use of efficient volume rendering and foveated rendering techniques. We evaluated the system regarding its performance and gained first insight into the usefulness of a freely grabbable section slice in a preliminary user study.

AB - High-quality visualization of medical image data is essential for preoperative planning of complex and critical surgical procedures. Controllable 3D volume rendering in virtual reality (VR) is particularly useful to display depth and spatial relationships in volumetric data, and thus to identify specific anatomical landmarks and structural dependencies. However, intuitive control over the medical volume itself, the selection of sectional planes, transfer functions or the rotation or zooming has yet to be explored in depth. In this work, we demonstrate a real-time VR direct volume rendering application for medical images with tangible and intuitive interaction. Our system is real-time capable by the use of efficient volume rendering and foveated rendering techniques. We evaluated the system regarding its performance and gained first insight into the usefulness of a freely grabbable section slice in a preliminary user study.

KW - Human computer interaction (HCI)

KW - Human-centered computing

KW - Interaction paradigms

KW - Virtual reality

UR - http://www.scopus.com/inward/record.url?scp=85180361935&partnerID=8YFLogxK

U2 - 10.1109/ISMAR-Adjunct60411.2023.00131

DO - 10.1109/ISMAR-Adjunct60411.2023.00131

M3 - Conference contribution

AN - SCOPUS:85180361935

T3 - Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023

SP - 613

EP - 614

BT - Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023

A2 - Bruder, Gerd

A2 - Olivier, Anne-Helene

A2 - Cunningham, Andrew

A2 - Peng, Evan Yifan

A2 - Grubert, Jens

A2 - Williams, Ian

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023

Y2 - 16 October 2023 through 20 October 2023

ER -

Kleinbeck C, Smietana M, Lewis N, Teufel T, Kreimeier J, Heinzl C et al. Adaptive Volumetric Anatomy Visualization in VR with Tangible Control. In Bruder G, Olivier AH, Cunningham A, Peng EY, Grubert J, Williams I, editors, Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023. Institute of Electrical and Electronics Engineers Inc. 2023. p. 613-614. (Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023). doi: 10.1109/ISMAR-Adjunct60411.2023.00131

Adaptive Volumetric Anatomy Visualization in VR with Tangible Control

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this