XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

Jan Hendrik Plümer; Kevin Yu; Ulrich Eck; Denis Kalkofen; Philipp Steininger; Nassir Navab; Markus Tatzgern

doi:10.1109/ISMAR62088.2024.00014

XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

Jan Hendrik Plümer
, Kevin Yu
, Ulrich Eck
, Denis Kalkofen
, Philipp Steininger
, Nassir Navab
, Markus Tatzgern

Informatics 16 - Chair of Computer Aided Medical Procedures

Salzburg University of Applied Sciences
medPhoton GmbH
Flinders University
Graz University of Technology (TU Graz)

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Scopus citations

Abstract

Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost-and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.

Original language	English
Title of host publication	Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024
Editors	Ulrich Eck, Misha Sra, Jeanine Stefanucci, Maki Sugimoto, Markus Tatzgern, Ian Williams
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1-10
Number of pages	10
ISBN (Electronic)	9798331516475
DOIs	https://doi.org/10.1109/ISMAR62088.2024.00014
State	Published - 2024
Event	23rd IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024 - Seattle, United States Duration: 21 Oct 2024 → 25 Oct 2024

Publication series

Name	Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024

Conference

Conference	23rd IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024
Country/Territory	United States
City	Seattle
Period	21/10/24 → 25/10/24

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 3 Good Health and Well-being

Keywords

Extended reality
human-robot interaction
latency visualization
mixed reality
product development
prototyping

Access to Document

10.1109/ISMAR62088.2024.00014

Cite this

Plümer, J. H., Yu, K., Eck, U., Kalkofen, D., Steininger, P., Navab, N., & Tatzgern, M. (2024). XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. In U. Eck, M. Sra, J. Stefanucci, M. Sugimoto, M. Tatzgern, & I. Williams (Eds.), Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024 (pp. 1-10). (Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR62088.2024.00014

Plümer, Jan Hendrik ; Yu, Kevin ; Eck, Ulrich et al. / XR Prototyping of Mixed Reality Visualizations : Compensating Interaction Latency for a Medical Imaging Robot. Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024. editor / Ulrich Eck ; Misha Sra ; Jeanine Stefanucci ; Maki Sugimoto ; Markus Tatzgern ; Ian Williams. Institute of Electrical and Electronics Engineers Inc., 2024. pp. 1-10 (Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024).

@inproceedings{f8bb39381d4d4bcab932e194fc5408da,

title = "XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot",

abstract = "Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost-and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.",

keywords = "Extended reality, human-robot interaction, latency visualization, mixed reality, product development, prototyping",

author = "Pl{\"u}mer, \{Jan Hendrik\} and Kevin Yu and Ulrich Eck and Denis Kalkofen and Philipp Steininger and Nassir Navab and Markus Tatzgern",

note = "Publisher Copyright: {\textcopyright} 2024 IEEE.; 23rd IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024 ; Conference date: 21-10-2024 Through 25-10-2024",

year = "2024",

doi = "10.1109/ISMAR62088.2024.00014",

language = "English",

series = "Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1--10",

editor = "Ulrich Eck and Misha Sra and Jeanine Stefanucci and Maki Sugimoto and Markus Tatzgern and Ian Williams",

booktitle = "Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024",

}

Plümer, JH, Yu, K, Eck, U, Kalkofen, D, Steininger, P, Navab, N & Tatzgern, M 2024, XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. in U Eck, M Sra, J Stefanucci, M Sugimoto, M Tatzgern & I Williams (eds), Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024. Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024, Institute of Electrical and Electronics Engineers Inc., pp. 1-10, 23rd IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024, Seattle, United States, 21/10/24. https://doi.org/10.1109/ISMAR62088.2024.00014

XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. / Plümer, Jan Hendrik; Yu, Kevin; Eck, Ulrich et al.
Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024. ed. / Ulrich Eck; Misha Sra; Jeanine Stefanucci; Maki Sugimoto; Markus Tatzgern; Ian Williams. Institute of Electrical and Electronics Engineers Inc., 2024. p. 1-10 (Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - XR Prototyping of Mixed Reality Visualizations

T2 - 23rd IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024

AU - Plümer, Jan Hendrik

AU - Yu, Kevin

AU - Eck, Ulrich

AU - Kalkofen, Denis

AU - Steininger, Philipp

AU - Navab, Nassir

AU - Tatzgern, Markus

PY - 2024

Y1 - 2024

N2 - Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost-and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.

AB - Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost-and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.

KW - Extended reality

KW - human-robot interaction

KW - latency visualization

KW - mixed reality

KW - product development

KW - prototyping

UR - https://www.scopus.com/pages/publications/85213517190

U2 - 10.1109/ISMAR62088.2024.00014

DO - 10.1109/ISMAR62088.2024.00014

M3 - Conference contribution

AN - SCOPUS:85213517190

T3 - Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024

SP - 1

EP - 10

BT - Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024

A2 - Eck, Ulrich

A2 - Sra, Misha

A2 - Stefanucci, Jeanine

A2 - Sugimoto, Maki

A2 - Tatzgern, Markus

A2 - Williams, Ian

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 21 October 2024 through 25 October 2024

ER -

Plümer JH, Yu K, Eck U, Kalkofen D, Steininger P, Navab N et al. XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. In Eck U, Sra M, Stefanucci J, Sugimoto M, Tatzgern M, Williams I, editors, Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024. Institute of Electrical and Electronics Engineers Inc. 2024. p. 1-10. (Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024). doi: 10.1109/ISMAR62088.2024.00014

XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

Abstract

Publication series

Conference

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this