Comparison between Video-mediated and Asymmetric 3D Teleconsultation during a Preclinical Scenario

Robin Strak, Kevin Yu, Frieder Pankratz, Marc Lazarovici, Benedikt Sandmeyer, Julia Reichling, Simon Weidert, Clemens Kraetsch, Barbara Roegele, Nassir Navab, Ulrich Eck, Daniel Roth

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

11 Scopus citations

Abstract

Current teleconsultation solutions for preclinical emergencies can transmit knowledge from a remote expert to a local paramedic using audio and 2D video channels. Such technology lacks precision and efficiency for medical diagnostic tasks, and visual feedback is often missing between participants. We investigate a mixed reality 3D teleconsultation solution for preclinical use, which provides a 3D reconstruction of the local scene to a remote expert, displayed in Virtual Reality. A remote expert can join the local scene virtually as an Augmented Reality avatar. The remote expert can annotate the local scene and guide the local paramedics through the procedure. We explored our system in a user study within a preclinical scenario on a collaborative task of attaching chest lead electrodes of a 12 channel electrocardiogram on a mannequin. We compared the 3D teleconsultation system to a 2D video-mediated teleconsultation via a top-mounted camera and report results from the consultee side in AR. Based on our empirical user study with 10 paramedics with an average of 17 years experience, we observe an improvement in the electrode placement quality using the 3D teleconsultation system. Results indicate no significant difference in the cognitive task-load between conditions. Participants perceived the video-mediated consultation as more usable due to their unfamiliarity with the 3D teleconsultation system. However, participants acknowledge the potential of 3D teleconsultation and believe such a system can significantly improve the preclinical treatment.

Original languageEnglish
Title of host publicationTagungsband - Mensch und Computer 2021
EditorsBastian Pfleging, Dagmar Kern, Stefan Schneegass
PublisherAssociation for Computing Machinery
Pages227-235
Number of pages9
ISBN (Electronic)9781450386456
DOIs
StatePublished - 5 Sep 2021
Externally publishedYes
Event2021 Conference on Mensch und Computer, MuC 2021 - 2021 Conference on Humans and Computers, MuC 2021 - Virtual, Online, Germany
Duration: 5 Sep 20218 Sep 2021

Publication series

NameACM International Conference Proceeding Series

Conference

Conference2021 Conference on Mensch und Computer, MuC 2021 - 2021 Conference on Humans and Computers, MuC 2021
Country/TerritoryGermany
CityVirtual, Online
Period5/09/218/09/21

Keywords

  • augmented reality
  • reconstruction
  • teleconsultation
  • virtual reality

Fingerprint

Dive into the research topics of 'Comparison between Video-mediated and Asymmetric 3D Teleconsultation during a Preclinical Scenario'. Together they form a unique fingerprint.

Cite this