A User-Centered Teleoperation GUI for Automated Vehicles: Identifying and Evaluating Information Requirements for Remote Driving and Assistance

  • Maria Magdalena Wolf
  • , Henrik Schmidt
  • , Michael Christl
  • , Jana Fank
  • , Frank Diermeyer

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

Teleoperation emerged as a promising fallback for situations beyond the capabilities of automated vehicles. Nevertheless, teleoperation still faces challenges, such as reduced situational awareness. Since situational awareness is primarily built through the remote operator’s visual perception, the graphical user interface (GUI) design is critical. In addition to video feed, supplemental informational elements are crucial—not only for the predominantly studied remote driving, but also for emerging desk-based remote assistance concepts. This work develops a GUI for different teleoperation concepts by identifying key informational elements during the teleoperation process through expert interviews (N = 9). Following this, a static and dynamic GUI prototype was developed and evaluated in a click dummy study (N = 36). Thereby, the dynamic GUI adapts the number of displayed elements according to the teleoperation phase. Results show that both GUIs achieve good system usability scale (SUS) ratings, with the dynamic GUI significantly outperforming the static version in both usability and task completion time. However, the results might be attributable to a learning effect due to the lack of randomization. The user experience questionnaire (UEQ) score shows potential for improvement. To enhance the user experience, the GUI should be evaluated in a follow-up study that includes interaction with a real vehicle.

Original languageEnglish
Article number78
JournalMultimodal Technologies and Interaction
Volume9
Issue number8
DOIs
StatePublished - Aug 2025

Keywords

  • automated vehicles
  • graphical user interface
  • human-machine interaction
  • remote operation
  • teleoperation

Fingerprint

Dive into the research topics of 'A User-Centered Teleoperation GUI for Automated Vehicles: Identifying and Evaluating Information Requirements for Remote Driving and Assistance'. Together they form a unique fingerprint.

Cite this