Gaze-based attention network analysis in a virtual reality classroom

Philipp Stark, Lisa Hasenbein, Enkelejda Kasneci, Richard Göllner

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

This article provides a step-by-step guideline for measuring and analyzing visual attention in 3D virtual reality (VR) environments based on eye-tracking data. We propose a solution to the challenges of obtaining relevant eye-tracking information in a dynamic 3D virtual environment and calculating interpretable indicators of learning and social behavior. With a method called "gaze-ray casting," we simulated 3D-gaze movements to obtain information about the gazed objects. This information was used to create graphical models of visual attention, establishing attention networks. These networks represented participants' gaze transitions between different entities in the VR environment over time. Measures of centrality, distribution, and interconnectedness of the networks were calculated to describe the network structure. The measures, derived from graph theory, allowed for statistical inference testing and the interpretation of participants' visual attention in 3D VR environments. Our method provides useful insights when analyzing students’ learning in a VR classroom, as reported in a corresponding evaluation article with N = 274 participants. • Guidelines on implementing gaze-ray casting in VR using the Unreal Engine and the HTC VIVE Pro Eye. • Creating gaze-based attention networks and analyzing their network structure. • Implementation tutorials and the Open Source software code are provided via OSF: https://osf.io/pxjrc/?view_only=1b6da45eb93e4f9eb7a138697b941198.

Original languageEnglish
Article number102662
JournalMethodsX
Volume12
DOIs
StatePublished - Jun 2024

Keywords

  • Eye tracking
  • Gaze-ray casting
  • Graph theory
  • Network analysis
  • Virtual reality
  • Visual attention

Fingerprint

Dive into the research topics of 'Gaze-based attention network analysis in a virtual reality classroom'. Together they form a unique fingerprint.

Cite this