States of Confusion: Eye and Head Tracking Reveal Surgeons' Confusion during Arthroscopic Surgery

Benedikt Hosp; Myat Su Yin; Peter Haddawy; Ratthaphum Watcharopas; Paphon Sa-Ngasoongsong; Enkelejda Kasneci

doi:10.1145/3462244.3479953

States of Confusion: Eye and Head Tracking Reveal Surgeons' Confusion during Arthroscopic Surgery

Benedikt Hosp
, Myat Su Yin
, Peter Haddawy
, Ratthaphum Watcharopas
, Paphon Sa-Ngasoongsong
, Enkelejda Kasneci

University of Tübingen
Mahidol University
University of Bremen
Ramathibodi Hospital

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Scopus citations

Abstract

During arthroscopic surgeries, surgeons are faced with challenges like cognitive re-projection of the 2D screen output into the 3D operating site or navigation through highly similar tissue. Training of these cognitive processes takes much time and effort for young surgeons, but is necessary and crucial for their education. In this study we want to show how to recognize states of confusion of young surgeons during an arthroscopic surgery, by looking at their eye and head movements and feeding them to a machine learning model. With an accuracy of over 94% and detection speed of 0.039 seconds, our model is a step towards online diagnostic and training systems for the perceptual-cognitive processes of surgeons during arthroscopic surgeries.

Original language	English
Title of host publication	ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction
Publisher	Association for Computing Machinery, Inc
Pages	753-757
Number of pages	5
ISBN (Electronic)	9781450384810
DOIs	https://doi.org/10.1145/3462244.3479953
State	Published - 18 Oct 2021
Externally published	Yes
Event	23rd ACM International Conference on Multimodal Interaction, ICMI 2021 - Virtual, Online, Canada Duration: 18 Oct 2021 → 22 Oct 2021

Publication series

Name	ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction

Conference

Conference	23rd ACM International Conference on Multimodal Interaction, ICMI 2021
Country/Territory	Canada
City	Virtual, Online
Period	18/10/21 → 22/10/21

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 3 Good Health and Well-being

Keywords

confusion
eye
gaze
head
machine learning
medicine
random forest
surgery
tracking

Access to Document

10.1145/3462244.3479953

Cite this

Hosp, B., Yin, M. S., Haddawy, P., Watcharopas, R., Sa-Ngasoongsong, P., & Kasneci, E. (2021). States of Confusion: Eye and Head Tracking Reveal Surgeons' Confusion during Arthroscopic Surgery. In ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction (pp. 753-757). (ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction). Association for Computing Machinery, Inc. https://doi.org/10.1145/3462244.3479953

Hosp, Benedikt ; Yin, Myat Su ; Haddawy, Peter et al. / States of Confusion : Eye and Head Tracking Reveal Surgeons' Confusion during Arthroscopic Surgery. ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction. Association for Computing Machinery, Inc, 2021. pp. 753-757 (ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction).

@inproceedings{bcd6d4585d574e3982f7b8f1855b3699,

title = "States of Confusion: Eye and Head Tracking Reveal Surgeons' Confusion during Arthroscopic Surgery",

abstract = "During arthroscopic surgeries, surgeons are faced with challenges like cognitive re-projection of the 2D screen output into the 3D operating site or navigation through highly similar tissue. Training of these cognitive processes takes much time and effort for young surgeons, but is necessary and crucial for their education. In this study we want to show how to recognize states of confusion of young surgeons during an arthroscopic surgery, by looking at their eye and head movements and feeding them to a machine learning model. With an accuracy of over 94\% and detection speed of 0.039 seconds, our model is a step towards online diagnostic and training systems for the perceptual-cognitive processes of surgeons during arthroscopic surgeries.",

keywords = "confusion, eye, gaze, head, machine learning, medicine, random forest, surgery, tracking",

author = "Benedikt Hosp and Yin, \{Myat Su\} and Peter Haddawy and Ratthaphum Watcharopas and Paphon Sa-Ngasoongsong and Enkelejda Kasneci",

note = "Publisher Copyright: {\textcopyright} 2021 Owner/Author.; 23rd ACM International Conference on Multimodal Interaction, ICMI 2021 ; Conference date: 18-10-2021 Through 22-10-2021",

year = "2021",

month = oct,

day = "18",

doi = "10.1145/3462244.3479953",

language = "English",

series = "ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction",

publisher = "Association for Computing Machinery, Inc",

pages = "753--757",

booktitle = "ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction",

}

Hosp, B, Yin, MS, Haddawy, P, Watcharopas, R, Sa-Ngasoongsong, P & Kasneci, E 2021, States of Confusion: Eye and Head Tracking Reveal Surgeons' Confusion during Arthroscopic Surgery. in ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction. ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction, Association for Computing Machinery, Inc, pp. 753-757, 23rd ACM International Conference on Multimodal Interaction, ICMI 2021, Virtual, Online, Canada, 18/10/21. https://doi.org/10.1145/3462244.3479953

States of Confusion: Eye and Head Tracking Reveal Surgeons' Confusion during Arthroscopic Surgery. / Hosp, Benedikt; Yin, Myat Su; Haddawy, Peter et al.
ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction. Association for Computing Machinery, Inc, 2021. p. 753-757 (ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - States of Confusion

T2 - 23rd ACM International Conference on Multimodal Interaction, ICMI 2021

AU - Hosp, Benedikt

AU - Yin, Myat Su

AU - Haddawy, Peter

AU - Watcharopas, Ratthaphum

AU - Sa-Ngasoongsong, Paphon

AU - Kasneci, Enkelejda

PY - 2021/10/18

Y1 - 2021/10/18

N2 - During arthroscopic surgeries, surgeons are faced with challenges like cognitive re-projection of the 2D screen output into the 3D operating site or navigation through highly similar tissue. Training of these cognitive processes takes much time and effort for young surgeons, but is necessary and crucial for their education. In this study we want to show how to recognize states of confusion of young surgeons during an arthroscopic surgery, by looking at their eye and head movements and feeding them to a machine learning model. With an accuracy of over 94% and detection speed of 0.039 seconds, our model is a step towards online diagnostic and training systems for the perceptual-cognitive processes of surgeons during arthroscopic surgeries.

AB - During arthroscopic surgeries, surgeons are faced with challenges like cognitive re-projection of the 2D screen output into the 3D operating site or navigation through highly similar tissue. Training of these cognitive processes takes much time and effort for young surgeons, but is necessary and crucial for their education. In this study we want to show how to recognize states of confusion of young surgeons during an arthroscopic surgery, by looking at their eye and head movements and feeding them to a machine learning model. With an accuracy of over 94% and detection speed of 0.039 seconds, our model is a step towards online diagnostic and training systems for the perceptual-cognitive processes of surgeons during arthroscopic surgeries.

KW - confusion

KW - eye

KW - gaze

KW - head

KW - machine learning

KW - medicine

KW - random forest

KW - surgery

KW - tracking

UR - https://www.scopus.com/pages/publications/85119016402

U2 - 10.1145/3462244.3479953

DO - 10.1145/3462244.3479953

M3 - Conference contribution

AN - SCOPUS:85119016402

T3 - ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction

SP - 753

EP - 757

BT - ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction

PB - Association for Computing Machinery, Inc

Y2 - 18 October 2021 through 22 October 2021

ER -

Hosp B, Yin MS, Haddawy P, Watcharopas R, Sa-Ngasoongsong P, Kasneci E. States of Confusion: Eye and Head Tracking Reveal Surgeons' Confusion during Arthroscopic Surgery. In ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction. Association for Computing Machinery, Inc. 2021. p. 753-757. (ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction). doi: 10.1145/3462244.3479953

States of Confusion: Eye and Head Tracking Reveal Surgeons' Confusion during Arthroscopic Surgery

Abstract

Publication series

Conference

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this