Know your sensors — a modality study for surgical action classification

Lennart Bastian, Tobias Czempiel, Christian Heiliger, Konrad Karcz, Ulrich Eck, Benjamin Busam, Nassir Navab

Publikation: Beitrag in FachzeitschriftArtikelBegutachtung

2 Zitate (Scopus)

Abstract

The surgical operating room (OR) presents many opportunities for automation and optimisation. Videos from various sources in the OR are becoming increasingly available. The medical community seeks to leverage this wealth of data to develop automated methods to advance interventional care, lower costs, and improve overall patient outcomes. Existing datasets from OR room cameras are thus far limited in size or modalities acquired, leaving it unclear which sensor modalities are best suited for tasks such as recognising surgical action from videos. This study demonstrates that the task of surgical workflow classification is highly dependent on the sensor modalities used. We perform a systematic analysis on several commonly available sensor modalities, evaluating two commonly used fusion approaches that can improve classification performance. Our findings are consistent across model architectures as well as separate camera views. The analyses are carried out on a set of multi-view RGB-D video recordings of 16 laparoscopic interventions.

OriginalspracheEnglisch
Seiten (von - bis)1113-1121
Seitenumfang9
FachzeitschriftComputer Methods in Biomechanics and Biomedical Engineering: Imaging and Visualization
Jahrgang11
Ausgabenummer4
DOIs
PublikationsstatusVeröffentlicht - 2023

Fingerprint

Untersuchen Sie die Forschungsthemen von „Know your sensors — a modality study for surgical action classification“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren