ToF meets RGB: Novel multi-sensor super-resolution for hybrid 3-D endoscopy

Thomas Köhler, Sven Haase, Sebastian Bauer, Jakob Wasza, Thomas Kilgus, Lena Maier-Hein, Hubertus Feußner, Joachim Hornegger

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

23 Scopus citations

Abstract

3-D endoscopy is an evolving field of research with the intention to improve safety and efficiency of minimally invasive surgeries. Time-of-Flight (ToF) imaging allows to acquire range data in real-time and has been engineered into a 3-D endoscope in combination with an RGB sensor (640x480 px) as a hybrid imaging system, recently. However, the ToF sensor suffers from a low spatial resolution (64x48 px) and a poor signal-to-noise ratio. In this paper, we propose a novel multi-frame super-resolution framework to improve range images in a ToF/RGB multi-sensor setup. Our approach exploits high-resolution RGB data to estimate subpixel motion used as a cue for range super-resolution. The underlying non-parametric motion model based on optical flow makes the method applicable to endoscopic scenes with arbitrary endoscope movements. The proposed method was evaluated on synthetic and real images. Our approach improves the peak-signal-to-noise ratio by 1.6 dB and structural similarity by 0.02 compared to single-sensor super-resolution.

Original languageEnglish
Title of host publicationMedical Image Computing and Computer-Assisted Intervention, MICCAI 2013 - 16th International Conference, Proceedings
Pages139-146
Number of pages8
EditionPART 1
DOIs
StatePublished - 2013
Event16th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2013 - Nagoya, Japan
Duration: 22 Sep 201326 Sep 2013

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 1
Volume8149 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference16th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2013
Country/TerritoryJapan
CityNagoya
Period22/09/1326/09/13

Fingerprint

Dive into the research topics of 'ToF meets RGB: Novel multi-sensor super-resolution for hybrid 3-D endoscopy'. Together they form a unique fingerprint.

Cite this