Micro-Ct synthesis and inner ear super resolution via generative adversarial networks and bayesian inference

Hongwei Li, Rameshwara G.N. Prasad, Anjany Sekuboyina, Chen Niu, Siwei Bai, Werner Hemmert, Bjoern Menze

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Scopus citations

Abstract

Existing medical image super-resolution methods rely on pairs of low-and high-resolution images to learn a mapping in a fully supervised manner. However, such image pairs are often not available in clinical practice. In this paper, we address super resolution problem in a real-world scenario using unpaired data and synthesize linearly eight times higher resolved Micro-CT images of temporal bone structure embedded in the inner ear. We explore cycle-consistency generative adversarial networks for super-resolution and equip the model with Bayesian inference. We further introduce Hu Moments distance as the evaluation metric to quantify the shape of the temporal bone. We evaluate our method on a public inner ear CT dataset and have seen both visual and quantitative improvement over state-of-the-art supervised deep-learning based methods. Further, we conduct a multi-rater visual evaluation experiment and find that three inner-ear researchers consistently rate our method highest quality scores among three methods. Furthermore, we are able to quantify uncertainty in the unpaired translation task and the uncertainty map can provide structural information of the temporal bone.

Original languageEnglish
Title of host publication2021 IEEE 18th International Symposium on Biomedical Imaging, ISBI 2021
PublisherIEEE Computer Society
Pages1500-1504
Number of pages5
ISBN (Electronic)9781665412469
DOIs
StatePublished - 13 Apr 2021
Event18th IEEE International Symposium on Biomedical Imaging, ISBI 2021 - Nice, France
Duration: 13 Apr 202116 Apr 2021

Publication series

NameProceedings - International Symposium on Biomedical Imaging
Volume2021-April
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452

Conference

Conference18th IEEE International Symposium on Biomedical Imaging, ISBI 2021
Country/TerritoryFrance
CityNice
Period13/04/2116/04/21

Fingerprint

Dive into the research topics of 'Micro-Ct synthesis and inner ear super resolution via generative adversarial networks and bayesian inference'. Together they form a unique fingerprint.

Cite this