Synthesising images and labels between mr sequence types with cycleGAN

Eric Kerfoot, Esther Puyol-Antón, Bram Ruijsink, Rina Ariga, Ernesto Zacur, Pablo Lamata, Julia Schnabel

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

7 Scopus citations

Abstract

Real-time (RT) sequences for cardiac magnetic resonance imaging (CMR) have recently been proposed as alternatives to standard cine CMR sequences for subjects unable to hold the breath or suffering from arrhythmia. RT image acquisitions during free breathing produce comparatively poor quality images, a trade-off necessary to achieve the high temporal resolution needed for RT imaging and hence are less suitable in the clinical assessment of cardiac function. We demonstrate the application of a CycleGAN architecture to train autoencoder networks for synthesising cine-like images from RT images and vice versa. Applying this conversion to real-time data produces clearer images with sharper distinctions between myocardial and surrounding tissues, giving clinicians a more precise means of visually inspecting subjects. Furthermore, applying the transformation to segmented cine data to produce pseudo-real-time images allows this label information to be transferred to the real-time image domain. We demonstrate the feasibility of this approach by training a U-net based architecture using these pseudo-real-time images which can effectively segment actual real-time images.

Original languageEnglish
Title of host publicationDomain Adaptation and Representation Transfer and Medical Image Learning with Less Labels and Imperfect Data First MICCAI Workshop, DART 2019 and First International Workshop, MIL3ID 2019 Shenzhen, Held in Conjunction with MICCAI 2019 Shenzhen, 2019 Proceedings
EditorsQian Wang, Fausto Milletari, Nicola Rieke, Hien V. Nguyen, Badri Roysam, Shadi Albarqouni, M. Jorge Cardoso, Ziyue Xu, Konstantinos Kamnitsas, Vishal Patel, Steve Jiang, Kevin Zhou, Khoa Luu, Ngan Le
PublisherSpringer
Pages45-53
Number of pages9
ISBN (Print)9783030333904
DOIs
StatePublished - 2019
Externally publishedYes
Event1st MICCAI Workshop on Domain Adaptation and Representation Transfer, DART 2019, and the 1st International Workshop on Medical Image Learning with Less Labels and Imperfect Data, MIL3ID 2019, held in conjunction with 22nd International Conference on Medical Image Computing and Computer- Assisted Intervention, MICCAI 2019 - Shenzhen, China
Duration: 13 Oct 201917 Oct 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11795 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference1st MICCAI Workshop on Domain Adaptation and Representation Transfer, DART 2019, and the 1st International Workshop on Medical Image Learning with Less Labels and Imperfect Data, MIL3ID 2019, held in conjunction with 22nd International Conference on Medical Image Computing and Computer- Assisted Intervention, MICCAI 2019
Country/TerritoryChina
CityShenzhen
Period13/10/1917/10/19

Keywords

  • Cardiac MR
  • Cardiac quantification
  • Convolutional neural networks
  • Generative adversarial networks
  • Image synthesis

Fingerprint

Dive into the research topics of 'Synthesising images and labels between mr sequence types with cycleGAN'. Together they form a unique fingerprint.

Cite this