LSTM spatial co-transformer networks for registration of 3D fetal US and MR brain images

Robert Wright, Bishesh Khanal, Alberto Gomez, Emily Skelton, Jacqueline Matthew, Jo V. Hajnal, Daniel Rueckert, Julia A. Schnabel

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

19 Scopus citations

Abstract

In this work, we propose a deep learning-based method for iterative registration of fetal brain images acquired by ultrasound and magnetic resonance, inspired by “Spatial Transformer Networks”. Images are co-aligned to a dual modality spatio-temporal atlas, where computational image analysis may be performed in the future. Our results show better alignment accuracy compared to “Self-Similarity Context descriptors”, a state-of-the-art method developed for multi-modal image registration. Furthermore, our method is robust and able to register highly misaligned images, with any initial orientation, where similarity-based methods typically fail.

Original languageEnglish
Title of host publicationData Driven Treatment Response Assessment and Preterm, Perinatal, and Paediatric Image Analysis - First International Workshop, DATRA 2018 and Third International Workshop, PIPPI 2018 Held in Conjunction with MICCAI 2018, Proceedings
EditorsAndrew Melbourne, Rosalind Aughwane, Emma Robinson, Roxane Licandro, Melanie Gau, Martin Kampel, Matthew DiFranco, Paolo Rota, Roxane Licandro, Pim Moeskops, Ernst Schwartz, Antonios Makropoulos
PublisherSpringer Verlag
Pages149-159
Number of pages11
ISBN (Print)9783030008062
DOIs
StatePublished - 2018
Externally publishedYes
Event1st International Workshop on Data Driven Treatment Response Assessment, DATRA 2018 and 3rd International Workshop on Preterm, Perinatal, and Paediatric Image Analysis, PIPPI 2018 Held in Conjunction with 21st International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2018 - Granada, Spain
Duration: 16 Sep 201816 Sep 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11076 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference1st International Workshop on Data Driven Treatment Response Assessment, DATRA 2018 and 3rd International Workshop on Preterm, Perinatal, and Paediatric Image Analysis, PIPPI 2018 Held in Conjunction with 21st International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2018
Country/TerritorySpain
CityGranada
Period16/09/1816/09/18

Fingerprint

Dive into the research topics of 'LSTM spatial co-transformer networks for registration of 3D fetal US and MR brain images'. Together they form a unique fingerprint.

Cite this