Towards Generalised Neural Implicit Representations for Image Registration

Veronika A. Zimmer, Kerstin Hammernik, Vasiliki Sideri-Lampretsa, Wenqi Huang, Anna Reithmeir, Daniel Rueckert, Julia A. Schnabel

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Neural implicit representations (NIRs) enable to generate and parametrize the transformation for image registration in a continuous way. By design, these representations are image-pair-specific, meaning that for each signal a new multi-layer perceptron has to be trained. In this work, we investigate for the first time the potential of existent NIR generalisation methods for image registration and propose novel methods for the registration of a group of image pairs using NIRs. To exploit the generalisation potential of NIRs, we encode the fixed and moving image volumes to latent representations, which are then used to condition or modulate the NIR. Using ablation studies on a 3D benchmark dataset, we show that our methods are able to generalise to a set of image pairs with a performance comparable to pairwise registration using NIRs when trained on N=10 and N=120 datasets. Our results demonstrate the potential of generalised NIRs for 3D deformable image registration.

Original languageEnglish
Title of host publicationDeep Generative Models - Third MICCAI Workshop, DGM4MICCAI 2023, Held in Conjunction with MICCAI 2023, Proceedings
EditorsAnirban Mukhopadhyay, Ilkay Oksuz, Sandy Engelhardt, Dajiang Zhu, Yixuan Yuan
PublisherSpringer Science and Business Media Deutschland GmbH
Pages45-55
Number of pages11
ISBN (Print)9783031537660
DOIs
StatePublished - 2024
Event3rd Workshop on Deep Generative Models for Medical Image Computing and Computer Assisted Intervention, DGM4MICCAI 2023 Held in Conjunction with 26th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2023 - Vancouver, Canada
Duration: 8 Oct 202312 Oct 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14533 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference3rd Workshop on Deep Generative Models for Medical Image Computing and Computer Assisted Intervention, DGM4MICCAI 2023 Held in Conjunction with 26th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2023
Country/TerritoryCanada
CityVancouver
Period8/10/2312/10/23

Keywords

  • Generalisation
  • Image registration
  • Neural implicit representation
  • Periodic activation functions

Fingerprint

Dive into the research topics of 'Towards Generalised Neural Implicit Representations for Image Registration'. Together they form a unique fingerprint.

Cite this