Reinforced redetection of landmark in pre- and post-operative brain scan using anatomical guidance for image alignment

Diana Waldmannstetter, Fernando Navarro, Benedikt Wiestler, Jan S. Kirschke, Anjany Sekuboyina, Ester Molero, Bjoern H. Menze

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Re-identifying locations of interest in pre- and post-operative images is a hard identification problem, as the anatomical landscape changes dramatically due to tumor resection and tissue displacement. Classical image registration techniques oftentimes fail in vicinity of the tumor, where the enclosing structures are massively altered from one scan to another. Still, locations nearby the tumor or the resection cavity are the most relevant for evaluating tumor progression patterns and for comparing pre- and post-operative radiomic signatures. We address this issue by exploring a Reinforcement Learning (RL) approach. An artificial agent is self-taught to find the optimal path towards a target driven by a feedback signal from the environment. Incorporating anatomical guidance, we restrict the agent’s search space to surgery-unaffected structures only. By defining landmarks for each patient individually, we aim to obtain a patient-specific representation of its differential radiomic features across different time points for enhancing image alignment. Estimated landmarks reach a remarkable mean distance error around 3 mm. In addition, they show a high agreement with expert annotations on a challenging dataset of MR scans from the brain before and after tumor resection.

Original languageEnglish
Title of host publicationBiomedical Image Registration - 9th International Workshop, WBIR 2020, Proceedings
EditorsZiga Spiclin, Jamie McClelland, Jan Kybic, Orcun Goksel
PublisherSpringer
Pages81-90
Number of pages10
ISBN (Print)9783030501198
DOIs
StatePublished - 2020
Event9th International Workshop on Biomedical Image Registration, WBIR 2020 - Portoroz, Slovenia
Duration: 1 Dec 20202 Dec 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12120 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference9th International Workshop on Biomedical Image Registration, WBIR 2020
Country/TerritorySlovenia
CityPortoroz
Period1/12/202/12/20

Keywords

  • Brain tumor
  • Differential radiomics
  • Image alignment
  • Image registration
  • Reinforcement Learning

Fingerprint

Dive into the research topics of 'Reinforced redetection of landmark in pre- and post-operative brain scan using anatomical guidance for image alignment'. Together they form a unique fingerprint.

Cite this