Skip to main navigation Skip to search Skip to main content

Spatio-Temporal Learning from Longitudinal Data for Multiple Sclerosis Lesion Segmentation

  • Stefan Denner
  • , Ashkan Khakzar
  • , Moiz Sajid
  • , Mahdi Saleh
  • , Ziga Spiclin
  • , Seong Tae Kim
  • , Nassir Navab
  • Technical University of Munich
  • Univ. of Ljubljana
  • Johns Hopkins University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

14 Scopus citations

Abstract

Segmentation of Multiple Sclerosis (MS) lesions in longitudinal brain MR scans is performed for monitoring the progression of MS lesions. We hypothesize that the spatio-temporal cues in longitudinal data can aid the segmentation algorithm. Therefore, we propose a multi-task learning approach by defining an auxiliary self-supervised task of deformable registration between two time-points to guide the neural network toward learning from spatio-temporal changes. We show the efficacy of our method on a clinical dataset comprised of 70 patients with one follow-up study for each patient. Our results show that spatio-temporal information in longitudinal data is a beneficial cue for improving segmentation. We improve the result of current state-of-the-art by 2.6% in terms of overall score (p < 0.05). Code is publicly available (https://github.com/StefanDenn3r/Spatio-temporal-MS-Lesion-Segmentation ).

Original languageEnglish
Title of host publicationBrainlesion
Subtitle of host publicationGlioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries - 6th International Workshop, BrainLes 2020, Held in Conjunction with MICCAI 2020, Revised Selected Papers
EditorsAlessandro Crimi, Spyridon Bakas
PublisherSpringer Science and Business Media Deutschland GmbH
Pages111-121
Number of pages11
ISBN (Print)9783030720834
DOIs
StatePublished - 2021
Event6th International MICCAI Brainlesion Workshop, BrainLes 2020 Held in Conjunction with 23rd Medical Image Computing for Computer Assisted Intervention Conference, MICCAI 2020 - Virtual, Online
Duration: 4 Oct 20204 Oct 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12658 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference6th International MICCAI Brainlesion Workshop, BrainLes 2020 Held in Conjunction with 23rd Medical Image Computing for Computer Assisted Intervention Conference, MICCAI 2020
CityVirtual, Online
Period4/10/204/10/20

Keywords

  • Longitudinal analysis
  • MS lesion segmentation

Fingerprint

Dive into the research topics of 'Spatio-Temporal Learning from Longitudinal Data for Multiple Sclerosis Lesion Segmentation'. Together they form a unique fingerprint.

Cite this