TransforMesh: A Transformer Network for Longitudinal Modeling of Anatomical Meshes

for the Alzheimer’s Disease Neuroimaging

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

10 Scopus citations

Abstract

The longitudinal modeling of neuroanatomical changes related to Alzheimer’s disease (AD) is crucial for studying the progression of the disease. To this end, we introduce TransforMesh, a spatio-temporal network based on transformers that models longitudinal shape changes on 3D anatomical meshes. While transformer and mesh networks have recently shown impressive performances in natural language processing and computer vision, their application to medical image analysis has been very limited. To the best of our knowledge, this is the first work that combines transformer and mesh networks. Our results show that TransforMesh can model shape trajectories better than other baseline architectures that do not capture temporal dependencies. Moreover, we also explore the capabilities of TransforMesh in detecting structural anomalies of the hippocampus in patients developing AD.

Original languageEnglish
Title of host publicationMachine Learning in Medical Imaging - 12th International Workshop, MLMI 2021, Held in Conjunction with MICCAI 2021, Proceedings
EditorsChunfeng Lian, Xiaohuan Cao, Islem Rekik, Xuanang Xu, Pingkun Yan
PublisherSpringer Science and Business Media Deutschland GmbH
Pages209-218
Number of pages10
ISBN (Print)9783030875886
DOIs
StatePublished - 2021
Externally publishedYes
Event12th International Workshop on Machine Learning in Medical Imaging, MLMI 2021, held in conjunction with 24th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2021 - Virtual, Online
Duration: 27 Sep 202127 Sep 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12966 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference12th International Workshop on Machine Learning in Medical Imaging, MLMI 2021, held in conjunction with 24th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2021
CityVirtual, Online
Period27/09/2127/09/21

Fingerprint

Dive into the research topics of 'TransforMesh: A Transformer Network for Longitudinal Modeling of Anatomical Meshes'. Together they form a unique fingerprint.

Cite this