Automatic image registration of optoacoustic tomography and magnetic resonance imaging based on deep learning

Yexing Hu, Berkan Lafci, Artur Luzgin, Hao Wang, Jan Klohs, Xose Luis Deán-Ben, Ruiqing Ni, Daniel Razansky, Wuwei Ren

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Multi-spectral optoacoustic tomography (MSOT) combines rich contrast of optical imaging and high resolution of ultrasound, and becomes an attractive biomedical research tool in the last decade. Aligning MSOT images with anatomical map provided by magnetic resonance imaging (MRI) can potentially enhance the interpretation of optoacoustic signal which mainly reflects molecular and functional information. Therefore, developing an automated algorithm of image registration between MSOT and MRI is crucial. Existing MSOT-MRI registration algorithms mostly relied on manual segmentation, which requires user-dependent experience. Herein, we developed a fully automated algorithm for MSOT-MRI registration based on deep learning (DL). This workflow consists of DL-based segmentation and image transformation. We have experimentally demonstrated the accuracy and computational efficiency of the method, paving the way towards high-throughput MSOT data analysis in close future.

Original languageEnglish
Title of host publication1st Conference on Biomedical Photonics and Cross-Fusion, BPC 2022
EditorsZhenxi Zhang, Junle Qu, Buhong Li
PublisherSPIE
ISBN (Electronic)9781510660274
DOIs
StatePublished - 2022
Externally publishedYes
Event1st Conference on Biomedical Photonics and Cross-Fusion, BPC 2022 - Shanghai, China
Duration: 21 Aug 202223 Aug 2022

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12461
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference1st Conference on Biomedical Photonics and Cross-Fusion, BPC 2022
Country/TerritoryChina
CityShanghai
Period21/08/2223/08/22

Keywords

  • Image registration
  • brain imaging
  • deep learning
  • magnetic resonance imaging
  • optoacoustic tomography

Fingerprint

Dive into the research topics of 'Automatic image registration of optoacoustic tomography and magnetic resonance imaging based on deep learning'. Together they form a unique fingerprint.

Cite this