Learning to Match 2D Keypoints Across Preoperative MR and Intraoperative Ultrasound

Hassan Rasheed, Reuben Dorent, Maximilian Fehrentz, Tina Kapur, William M. Wells, Alexandra Golby, Sarah Frisken, Julia A. Schnabel, Nazim Haouchine

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We propose in this paper a texture-invariant 2D keypoints descriptor specifically designed for matching preoperative Magnetic Resonance (MR) images with intraoperative Ultrasound (US) images. We introduce a matching-by-synthesis strategy, where intraoperative US images are synthesized from MR images accounting for multiple MR modalities and intraoperative US variability. We build our training set by enforcing keypoints localization over all images then train a patient-specific descriptor network that learns texture-invariant discriminant features in a supervised contrastive manner, leading to robust keypoints descriptors. Our experiments on real cases with ground truth show the effectiveness of the proposed approach, outperforming the state-of-the-art methods and achieving 80.35% matching precision on average.

Original languageEnglish
Title of host publicationSimplifying Medical Ultrasound - 5th International Workshop, ASMUS 2024, Held in Conjunction with MICCAI 2024, Proceedings
EditorsAlberto Gomez, Bishesh Khanal, Andrew King, Ana Namburete
PublisherSpringer Science and Business Media Deutschland GmbH
Pages78-87
Number of pages10
ISBN (Print)9783031736469
DOIs
StatePublished - 2025
Event5th International Workshop on Advances in Simplifying Medical Ultrasound, ASMUS 2024, held in conjunction with the 27th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2024 - Marrakesh, Morocco
Duration: 6 Oct 20246 Oct 2024

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume15186 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference5th International Workshop on Advances in Simplifying Medical Ultrasound, ASMUS 2024, held in conjunction with the 27th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2024
Country/TerritoryMorocco
CityMarrakesh
Period6/10/246/10/24

Fingerprint

Dive into the research topics of 'Learning to Match 2D Keypoints Across Preoperative MR and Intraoperative Ultrasound'. Together they form a unique fingerprint.

Cite this