TY - JOUR
T1 - Towards Autonomous Atlas-Based Ultrasound Acquisitions in Presence of Articulated Motion
AU - Jiang, Zhongliang
AU - Gao, Yuan
AU - Xie, Le
AU - Navab, Nassir
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2022/7/1
Y1 - 2022/7/1
N2 - Robotic ultrasound (US) imaging aims at overcoming some of the limitations of free-hand US examinations, e.g. difficulty in guaranteeing intra-and inter-operator repeatability. However, due to anatomical and physiological variations between patients and relative movement of anatomical substructures, it is challenging to robustly generate optimal trajectories to examine the anatomies of interest, in particular, when they comprise articulated joints. To address this challenge, this paper proposes a vision-based approach allowing autonomous robotic US limb scanning. To this end, an atlas MRI template of a human arm with annotated vascular structures is used to generate trajectories and register and project them onto patients' skin surfaces for robotic US acquisition. To effectively segment and accurately reconstruct the targeted 3D vessel, we make use of spatial continuity in consecutive US frames by incorporating channel attention modules into a U-Net-Type neural network. The automatic trajectory generation method is evaluated on six volunteers with various articulated joint angles. In all cases, the system can successfully acquire the planned vascular structure on volunteers' limbs. For one volunteer the MRI scan was also available, which allows the evaluation of the average radius of the scanned artery from US images, resulting in a radius estimation (1.2±0.05 mm) comparable to the MRI ground truth (1.2±0.04 mm).
AB - Robotic ultrasound (US) imaging aims at overcoming some of the limitations of free-hand US examinations, e.g. difficulty in guaranteeing intra-and inter-operator repeatability. However, due to anatomical and physiological variations between patients and relative movement of anatomical substructures, it is challenging to robustly generate optimal trajectories to examine the anatomies of interest, in particular, when they comprise articulated joints. To address this challenge, this paper proposes a vision-based approach allowing autonomous robotic US limb scanning. To this end, an atlas MRI template of a human arm with annotated vascular structures is used to generate trajectories and register and project them onto patients' skin surfaces for robotic US acquisition. To effectively segment and accurately reconstruct the targeted 3D vessel, we make use of spatial continuity in consecutive US frames by incorporating channel attention modules into a U-Net-Type neural network. The automatic trajectory generation method is evaluated on six volunteers with various articulated joint angles. In all cases, the system can successfully acquire the planned vascular structure on volunteers' limbs. For one volunteer the MRI scan was also available, which allows the evaluation of the average radius of the scanned artery from US images, resulting in a radius estimation (1.2±0.05 mm) comparable to the MRI ground truth (1.2±0.04 mm).
KW - Medical robotics
KW - Non-rigid registration
KW - Optical flow
KW - Robotic ultrasound
KW - UNet
KW - Vessel segmentation
UR - http://www.scopus.com/inward/record.url?scp=85131715187&partnerID=8YFLogxK
U2 - 10.1109/LRA.2022.3180440
DO - 10.1109/LRA.2022.3180440
M3 - Article
AN - SCOPUS:85131715187
SN - 2377-3766
VL - 7
SP - 7423
EP - 7430
JO - IEEE Robotics and Automation Letters
JF - IEEE Robotics and Automation Letters
IS - 3
ER -