TY - GEN
T1 - Improved Post-hoc Probability Calibration for Out-of-Domain MRI Segmentation
AU - Ouyang, Cheng
AU - Wang, Shuo
AU - Chen, Chen
AU - Li, Zeju
AU - Bai, Wenjia
AU - Kainz, Bernhard
AU - Rueckert, Daniel
N1 - Publisher Copyright:
© 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.
PY - 2022
Y1 - 2022
N2 - Probability calibration for deep models is highly desirable in safety-critical applications such as medical imaging. It makes output probabilities of deep networks interpretable, by aligning prediction probability with the actual accuracy in test data. In image segmentation, well-calibrated probabilities allow radiologists to identify regions where model-predicted segmentations are unreliable. These unreliable predictions often occur to out-of-domain (OOD) images that are caused by imaging artifacts or unseen imaging protocols. Unfortunately, most previous calibration methods for image segmentation perform sub-optimally on OOD images. To reduce the calibration error when confronted with OOD images, we propose a novel post-hoc calibration model. Our model leverages the pixel susceptibility against perturbations at the local level, and the shape prior information at the global level. The model is tested on cardiac MRI segmentation datasets that contain unseen imaging artifacts and images from an unseen imaging protocol. We demonstrate reduced calibration errors compared with the state-of-the-art calibration algorithm.
AB - Probability calibration for deep models is highly desirable in safety-critical applications such as medical imaging. It makes output probabilities of deep networks interpretable, by aligning prediction probability with the actual accuracy in test data. In image segmentation, well-calibrated probabilities allow radiologists to identify regions where model-predicted segmentations are unreliable. These unreliable predictions often occur to out-of-domain (OOD) images that are caused by imaging artifacts or unseen imaging protocols. Unfortunately, most previous calibration methods for image segmentation perform sub-optimally on OOD images. To reduce the calibration error when confronted with OOD images, we propose a novel post-hoc calibration model. Our model leverages the pixel susceptibility against perturbations at the local level, and the shape prior information at the global level. The model is tested on cardiac MRI segmentation datasets that contain unseen imaging artifacts and images from an unseen imaging protocol. We demonstrate reduced calibration errors compared with the state-of-the-art calibration algorithm.
UR - http://www.scopus.com/inward/record.url?scp=85138801998&partnerID=8YFLogxK
U2 - 10.1007/978-3-031-16749-2_6
DO - 10.1007/978-3-031-16749-2_6
M3 - Conference contribution
AN - SCOPUS:85138801998
SN - 9783031167485
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 59
EP - 69
BT - Uncertainty for Safe Utilization of Machine Learning in Medical Imaging - 4th International Workshop, UNSURE 2022, Held in Conjunction with MICCAI 2022, Proceedings
A2 - Sudre, Carole H.
A2 - Sudre, Carole H.
A2 - Baumgartner, Christian F.
A2 - Dalca, Adrian
A2 - Dalca, Adrian
A2 - Wells III, William M.
A2 - Qin, Chen
A2 - Tanno, Ryutaro
A2 - Van Leemput, Koen
A2 - Van Leemput, Koen
A2 - Wells III, William M.
PB - Springer Science and Business Media Deutschland GmbH
T2 - 4th Workshop on Uncertainty for Safe Utilization of Machine Learning in Medical Imaging, UNSURE 2022, held in conjunction with 25th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2022
Y2 - 18 September 2022 through 18 September 2022
ER -