TY - JOUR
T1 - CertainNet
T2 - Sampling-Free Uncertainty Estimation for Object Detection
AU - Gasperini, Stefano
AU - Haug, Jan
AU - Mahani, Mohammad Ali Nikouei
AU - Marcos-Ramiro, Alvaro
AU - Navab, Nassir
AU - Busam, Benjamin
AU - Tombari, Federico
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2022/4/1
Y1 - 2022/4/1
N2 - Estimating the uncertainty of a neural network plays a fundamental role in safety-critical settings. In perception for autonomous driving, measuring the uncertainty means providing additional calibrated information to downstream tasks, such as path planning, that can use it towards safe navigation. In this work, we propose a novel sampling-free uncertainty estimation method for object detection. We call it CertainNet, and it is the first to provide separate uncertainties for each output signal: objectness, class, location and size. To achieve this, we propose an uncertainty-aware heatmap, and exploit the neighboring bounding boxes provided by the detector at inference time. We evaluate the detection performance and the quality of the different uncertainty estimates separately, also with challenging out-of-domain samples: BDD100K and nuImages with models trained on KITTI. Additionally, we propose a new metric to evaluate location and size uncertainties. When transferring to unseen datasets, CertainNet generalizes substantially better than previous methods and an ensemble, while being real-time and providing high quality and comprehensive uncertainty estimates.
AB - Estimating the uncertainty of a neural network plays a fundamental role in safety-critical settings. In perception for autonomous driving, measuring the uncertainty means providing additional calibrated information to downstream tasks, such as path planning, that can use it towards safe navigation. In this work, we propose a novel sampling-free uncertainty estimation method for object detection. We call it CertainNet, and it is the first to provide separate uncertainties for each output signal: objectness, class, location and size. To achieve this, we propose an uncertainty-aware heatmap, and exploit the neighboring bounding boxes provided by the detector at inference time. We evaluate the detection performance and the quality of the different uncertainty estimates separately, also with challenging out-of-domain samples: BDD100K and nuImages with models trained on KITTI. Additionally, we propose a new metric to evaluate location and size uncertainties. When transferring to unseen datasets, CertainNet generalizes substantially better than previous methods and an ensemble, while being real-time and providing high quality and comprehensive uncertainty estimates.
KW - Computer vision for transportation
KW - deep learning for visual perception
KW - object detection
KW - uncertainty estimation
UR - http://www.scopus.com/inward/record.url?scp=85120570719&partnerID=8YFLogxK
U2 - 10.1109/LRA.2021.3130976
DO - 10.1109/LRA.2021.3130976
M3 - Article
AN - SCOPUS:85120570719
SN - 2377-3766
VL - 7
SP - 698
EP - 705
JO - IEEE Robotics and Automation Letters
JF - IEEE Robotics and Automation Letters
IS - 2
ER -