TY - GEN
T1 - Orientation-aware People Detection and Counting Method based on Overhead Fisheye Camera
AU - Cao, Hu
AU - Peng, Boyang
AU - Jia, Linxuan
AU - Li, Bin
AU - Knoll, Alois
AU - Chen, Guang
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - The rise of intelligent vision-based people detection and counting methods will have a significant impact on the future security and space management of intelligent buildings. The current deep learning-based people detection algorithm achieves state-of-the-art performance in images collected by standard cameras. Nevertheless, standard vision approaches do not perform well on fisheye cameras because they are not suitable for fisheye images with radial geometry and barrel distortion. Overhead fisheye cameras can provide a larger field of view compared to standard cameras in people detection and counting tasks. In this paper, we propose an orientation-aware people detection and counting method based on an overhead fisheye camera. Specifically, an orientation-aware deep convolutional neural network with simultaneous attention refinement module (SARM) is introduced for people detection in arbitrary directions. Based on the attention mechanism, SARM can suppress the noise feature and highlight the object feature to improve the context focusing ability of the network on the people with different poses and orientations. Following the collection of detection results, an Internet of Things (IoT) system based on Real Time Streaming Protocol (RTSP) is constructed to output results to different devices. Experiments on three common fisheye image datasets show that under low light conditions, our method has high generalization ability and outperforms the state-of-the-art methods.
AB - The rise of intelligent vision-based people detection and counting methods will have a significant impact on the future security and space management of intelligent buildings. The current deep learning-based people detection algorithm achieves state-of-the-art performance in images collected by standard cameras. Nevertheless, standard vision approaches do not perform well on fisheye cameras because they are not suitable for fisheye images with radial geometry and barrel distortion. Overhead fisheye cameras can provide a larger field of view compared to standard cameras in people detection and counting tasks. In this paper, we propose an orientation-aware people detection and counting method based on an overhead fisheye camera. Specifically, an orientation-aware deep convolutional neural network with simultaneous attention refinement module (SARM) is introduced for people detection in arbitrary directions. Based on the attention mechanism, SARM can suppress the noise feature and highlight the object feature to improve the context focusing ability of the network on the people with different poses and orientations. Following the collection of detection results, an Internet of Things (IoT) system based on Real Time Streaming Protocol (RTSP) is constructed to output results to different devices. Experiments on three common fisheye image datasets show that under low light conditions, our method has high generalization ability and outperforms the state-of-the-art methods.
UR - http://www.scopus.com/inward/record.url?scp=85140986513&partnerID=8YFLogxK
U2 - 10.1109/MFI55806.2022.9913868
DO - 10.1109/MFI55806.2022.9913868
M3 - Conference contribution
AN - SCOPUS:85140986513
T3 - IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems
BT - 2022 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI 2022
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2022 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI 2022
Y2 - 20 September 2022 through 22 September 2022
ER -