TY - JOUR
T1 - Maize tassel number and tasseling stage monitoring based on near-ground and UAV RGB images by improved YoloV8
AU - Yu, Xun
AU - Yin, Dameng
AU - Xu, Honggen
AU - Pinto Espinosa, Francisco
AU - Schmidhalter, Urs
AU - Nie, Chenwei
AU - Bai, Yi
AU - Sankaran, Sindhuja
AU - Ming, Bo
AU - Cui, Ningbo
AU - Wu, Wenbin
AU - Jin, Xiuliang
N1 - Publisher Copyright:
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2024.
PY - 2024/8
Y1 - 2024/8
N2 - The monitoring of the tassel number and tasseling time reflects the maize growth and is necessary for crop management. However, it mainly depends on field observations, which is very labor intensive and may be biased by human errors. Tassel detection remains challenging due to the varying appearance of tassels across maize varieties, tasseling stages, and spatial resolutions. Moreover, the capability of the deep learning model for monitoring tassel number change and the time of entering tasseling stage has not been explored. In this study, we propose a novel approach for fast tassel detection using PConv (Partial Convolution) within YoloV8 series, named PConv-YoloV8 series. Compared to seven state-of-the-art deep learning methods, PConv-YoloV8 × 6 best trades off detection accuracy with the number of parameters (Parameters = 52.50 MB, AP = 0.950, R2 = 0.92, rRMSE = 9.08%). The potential of PConv-YoloV8 × 6 to provide an accurate detection of tassels in complex situations from near-ground and UAV images were comprehensively studied. PConv-YoloV8 × 6 maintained an excellent detection accuracy for maize at different tasseling stages (AP = 0.826–0.972, R2 = 0.83–0.92, RMSE = 1.94–3.01, rRMSE = 21.06%-7.09%), for different varieties (AP = 0.901–0.978, R2 = 0.77–0.97, RMSE = 1.39–3.16, rRMSE = 11.72%-5.06%), at different resolutions (AP = 0.921–0.956, R2 = 0.84–0.93, rRMSE = 8.72%-17.71%), and on UAV images with different resolutions (AP = 0.918–0.968, R2 = 0.98–0.99, rRMSE = 6.43%-12.76%), which proved the robustness of the model. The tasseling number and the time of entering tasseling stage detected from images were basically consistent with the trends observed in the manually labeled results. This study provides an effective method to monitor the tassel number and the time of entering the tasseling stage. A new maize tassel detection dataset (18260 tassels in 729 near-ground images and 20835 tassels in 144 UAV images) is created. Future studies will focus on making more lightweight models and achieving real-time detection capabilities.
AB - The monitoring of the tassel number and tasseling time reflects the maize growth and is necessary for crop management. However, it mainly depends on field observations, which is very labor intensive and may be biased by human errors. Tassel detection remains challenging due to the varying appearance of tassels across maize varieties, tasseling stages, and spatial resolutions. Moreover, the capability of the deep learning model for monitoring tassel number change and the time of entering tasseling stage has not been explored. In this study, we propose a novel approach for fast tassel detection using PConv (Partial Convolution) within YoloV8 series, named PConv-YoloV8 series. Compared to seven state-of-the-art deep learning methods, PConv-YoloV8 × 6 best trades off detection accuracy with the number of parameters (Parameters = 52.50 MB, AP = 0.950, R2 = 0.92, rRMSE = 9.08%). The potential of PConv-YoloV8 × 6 to provide an accurate detection of tassels in complex situations from near-ground and UAV images were comprehensively studied. PConv-YoloV8 × 6 maintained an excellent detection accuracy for maize at different tasseling stages (AP = 0.826–0.972, R2 = 0.83–0.92, RMSE = 1.94–3.01, rRMSE = 21.06%-7.09%), for different varieties (AP = 0.901–0.978, R2 = 0.77–0.97, RMSE = 1.39–3.16, rRMSE = 11.72%-5.06%), at different resolutions (AP = 0.921–0.956, R2 = 0.84–0.93, rRMSE = 8.72%-17.71%), and on UAV images with different resolutions (AP = 0.918–0.968, R2 = 0.98–0.99, rRMSE = 6.43%-12.76%), which proved the robustness of the model. The tasseling number and the time of entering tasseling stage detected from images were basically consistent with the trends observed in the manually labeled results. This study provides an effective method to monitor the tassel number and the time of entering the tasseling stage. A new maize tassel detection dataset (18260 tassels in 729 near-ground images and 20835 tassels in 144 UAV images) is created. Future studies will focus on making more lightweight models and achieving real-time detection capabilities.
KW - Deep learning
KW - Dynamic monitoring
KW - Maize tassel
KW - RGB images
KW - Tasseling stage
KW - UAV
UR - http://www.scopus.com/inward/record.url?scp=85191711090&partnerID=8YFLogxK
U2 - 10.1007/s11119-024-10135-y
DO - 10.1007/s11119-024-10135-y
M3 - Article
AN - SCOPUS:85191711090
SN - 1385-2256
VL - 25
SP - 1800
EP - 1838
JO - Precision Agriculture
JF - Precision Agriculture
IS - 4
ER -