Corn pose estimation using 3D object detection and stereo images

作     者：Gao, Yuliang Li, Zhen Hong, Qingqing Li, Bin Zhang, Lifeng 

作者机构：Kyushu Inst Technol Grad Sch Engn Kitakyushu Fukuoka 8040015 Japan Nantong Univ Sch Elect Engn Nantong 226021 Jiangsu Peoples R China Yangzhou Univ Coll Artificial Intelligence Yangzhou 225012 Jiangsu Peoples R China 

出 版 物：《COMPUTERS AND ELECTRONICS IN AGRICULTURE》 (Comput. Electron. Agric.)

年 卷 期：2025年第231卷

核心收录：

学科分类：09[农学] 0901[农学-作物学] 0812[工学-计算机科学与技术（可授工学、理学学位）] 

基　　金：JST SPRING  Japan [JPMJSP2154] 

主　　题：3D object detection Stereo vision Corn Transformer FCOSNet 

摘      要：Corn is an important staple crop. Obtaining the pose and dimensions of corn is key for automating corn cultivation, mainly using robotic arms or similar devices to perform precise operations, such as pesticide spraying, measurement, or precise picking. In this study, the Stereo-Corn-Pose Detection (SCPD) algorithm was proposed, which used three dimensional (3D) object detection to obtain the pose and dimensions of corn with stereo images. This algorithm includes pitch angle detection, which is absent in traditional 3D object detection. The SCPD algorithm consists of two models: the union box detection model, FCOS-Stereo, based on the anchor-free network FCOSNet, and the 3D bounding box regression model, Cross-Stereo-EfficientFormer. This regression model incorporates a cross-attention mechanism into EfficientFormer to extract and fuse features effectively. This work constructed a dataset comprising 2,700 samples for training and 300 samples for testing. In the test set, this work achieved a union bounding box mAP of 85.3%, representing a 3.5% improvement over the original FCOSNet model. It also achieved 88.3% AP3D and 85.6% APBEV for 3D bounding box regression, making increases of 5% and 4.7%, respectively, compared to the traditional 3D object detection method, IDA3D. The results indicate an accuracy of approximately 91% in detecting corn dimensions and pose. Therefore, the SCPD algorithm offers a novel framework for obtaining the 3D dimensions and pose of corn and promotes precision and smart agriculture for corn cultivation.