复杂环境下樱桃番茄的多阶段采摘点定位方法
DOI:
CSTR:
作者:
作者单位:

1.北京信息科技大学机电工程学院北京100192;2.中国农业机械化科学研究院集团有限公司农业装备技术 全国重点实验室北京100083;3.中国农业机械化科学研究院集团有限公司北京100083

作者简介:

通讯作者:

中图分类号:

TP391.41;TN911.73

基金项目:

农业装备技术全国重点实验室开放基金(NKL-2023-004)、北京市属高校重点研究培育项目(2021YJPY201)、国家重点研发计划“政府间国际科技创新合作”重点专项(SQ2023YFE0101940)资助项目


Multi-stage localization method for picking points of cherry tomatoes in complex environments
Author:
Affiliation:

1.School of Mechanical and Electrical Engineering, Beijing Information Science and Technology University Beijing 100192,China; 2.National Key Laboratory of Agricultural Equipment Technology, Chinese Academy of Agricultural Mechanization Sciences Group Co., Ltd., Beijing 100083, China; 3.Chinese Academy of Agricultural Mechanization Sciences Group Co., Ltd., Beijing 100083, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    樱桃番茄在复杂温室环境中易受果实密集遮挡、果梗细小及姿态多变等因素影响,导致采摘点定位困难。为此,提出一种基于Sim-YOLO-Pose算法与由远及近多阶段定位策略的番茄小目标采摘点定位方法。首先,构建Sim-YOLO-Pose模型,在YOLOv5骨干网络中融合无参SimAM注意力机制,并结合YOLOv7-pose模型,以增强番茄小目标及果梗检测能力,抑制复杂背景干扰;其次,设计由远及近的多阶段定位流程,远距离下利用Sim-YOLO模型检测番茄成熟度并筛选成熟果实;随后动态调整相机至近距离,采用YOLOv7-pose检测果实外轮廓关键点并估计空间姿态;再基于YOLACT实例分割模型提取果梗掩膜,并结合姿态信息预测果梗位置;最后融合果梗轮廓与果实关键点坐标,通过几何计算获得采摘点三维坐标。实验结果表明,Sim-YOLO-Pose模型在番茄小目标及果梗检测任务中平均精度均值(mAP)mAP@0.5达到97.5%,较YOLOv5-pose提升4.5个百分点,单帧检测时间为0.022 s。由远及近多阶段定位方法在复杂场景下采摘点识别成功率达到86.7%,近景单果关键点平均检测置信度为51%。结果表明,该方法能够有效提升复杂温室环境下樱桃番茄小目标检测与采摘点定位的精度和鲁棒性,满足实时采摘应用需求。

    Abstract:

    In complex greenhouse environments, cherry tomatoes are easily affected by dense fruit occlusion, slender pedicels, and variable fruit postures, which makes pickingpoint localization difficult. To address this problem, a tomato small-target picking-point localization method based on the Sim-YOLO-Pose algorithm and a far-to-near multi-stage localization strategy is proposed. First, a Sim-YOLO-Pose model is constructed by integrating the parameter-free SimAM attention mechanism into the YOLOv5 backbone network and combining it with the YOLOv7-pose model, thereby enhancing the detection capability for small tomato targets and pedicels while suppressing complex background interference. Second, a far-to-near multi-stage localization process is designed. At a long distance, the Sim-YOLO model is used to detect tomato maturity and screen mature fruits. The camera is then dynamically adjusted to a close distance, where YOLOv7-pose is used to detect fruit contour keypoints and estimate spatial posture. Subsequently, the YOLACT instance segmentation model is used to extract the pedicel mask, and the pedicel position is predicted by combining posture information. Finally, the pedicel contour and fruit keypoint coordinates are fused to obtain the three-dimensional coordinates of the picking point through geometric calculation. Experimental results show that the Sim-YOLO-Pose model achieves an mAP@0.5 of 97.5% in the detection of small tomato targets and pedicels, which is 4.5 percentage points higher than that of YOLOv5-pose, with a single-frame detection time of 0.022 s. The far-to-near multi-stage localization method achieves a picking-point recognition success rate of 86.7% in complex scenes, and the average detection confidence of single-fruit keypoints in close-range images reaches 51%. The results indicate that the proposed method can effectively improve the accuracy and robustness of small-target detection and picking-point localization for cherry tomatoes in complex greenhouse environments, meeting the requirements of real-time harvesting applications.

    参考文献
    相似文献
    引证文献
引用本文

胡欢,邢宇,张俊宁,韩振浩,韩金龙,王美铱.复杂环境下樱桃番茄的多阶段采摘点定位方法[J].电子测量与仪器学报,2026,40(9):178-189

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-11-13
  • 出版日期:
文章二维码
×
《电子测量与仪器学报》
关于防范虚假编辑部邮件的郑重公告