基于视触融合及刚度自适应的机械臂抓取方法
DOI:
CSTR:
作者:
作者单位:

1.哈尔滨理工大学黑龙江省复杂智能系统与集成重点实验室哈尔滨150080; 2.哈尔滨理工大学先进制造智能化 技术教育部重点实验室哈尔滨150080; 3.哈尔滨工业大学机电工程学院哈尔滨150080

作者简介:

通讯作者:

中图分类号:

TP24TH29

基金项目:

黑龙江省自然科学基金(PL2025E050)、黑龙江省省属本科高校优秀青年教师基础研究支持计划(YQJH2025073)项目资助


Mechanical arm grasping method based on vision-tactile fusion and stiffness self-adaptation
Author:
Affiliation:

1.Heilongjiang Provincial Key Laboratory of Complex Intelligent System and Integration, Harbin University of Science and Technology, Harbin 150080, China; 2.Key Laboratory of Advanced Manufacturing Intelligent Technology, Ministry of Education, Harbin University of Science and Technology, Harbin 150080, China; 3.School of Mechatronics Engineering, Harbin Institute of Technology, Harbin 150080, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对非结构化环境中单一视觉几何定位残余误差与物体物理属性未知相耦合,且现有视触系统缺乏底层动态闭环补偿导致接触力失控的问题,提出一种基于视觉先验引导与触觉反馈修正的视触协同机械臂抓取方法。首先,以ResUNet替换GraspNet主干网络并引入基于抓取点与物体重心欧氏距离的重心约束机制,增强点云特征提取完整性,提高抓取位姿检测的物理稳定性与精确率;其次,利用触觉数据集训练卷积神经网络(CNN)-Transformer刚度估计器,并将在线辨识出的软、中、硬3类刚度等级,依据分类概率与阻抗系数映射的导纳参数转换规则输入控制器,实现抓取接触力动态调整,增强交互柔顺性,降低物品损坏风险;最后,在深度确定性策略梯度(DDPG)基础上融合快速随机搜索树算法(RRT)与事后经验回放机制(HER),构建融合路径导向与经验重构的RHER-DDPG算法(RHER-DDPG),通过RRT专家轨迹缩小初期动作探索空间,结合HER将失败目标重新标记为成功样本,共同加速了Actor网络高维状态到动作映射的收敛过程,生成高效抓取策略。对比实验表明:相较原始GraspNet网络,抓取检测精确率提升12.8%;相较传统DDPG算法,模型收敛迭代次数减少约30%,并在真实场景下机械臂抓取测试成功率达90.3%,物品损坏率仅为7.1%,验证了所提方法的有效性。

    Abstract:

    To address the coupling of residual errors of single-visual geometric localization are coupled with the unknown physical properties of objects in unstructured environments, as well as the lack of low-level dynamic closed-loop compensation in existing visuo-tactile systems leading to uncontrolled contact forces, a visuo-tactile collaborative robotic grasping method based on visual prior guidance and tactile feedback correction is proposed. First, the GraspNet backbone network is replaced by ResUNet, and a center-of-mass constraint mechanism based on the Euclidean distance between the grasp point and the object′s centroid is introduced. This enhances the completeness of point cloud feature extraction, thereby improving the physical stability and accuracy of grasp pose detection. Second, a convolutional neural network (CNN)-Transformer stiffness estimator is trained using a tactile dataset. The online-identified soft, medium, and hard stiffness levels are input into the controller according to the admittance parameter conversion rules mapped by classification probabilities and impedance coefficients. This realizes the dynamic adjustment of grasping contact force, enhances interaction compliance, and reduces the risk of object damage. Finally, based on the deep deterministic policy gradient (DDPG), the rapidly-exploring random tree (RRT) algorithm and hindsight experience replay (HER) mechanism are integrated to construct the RRT-guided hindsight experience replay deep deterministic policy gradient (RHER-DDPG) algorithm, which fuses path guidance and experience reconstruction. By utilizing RRT expert trajectories to narrow the initial action exploration space and combining HER to relabel failed targets as successful samples, the convergence process of the Actor network mapping from high-dimensional states to actions is jointly accelerated, generating efficient grasping strategies. Comparative experiments show that, compared with the original GraspNet, the grasp detection accuracy is improved by 12.8%. Compared with the traditional DDPG algorithm, the model convergence iterations are reduced by approximately 30%. In real-world robotic grasping tests, the success rate reaches 90.3% and the object damage rate is only 7.1%, verifying the effectiveness of the proposed method.

    参考文献
    相似文献
    引证文献
引用本文

李佳钰,王宏斌,陈新宇,杨怀广,尤波.基于视触融合及刚度自适应的机械臂抓取方法[J].仪器仪表学报,2026,47(4):143-154

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-06-08
  • 出版日期:
文章二维码