Study on temperature control strategy of moxibustion robot based on reinforcement learning
DOI:
CSTR:
Author:
Affiliation:

1.School of Electrical Engineering, Sichuan University, Chengdu 610065, China; 2.Department of Rehabilitation Medicine, Chengdu Fifth People′s Hospital, Chengdu 611130, China; 3.Department of Acupuncture and Rehabilitation, Affiliated Hospital of Chengdu University of Traditional Chinese Medicine, Chengdu 610072, China

Clc Number:

TP399

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Aiming at the problems of complex parameter identification and poor adaptability of traditional PID control algorithm in temperature control of moxibustion robot, reinforcement learning is introduced into the field of temperature control of moxibustion robot, and an improved reinforcement learning algorithm is proposed. First, the offline training simulation environment of the agent is jointly built by multi-physics simulation software and neural network to solve the problem of low efficiency of online training of the agent; then, an improved reinforcement learning algorithm combining reward guidance and cosine annealing strategy is proposed to improve the convergence and success rate of the algorithm; finally, the model trained in the simulation environment is transferred to the real environment for experimental verification. The experimental results show that the temperature overshoot is 0.2 ℃, and the steady-state temperature is kept within 43.1±0.4 ℃. The improved reinforcement learning algorithm has better temperature control ability than the traditional PID control algorithm.

    Reference
    Related
    Cited by
Get Citation
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:
  • Revised:
  • Adopted:
  • Online: March 08,2024
  • Published:
Article QR Code