Reinforcement Learning-Based Prescribed Performance Motion Control of Pneumatic Muscle Actuated Robotic Arms With Measurement Noises
针对气动肌肉驱动机械臂的非线性和测量噪声问题，提出一种结合强化学习和预设性能的鲁棒控制方法，首次同时限制瞬态和稳态性能、提升噪声抑制能力并优化控制效率。
Featured with high power density, excellent flexibility, shock absorption capacity, etc., pneumatic muscles (PMs) promote the development of exoskeleton robots and rehabilitation equipment. However, the complex nonlinearities of PMs limit efficiency optimization in closed-loop control, while the force-displacement coupling, soft materials, deficient workspace, etc., make it more difficult to simultaneously increase motion speeds and ensure the safety of multiple PM-actuated (PMA) robots. Although force sensors can currently be replaced by applying state estimation techniques, the amplification effects of measurement noises still compromise control accuracy and stability in practice. To this end, this article proposes a reinforcement learning-based robust motion control method with the prescribed performance, which achieves efficient and satisfactory tracking control for PMA robotic arms. In particular, by elaborately incorporating an integral term, a robust generalized proportional integral observer is used to eliminate measurement noises. Meanwhile, by using an actor–critic network to optimize control performance, an error-transformation-based continuous controller is designed to guarantee the uniformly ultimately boundedness of tracking errors. Compared with most existing methods, this article provides the first solution to restrict the entire transient and steady-state performance of PMA robotic arms, improve the noise suppression capability, and optimize the control efficiency simultaneously. Finally, complete stability analysis based on Lyapunov techniques is provided, and several groups of hardware experiments demonstrate the practicability and robustness of the proposed method.