Observer-Based Human-in-the-Loop Optimal Output Cluster Synchronization Control for Multiagent Systems: A Model-Free Reinforcement Learning Method
研究了非线性多智能体系统中，人机协同下的最优输出簇同步控制问题，通过设计观测器和强化学习算法，在无需完整系统模型的情况下实现控制目标。
This article investigates the observer-based human-in-the-loop (HiTL) optimal output cluster synchronization control problem for nonlinear multiagent systems (MASs). First, the leader is designed to be nonautonomous, with the unknown time-varying input monitored by the human operator directly. To address the problem that leader's output is not available to each follower, an observer is designed. This observer features practical prescribed-time convergence, and independence of prior knowledge of leader's input. Then, an augmented system consisting of observer dynamics and follower dynamics is constructed and a cost function is formulated. Accordingly, the HiTL optimal output cluster synchronization control problem is transformed into a solution to the Hamilton-Jacobian-Bellman equation (HJBE). Subsequently, the off-policy reinforcement learning algorithm is utilized to learn the solution to HJBE without complete knowledge of the system dynamics. To alleviate computational burden, the single critic neural network (NN) is employed for the algorithm implementation, with the least square method applied for training the NN weights. Finally, the simulation results are presented to verify the validity of the designed control scheme.