Uncalibrated Model-Free Visual Servo Control for Robotic Endoscopic with RCM Constraint Using Neural Networks
提出一种无需标定和模型的无标定无模型视觉伺服控制方案,利用梯度神经网络在线估计雅可比矩阵和交互矩阵,并考虑RCM约束、关节漂移和物理约束,通过二次规划和预定义时间收敛的零化神经网络求解最优控制信号,仿真验证了其在图像特征调节和跟踪任务中的有效性。
With the advancement of robotic-assisted minimally invasive surgery, visual servo control has become a crucial technique for improving surgical outcomes. However, traditional visual servo methods often rely on precise kinematic models and camera calibration, limiting their generalizability. Considering these, this article proposes a novel uncalibrated model-free visual servo control scheme. Specifically, we introduce a Jacobian matrix and interaction matrix estimation method based on a gradient neural network (GNN), which enables online estimation by utilizing control signals and sensor outputs. Then, the estimated results are incorporated into a visual servo control framework that considers remote center of motion (RCM) constraint, joint-drift problem, and physical constraint, formulated as a quadratic programming (QP) problem. Subsequently, focusing on the joint limits and endoscope insertion depth constraint, we develop a nonpiecewise differentiable multilevel constraint handling technique. For the formulated QP problem, a predefined-time convergent error-regulating zeroing neural network (PTCER-ZNN) solver is designed, and we can derive the optimal control signals. Detailed theoretical analyses of the developed GNN estimation method and the PTCER-ZNN solver are provided. Simulation results demonstrate the effectiveness of the proposed scheme in image feature regulation and tracking tasks, exhibiting its advantages over existing approaches.