RLGBS:用于造纸机干燥段工艺优化的强化学习引导束搜索

RLGBS: Reinforcement Learning-Guided Beam Search for process optimization in a paper machine dryer section

Computers in Industry · 2025
被引 4
ABS 3

中文导读

针对造纸干燥能耗占行业总能耗三分之二以上的问题,提出RLGBS方法,通过强化学习与束搜索结合优化干燥参数,在多变工况下实现稳定节能,适用于工业过程控制。

Abstract

Paper drying is responsible for over two-thirds of energy consumption in the U.S. pulp and paper industry, presenting significant potential for energy savings through optimization of process parameters. Current approaches often assume fixed operating conditions, neglecting dynamic ambient and process variations that limit achievable savings and real-world applicability. To this end, we develop a physics-based simulation environment for a paper machine dryer section and propose a reinforcement learning (RL) framework to minimize overall energy consumption by optimizing drying process parameters under diverse operating conditions. To mitigate overdrying and numerical instabilities caused by suboptimal local RL actions, we introduce Reinforcement Learning-Guided Beam Search (RLGBS), which explores multiple action sequences in parallel using beam search. Instead of making step-by-step decisions, RLGBS prioritizes solutions based on cumulative probability, reducing the impact of individual suboptimal actions. Experiments demonstrate that RLGBS achieves consistent energy savings under unseen operating conditions not encountered during training, outperforming conventional RL methods. While validated in drying optimization, this framework is broadly applicable to other RL-based industrial process control problems.

造纸工业工艺优化强化学习能源效率