Competitive Multitasking Sampling With Deep Reinforcement Learning for Surrogate-Assisted Constrained Multiobjective Optimization
提出一种竞争性多任务采样框架，通过深度强化学习选择三种互补采样子任务，在代理辅助进化优化中平衡可行解与不可行解的采样，提升昂贵约束多目标优化问题的求解效果。
When solving expensive constrained multiobjective optimization problems by surrogate-assisted evolutionary algorithms, the evolutionary sampling method is utilized to select valuable candidate solutions for expensive evaluations, therefore playing a vital role. Most existing sampling methods always prioritize feasible solutions over infeasible solutions during the whole evolutionary process. However, sampling infeasible solutions in some cases can not only provide search directions but also enhance diversity. To tackle this issue, a novel competitive multitasking sampling-based framework is proposed. Specifically, three complementary sampling subtasks are constructed: constraint-prioritized subtask, objective-constraint equivalence subtask, and objective-prioritized subtask. The main task is to find the constrained Pareto front. Different sampling subtasks exhibit different performances on various expensive problems. During each iteration, one of the sampling subtasks is selected by hierarchical deep reinforcement learning technique. This technique can effectively learn the relationship between the environmental states and the performances of different subtasks. Based on the selected subtask, the candidate points are generated via surrogate-assisted evolution. Subsequently, after these points undergo expensive evaluations, they can be regarded as knowledge and transferred to both the subtasks and the main task. Experimental results on three benchmark test suites and a real-world application have demonstrated the framework’s superiority over other state-of-the-art competitors.