A Deep Reinforcement Learning Framework Assisted by Genetic Programming for Dynamic Flexible Job Shop Scheduling
针对电解铝生产中作业动态到达的柔性调度问题，提出一种结合行为聚类多树遗传编程和树结构长短期记忆网络的深度强化学习框架，以最小化总延迟时间，实验证明其优于现有方法。
The dynamic flexible job shop scheduling problem with jobs arriving (DFJSP-JA) is a critical scheduling problem in electrolytic aluminum production processes within the aluminum industry. In the DFJSP-JA, job processing information is obtained after job arrival, thus requiring real-time decisions to minimize total tardiness (TTD). A tree-structured long short-term memory deep reinforcement learning framework with behavior clustering-based multi-tree genetic programming (TDRL-BCMTGP) is proposed to address the DFJSP-JA. Behavior clustering is introduced to group the candidates of the multi-tree genetic programming (MTGP) to expedite the iterative generation of high-quality scheduling rules by improving the population diversity of the MTGP. A Tree-structured Long Short-Term Memory (Tree-LSTM) model trained via contrastive learning generates embedding vectors that capture the structural discrepancy and semantic similarity of the candidates. The embedding vectors are concatenated with the shop floor states and fed into the policy network to train an effective agent. Experimental results demonstrate that the TDRL-BCMTGP framework outperforms state-of-the-art methods in minimizing the TTD across four types of dynamic shop floor scenarios in electrolytic aluminum production processes, while maintaining robust generalization capability under simulated time delays and dynamic changes in shop floor machines.