Capacity planning in logistics corridors: Deep reinforcement learning for the dynamic stochastic temporal bin packing problem
研究物流走廊终端日常容量规划中的不确定性管理，提出基于深度强化学习的实时分配算法，将单个集装箱实时分配给承运商卡车，优于实用启发式和随机混合整数规划方法。
This paper addresses the challenge of managing uncertainty in the daily capacity planning of a terminal in a corridor-based logistics system. Corridor-based logistics systems facilitate the exchange of freight between two distinct regions, usually involving industrial and logistics clusters. In this context, we introduce the dynamic stochastic temporal bin packing problem. It models the assignment of individual containers to carriers’ trucks over discrete time units in real-time. We formulate it as a Markov decision process (MDP). Two distinguishing characteristics of our problem are the stochastic nature of the time-dependent availability of containers, i.e., container delays , and the continuous-time, or dynamic , aspect of the planning, where a container announcement may occur at any time moment during the planning horizon. We introduce an innovative real-time planning algorithm based on Proximal Policy Optimization (PPO), a Deep Reinforcement Learning (DRL) method, to allocate individual containers to eligible carriers in real-time. In addition, we propose some practical heuristics and two novel rolling-horizon batch-planning methods based on (stochastic) mixed-integer programming (MIP), which can be interpreted as computational information relaxation bounds because they delay decision making. The results show that our proposed DRL method outperforms the practical heuristics and effectively scales to larger-sized problems as opposed to the stochastic MIP-based approach, making our DRL method a practically appealing solution. • Novel dynamic stochastic temporal bin packing for logistics corridors optimization. • A cutting-edge capacity planning method using real-time proximal policy optimization. • A novel rolling-horizon two-stage stochastic programming approach for batch planning. • Innovated logistics planning, balancing efficiency across interdependent processes.