Convergence and Inference of Stream Stochastic Gradient Descent, with Applications to Queueing Systems and Inventory Control
研究了流随机梯度下降（Stream SGD）在马尔可夫依赖数据下的收敛性和推断方法，证明了最优收敛速率和遗憾界，并建立了在线推断框架，适用于排队和库存问题。
Stream SGD: Fast Learning and Valid Inference from Dependent Data Many online optimization problems in operations research rely on data generated by Markovian systems whose dynamics depend on the decision parameters, creating both statistical dependence and biased gradient information. This paper, “Convergence and Inference of Stream Stochastic Gradient Descent, with Applications to Queueing Systems and Inventory Control,” develops a unified theory for stream stochastic gradient descent (SGD), a sample-efficient method that uses just one observation per iteration. Using Poisson-equation techniques, the authors quantify and control gradient bias and dependence, proving an optimal [Formula: see text] convergence rate and a state-of-the-art O(log T) regret bound. Beyond optimization performance, the paper introduces an online inference framework for uncertainty quantification and establishes a functional central limit theorem that underpins valid asymptotic inference. A new Wasserstein-type divergence yields verifiable conditions via coupling arguments tailored to operations research models. Applications to queueing and inventory problems demonstrate how the theory translates into practical, scalable algorithms.