Adaptive Importance Sampling for Efficient Stochastic Root Finding and Quantile Estimation
针对稀有事件下的随机求根问题,提出自适应重要性抽样方法,同时估计根和抽样参数,并嵌入样本平均近似和随机逼近算法,理论证明强一致性和渐近正态性。
Stochastic root-finding problems are fundamental in the fields of operations research and data science. However, when the root-finding problem involves rare events, crude Monte Carlo can be prohibitively inefficient. Importance sampling (IS) is a commonly used approach, but selecting a good IS parameter requires knowledge of the problem’s solution, which creates a circular challenge. In “Adaptive Importance Sampling for Efficient Stochastic Root Finding and Quantile Estimation,” He, Jiang, Lam, and Fu propose an adaptive IS approach to untie this circularity. The adaptive IS simultaneously estimates the root and the IS parameters, and can be embedded in sample average approximation–type algorithms and stochastic approximation–type algorithms. They provide theoretical analysis on strong consistency and asymptotic normality of the resulting estimators, and show the benefit of adaptivity from a worst-case perspective. They also provide specialized analyses on extreme quantile estimation under milder conditions.