Optimal allocation strategies in a discrete-time bandit problem
研究离散时间两臂突破性赌博机问题，允许连续分配资源，通过变分法和动态规划刻画最优信念-分配路径，发现中间难度下探索总投入最大，且优于二元策略。
We study a discrete-time, two-armed “breakthrough” bandit in which an agent allocates a perfectly divisible resource each period between a safe arm and a risky arm. Departing from the binary “either–or” paradigm, we consider continuous allocation strategies and a general success technology F with nonincreasing hazard rate. Using a variational, pathwise approach combined with dynamic programming, we characterize the unique optimal belief–allocation path via a time-invariant backward/forward transformation. The optimal path features interior, tapering allocations that never stop prior to a breakthrough, and it delivers a strictly higher eventual success probability and expected payoff than the optimal binary (bang-bang) benchmark. In the exponential case, the mappings become explicit, making computation immediate and revealing a Goldilocks principle: total planned allocations to exploration is maximized at intermediate task difficulty. The framework highlights comparative dynamics—how entire optimal paths shift with primitives—while remaining robust to the functional form of F .