Agentic AI and hallucinations
研究了一个竞争市场,其中AI代理从上游生成模型购买答案并转售给用户,用户对准确性和幻觉的担忧不同;代理可通过验证努力降低幻觉风险,而未来收益的威胁约束了努力水平。
We model a competitive market where AI agents buy answers from upstream generative models and resell them to users who differ in how much they value accuracy and in how much they fear hallucinations. Agents can privately exert effort for costly verification to lower hallucination risks. Since interactions halt in the event of a hallucination, the threat of losing future rents disciplines effort. A unique reputational equilibrium exists under nontrivial discounting. The equilibrium effort, and thus the price, increases with the share of users who have high accuracy concerns, implying that hallucination-sensitive sectors, such as law and medicine, endogenously lead to more serious verification efforts in agentic AI markets.