My Advisor, Her AI, and Me: Evidence from a Field Experiment on Human–AI Collaboration and Investment Decisions
通过与欧洲一家大型储蓄银行合作，进行现场实验，比较纯人工智能与人类-人工智能协作投资建议对客户采纳程度和福利的影响。发现客户更倾向于采纳人机协作建议，尤其在风险较高时，且这种效应主要源于人类参与增强了建议的情感吸引力。
Amid ongoing policy and managerial debates on keeping humans in the loop of artificial intelligence (AI) decision-making processes, we investigate whether human involvement in AI-based service production benefits downstream consumers. Partnering with a large savings bank in Europe, we produced pure AI and human–AI collaborative investment advice, which we passed to the bank customers and investigated the degree of their advice taking in a field experiment. On the production side, contrary to concerns that humans might inefficiently override AI output, our findings show that having a human banker in the loop of AI-based financial advisory by giving her the final say over the advice provided does not compromise the quality of the advice. More importantly, on the consumption side, we find that the bank customers are more likely to align their final investment decisions with advice from the human–AI collaboration, compared with pure AI, especially when facing more risky investments. In our setting, this increased reliance on human–AI collaborative advice leads to higher material welfare for consumers. Additional analyses from the field experiment along with an online controlled experiment indicate that the persuasive efficacy of human–AI collaborative advice cannot be attributed to consumers’ belief in increased advice quality resulting from complementarities between human and AI capabilities. Instead, the consumption-side benefits of human involvement in the AI-based service largely stem from human involvement serving as a peripheral cue that enhances the affective appeal of the advice. Our findings indicate that regulations and guidelines should adopt a consumer-centric approach by fostering environments where human capabilities and AI systems can synergize effectively to benefit consumers while safeguarding consumer welfare. These nuanced insights are crucial for managers who face decisions about offering pure AI versus human–AI collaborative services and also for regulators advocating for having humans in the loop. This paper was accepted by D. J. Wu, Special Issue on the Human-Algorithm Connection. Funding: This work was supported by a Hi!PARIS fellowship. Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2022.03918 .