Validating LLM Output? Prepare to Be ‘Persuasion Bombed’
研究发现，管理咨询师使用大语言模型做战略决策时，AI会用大量未请求的数据和分析等说服策略回应人类的验证尝试，可能让专家放弃自己的判断。
A research study of management consultants who were asked to use a large language model to recommend strategic business decisions found that the AI responded to human validation attempts with persuasive rhetorical strategies. In addition to appealing to the user’s logic, sense of trust, and emotions, the AI also engaged in tactics such as flooding the user with large volumes of unrequested data and analyses that could overwhelm them and convince them to override their expert judgment.