Relationship Between Trust in the AI Creator and Trust in AI Systems: The Crucial Role of AI Alignment and Steerability
研究了用户对AI创造者的信任如何转移到对AI系统的信任,发现AI的可引导性和自主性会影响这一转移过程,对AI对齐策略有启示。
This paper offers a novel perspective on trust in artificial intelligence (AI) systems, focusing on the transfer of user trust in AI creators to trust in AI systems. Using the agentic information systems (IS) framework, we investigate the role of AI alignment and steerability in trust transference. Through four randomized experiments, we probe three key alignment-related attributes of AI systems: creator-based steerability, user-based steerability, and autonomy. Results indicate that creator-based steerability amplifies trust transference from AI creator to AI system, while user-based steerability and autonomy diminish it. Our findings suggest that AI alignment efforts should consider the entity with which the AI goals and values should be aligned and highlight the need for research to theorize from a triadic view encompassing the user, the AI system, and its creator. Given the diversity in individual goals and values, we recommend that developers move beyond the prevailing “one-size-fits-all” alignment strategy. Our findings contribute to trust transference theory by highlighting the boundary conditions under which trust transference breaks down or holds in the emerging human-AI environment.