🌙

不要把鸡蛋都放在一个篮子里:应用心理学中的多重宇宙分析

Do not put all of your eggs in one basket: Multiverse analysis in applied psychology.

Journal of Applied Psychology · 2025
被引 5
人大 A+FT50ABS 4*

中文导读

介绍了多重宇宙分析如何帮助研究者系统评估不同数据处理和分析方式对假设检验结果的影响,并提供了操作指南和预注册模板,适合应用心理学研究者提升研究透明度。

Abstract

A multiverse analysis allows researchers to systematically evaluate the support for a hypothesis across a range of sensible ways in which data can be prepared for statistical analysis and/or be analyzed. Accordingly, multiverse analysis provides insights into the relevance of different approaches to, for instance, dealing with outliers or attrition, creating scales, or using different measures for the same construct. The goal of this article is to illustrate the usefulness of multiverse analysis for research in applied psychology and to guide researchers in conducting a multiverse analysis. To do so, we provide a detailed process model of the typical stages involved in conducting a multiverse analysis (along with a shortened version depicting multiverse analysis "at a glance"), as well as a designated, corresponding preregistration template for multiverse analysis. To showcase the merits of a multiverse analysis, we also evaluate two exemplary hypotheses regarding employees' experience of commuting to and from work. We observed that the results of these hypothesis tests varied strongly depending on how common decisions were made. As such, multiverse analysis represents an important tool for exploring the robustness of knowledge at the level of individual studies, even before a replication is conducted. Hence, multiverse analysis can strengthen the transparency and openness of empirical work. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

应用心理学研究方法数据分析可重复性