Insights from Attempts to Validate a Multi‐Attribute Model of Problem Definition Quality
通过校园酒精问题的实验，验证了一个多属性模型对问题定义质量的评估效果，发现专家评估存在利益相关者偏见，模型可用于筛选较差定义。
ABSTRACT Problem definitions are often used as part of the problem structuring process in decision sciences. We report an attempt to validate a multi‐attribute model of problem definition quality in the context of an experiment based upon the definition of the ‘alcohol problem’ on a campus. Three independent raters assessed values for the attributes of the model for 57 written problem definitions, and their rating was compared to three subjective ‘expert’ ratings made by individuals with some responsibility for alcohol policy. Our study shows that the experts exhibited considerable stakeholder bias in their assessments of the definitions, suggesting that a definition that is evaluated as good may not be subjectively acceptable to others. We present some evidence that the best definitions are those that provide direction with regard to solution, neither suggesting firm solutions to the problem nor being too open‐ended. It is shown that the multi‐attribute model is a reasonable tool for eliminating poorer definitions. Further, we relate our work to recent conceptual developments in understanding problem definition.