Knowledge Acquisition from Multiple Experts: An Empirical Study
通过实证认知研究，比较个体与群体提供一致概率知识的能力，发现群体获取的知识在概率排序上更准确，有助于改进专家系统的知识获取质量。
Expert systems often employ a weight on rules to capture conditional probabilities. For example, in classic rule-based settings, Pr(h ∣ e) = x is used to mean “If e is known to be true then conclude h is true with probability x.” Further, other probability-based approaches, such as influence diagrams and Bayes' Nets are increasingly being used to support decision making through decision support systems. Although algorithms for these systems have received substantial attention, less attention has been given to knowledge acquisition of probabilities used in these systems. However, the underlying probabilities are critical because they lead the user to particular solutions. Accordingly, the purpose of this paper is to investigate the quality of probability knowledge when it is acquired from groups or individuals. This paper summarizes the results of an empirical cognitive study on the ability of individuals and groups to provide consistent sets of probabilities Pr(A), Pr(B), Pr(A ∣ B) and Pr(B ∣ A). The analysis of these probabilities allowed the study of the ability of subjects to account for Bayes' theorem reversals, a basic assumption made by virtually all algorithms. It was found that knowledge acquisition from groups provided more correct orderings to the probabilities than knowledge acquisition from individuals. This suggests that knowledge acquisition from groups is more likely to obtain correct probability knowledge.