Performance-based assessment of expertise: How to decide if someone is an expert or not

摘要: Abstract The identification of an expert is vital to any study or application involving expertise. If external criterion (a “gold standard”) exists, then straightforward: Simply compare people against the standard and select whoever closest. However, such criteria are seldom available for domains where experts work; that's why needed in first place. purpose here explore various methods identifying absence a gold standard. One particularly promising approach (labeled CWS Cochran–Weiss–Shanteau ) explored detail. We illustrate through reanalyses three previous studies experts. In each case, provided new insights into When applied auditors, correctly detected group differences For agricultural judges, revealed subtle distinctions between subspecialties personnel selection, showed that irrelevant attributes were more informative than relevant attributes. believe provides valuable tool evaluation