Signal Detection Theory Analysis of Type 1 and Type 2 Data: Meta-d′, Response-Specific Meta-d′, and the Unequal Variance SDT Model

作者: Brian Maniscalco , Hakwan Lau

DOI: 10.1007/978-3-642-45190-4_3

关键词: MetacognitionAmbiguityUnequal variancePattern recognitionConstant false alarm rateReceiver operating characteristicDetection theoryArtificial intelligenceRelative operating characteristicComputer sciencePerception

摘要: Previously we have proposed a signal detection theory (SDT) methodology for measuring metacognitive sensitivity (Maniscalco and Lau, Conscious Cogn 21:422–430, 2012). Our SDT measure, meta-d′, provides response-bias free measure of how well confidence ratings track task accuracy. Here provide an overview standard extended formal treatment meta-d′. However, whereas meta-d′ characterizes observer’s in tracking overall accuracy, it may sometimes be interest to assess metacognition particular kind behavioral response. For instance, perceptual task, wish characterize separately reports stimulus presence absence. discuss the computing such “response-specific” corresponding Matlab code. This approach potentially offers alternative explanation data that are typically taken support unequal variance (UV-SDT) model. We demonstrate simulated generated from UV-SDT can fit by equal model positing different ability each response, likewise latter captured UV-SDT. ambiguity entails caution is needed interpreting processes underlying relative operating characteristic (ROC) curve properties. Type 1 ROC curves combining type 2 judgments, traditionally interpreted terms low-level (UV), high-level instead (response-specific metacognition). Similarly, differences area under response-specific reflect influence (UV) rather than processes.

参考文章(24)
James P. Egan, Signal detection theory and ROC analysis Academic Press. ,(1975)
John Arthur Swets, David Marvin Green, Signal Detection Theory and Psychophysics ,(1974)
Susan J. Galvin, John V. Podd, Vit Drga, John Whitmore, Type 2 tasks in the theory of signal detectability: Discrimination between correct and incorrect decisions Psychonomic Bulletin & Review. ,vol. 10, pp. 843- 876 ,(2003) , 10.3758/BF03196546
S. T. MUELLER, C. T. WEIDEMANN, Decision noise: An explanation for observed violations of signal detection theory Psychonomic Bulletin & Review. ,vol. 15, pp. 465- 494 ,(2008) , 10.3758/PBR.15.3.465
John A. Swets, Indices of discrimination or diagnostic accuracy: their ROCs and implied models. Psychological Bulletin. ,vol. 99, pp. 100- 117 ,(1986) , 10.1037/0033-2909.99.1.100
Trisha Van Zandt, ROC curves and confidence judgments in recognition memory. Journal of Experimental Psychology: Learning, Memory and Cognition. ,vol. 26, pp. 582- 600 ,(2000) , 10.1037/0278-7393.26.3.582
John A. Swets, Wilson P. Tanner, Theodore G. Birdsall, Decision processes in perception. Psychological Review. ,vol. 68, pp. 301- 340 ,(1961) , 10.1037/H0040547
Wilson P. Tanner, John A. Swets, A decision-making theory of visual detection. Psychological Review. ,vol. 61, pp. 401- 409 ,(1954) , 10.1037/H0058700
Ryota Kanai, Vincent Walsh, Chia-huei Tseng, Subjective discriminability of invisibility: A framework for distinguishing perceptual and attentional failures of awareness Consciousness and Cognition. ,vol. 19, pp. 1045- 1057 ,(2010) , 10.1016/J.CONCOG.2010.06.003
F. R. Clarke, T. G. Birdsall, W. P. Tanner, Two Types of ROC Curves and Definitions of Parameters The Journal of the Acoustical Society of America. ,vol. 31, pp. 629- 630 ,(1959) , 10.1121/1.1907764