A direct measure of discriminant and characteristic capability for classifier building and assessment

作者: Giuliano Armano

DOI: 10.1016/J.INS.2015.07.028

关键词:

摘要: Performance measures are used in various stages of the process aimed at solving a classification problem. Unfortunately, most these fact biased, meaning that they strictly depend on class ratio - i.e. imbalance between negative and positive samples. After pointing to source bias for best known measures, novel unbiased defined which able capture concepts discriminant characteristic capability. The combined use can give important information researchers involved machine learning or pattern recognition tasks, particular classifier performance assessment feature selection.

参考文章(41)
Huan Liu, Zheng Zhao, Searching for interacting features international joint conference on artificial intelligence. pp. 1156- 1161 ,(2007)
Rudy Setiono, Huan Liu, Feature selection and classification - a probabilistic wrapper approach industrial and engineering applications of artificial intelligence and expert systems. pp. 419- 424 ,(1996)
Peter A. Flach, C sar Ferri, Jos Hern ndez-orallo, A Coherent Interpretation of AUC as a Measure of Aggregated Classification Performance international conference on machine learning. pp. 657- 664 ,(2011)
Manoranjan Dash, Huan Liu, Hiroshi Motoda, Consistency Based Feature Selection pacific asia conference on knowledge discovery and data mining. pp. 98- 109 ,(2000) , 10.1007/3-540-45571-X_12
Pedro Domingos, A Unified Bias-Variance Decomposition for Zero-One and Squared Loss national conference on artificial intelligence. pp. 564- 569 ,(2000)
W. Duch, K. Grabczewski, T. Winiarski, J. Biesiada, A. Kachel, Feature selection based on information theory, consistency and separability indices international conference on neural information processing. ,vol. 4, pp. 1951- 1955 ,(2002) , 10.1109/ICONIP.2002.1199014
Andrew W. Moore, Mary S. Lee, Efficient Algorithms for Minimizing Cross Validation Error Machine Learning Proceedings 1994. pp. 190- 198 ,(1994) , 10.1016/B978-1-55860-335-6.50031-3
George H John, Ron Kohavi, Karl Pfleger, None, Irrelevant Features and the Subset Selection Problem Machine Learning Proceedings 1994. pp. 121- 129 ,(1994) , 10.1016/B978-1-55860-335-6.50023-4
Jerome H. Friedman, On Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality Data Mining and Knowledge Discovery. ,vol. 1, pp. 55- 77 ,(1997) , 10.1023/A:1009778005914