Parameter Optimization of Kernel-based One-class Classifier on Imbalance Learning

作者: Ling Zhuang , Honghua Dai

DOI: 10.4304/JCP.1.7.32-40

关键词: Pattern recognitionQuadratic classifierMachine learningLinear classifierArtificial intelligenceMargin classifierKernel methodSupport vector machineSemi-supervised learningStructured support vector machineMathematicsRadial basis function kernel

摘要: Compared with conventional two-class learning schemes, one-class classification simply uses a single class in the classifier training phase. Applying to learn from unbalanced data set is regarded as recognition based and has shown have potential of achieving better performance. Similar learning, parameter selection significant issue, especially when sensitive parameters. For scheme kernel function, such Support Vector Machine Data Description, besides parameters involved kernel, there another specific parameter: rejection rate v. In this paper, we proposed general framework involve majority solving problem. framework, first use minority target for stage; then both estimating generalization performance constructed classifier. This optimization criteria. We employed Grid search Experiment Design attain various settings. Experiments on UCI Reuters text show that optimized classifiers outperform all standard schemes examined.

参考文章(11)
Stan Matwin, Miroslav Kubat, Addressing the Curse of Imbalanced Training Sets: One-Sided Selection. international conference on machine learning. pp. 179- 186 ,(1997)
D.M.J. Tax, One-class classification TU Delft, Delft University of Technology. ,(2001)
Quang-Anh Tran, Qianli Zhang, Xing Li, Evolving training model method for one-class SVM systems, man and cybernetics. ,vol. 3, pp. 2388- 2393 ,(2003) , 10.1109/ICSMC.2003.1244241
Jianping Zhang, E. Bloedorn, L. Rosen, D. Venese, Learning rules from highly unbalanced data sets international conference on data mining. pp. 571- 574 ,(2004) , 10.1109/ICDM.2004.10015
Quang-Anh Tran, Xing Li, Haixin Duan, Efficient performance estimate for one-class support vector machine Pattern Recognition Letters. ,vol. 26, pp. 1174- 1182 ,(2005) , 10.1016/J.PATREC.2004.11.001
K.-R. Muller, D.M.J. Tax, A consistency-based model selection for one-class classification international conference on pattern recognition. ,vol. 3, pp. 363- 366 ,(2004) , 10.1109/ICPR.2004.24
Bhavani Raskutti, Adam Kowalczyk, Extreme re-balancing for SVMs ACM SIGKDD Explorations Newsletter. ,vol. 6, pp. 60- 69 ,(2004) , 10.1145/1007730.1007739
David M.J Tax, Robert P.W Duin, Support vector domain description Pattern Recognition Letters. ,vol. 20, pp. 1191- 1199 ,(1999) , 10.1016/S0167-8655(99)00087-2
Malik Yousef, Larry M. Manevitz, One-class svms for document classification Journal of Machine Learning Research. ,vol. 2, pp. 139- 154 ,(2002) , 10.5555/944790.944808
Bernhard Schölkopf, John C. Platt, John Shawe-Taylor, Alex J. Smola, Robert C. Williamson, Estimating the Support of a High-Dimensional Distribution Neural Computation. ,vol. 13, pp. 1443- 1471 ,(2001) , 10.1162/089976601750264965