Combining neighborhood separable subspaces for classification via sparsity regularized optimization

作者: Pengfei Zhu , Qinghua Hu , Yahong Han , Changqing Zhang , Yong Du

DOI: 10.1016/J.INS.2016.08.004

关键词:

摘要: The neighborhood rough set theory has been successfully applied to various classification tasks. key concept of this is find a sufficient and necessary separable subspace for building compact model. Given learning task, there usually exist numerous subspaces that maintain the discriminative ability original space with respect given granularity. These contain complementary information classification. However, it challenging task compute these efficiently. In paper, we develop fast attribute reduction algorithm based on sample pair selection all reducts. Nevertheless, cannot deal large-scale data. Then propose randomized dependency. can part reducts very efficient. A framework joint representation proposed fully exploit in different subspaces. addition, weight matrix learned combine residuals via group sparsity regularization. performances algorithms are compared, influence granularity discussed. Finally, technique compared other ensemble algorithms. Experimental results show superior state-of-the-art classifiers.

参考文章(58)
Meng Yang, Pengfei Zhu, Feng Liu, Linlin Shen, None, Joint representation and pattern learning for robust face recognition Neurocomputing. ,vol. 168, pp. 70- 80 ,(2015) , 10.1016/J.NEUCOM.2015.06.013
Yuwu Lu, Zhihui Lai, Yong Xu, Xuelong Li, David Zhang, Chun Yuan, Low-Rank Preserving Projections IEEE Transactions on Systems, Man, and Cybernetics. ,vol. 46, pp. 1900- 1913 ,(2016) , 10.1109/TCYB.2015.2457611
Rüdiger W. Brause, Medical Analysis and Diagnosis by Neural Networks Lecture Notes in Computer Science. pp. 1- 13 ,(2001) , 10.1007/3-540-45497-7_1
G. Rätsch, T. Onoda, K.-R. Müller, Soft Margins for AdaBoost Machine Learning. ,vol. 42, pp. 287- 320 ,(2001) , 10.1023/A:1007618119488
Andrzej Skowron, Cecylia Rauszer, The Discernibility Matrices and Functions in Information Systems Intelligent Decision Support. pp. 331- 362 ,(1992) , 10.1007/978-94-015-7975-9_21
Thomas G. Dietterich, Dragos D. Margineantu, Pruning Adaptive Boosting international conference on machine learning. pp. 211- 218 ,(1997)
Thorsten Joachims, Making large scale SVM learning practical Technical reports. ,(1999) , 10.17877/DE290R-14262
Javed Khan, Jun S Wei, Markus Ringner, Lao H Saal, Marc Ladanyi, Frank Westermann, Frank Berthold, Manfred Schwab, Cristina R Antonescu, Carsten Peterson, Paul S Meltzer, None, Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks Nature Medicine. ,vol. 7, pp. 673- 679 ,(2001) , 10.1038/89044
M. T. Wallace, L. K. Wilkinson, B. E. Stein, Representation and integration of multiple sensory inputs in primate superior colliculus. Journal of Neurophysiology. ,vol. 76, pp. 1246- 1266 ,(1996) , 10.1152/JN.1996.76.2.1246
Mehrtash Harandi, Mathieu Salzmann, None, Riemannian coding and dictionary learning: Kernels to the rescue computer vision and pattern recognition. pp. 3926- 3935 ,(2015) , 10.1109/CVPR.2015.7299018