A High Accuracy Nonlinear Dimensionality Reduction Optimization Method

作者: Zhitong Zhao , Jiantao Zhou , Haifeng Xing

DOI: 10.1007/978-981-15-1377-0_55

关键词: Pattern recognitionArtificial intelligenceNonlinear dimensionality reductionSupport vector machineLinear discriminant analysisCurse of dimensionalityk-nearest neighbors algorithmFeature (machine learning)Kernel principal component analysisDimensionality reductionComputer science

摘要: In the analysis and processing of image recognition, extracting useful valuable data from original dataset has become a problem. Since to be processed often presents high dimensional nonlinear feature, reasonable dimensionality reduction is an necessary method for improving accuracy analysis. One methods Kernel Principal Component Analysis (KPCA) certain advantages in dealing with data, but it also defects when facing which owe highly complex relationship. The other linear Linear Discriminant (LDA) supervisory characteristics, can reduce However only handle data. So we propose hybrid combination above two called KPCA-LDA. By new obtained by step beneficial next classification. We combine KPCA-LDA Back Propagation Neural Network (BPNN) achieve classification handwritten numbers. experimental results show that proposed KPCA-LDA-BPNN model reach 98.67%, about 3%-5% higher than using K Nearest Neighbor (KNN) Support Vector Machine (SVM).

参考文章(21)
Congli Mei, Ming Yang, Dongxin Shu, Hui Jiang, Guohai Liu, Monitoring the wheat straw fermentation process using an electronic nose with pattern recognition methods Analytical Methods. ,vol. 7, pp. 6006- 6011 ,(2015) , 10.1039/C5AY01268F
Khulal Urmila, Huanhuan Li, Quansheng Chen, Zhe Hui, Jiewen Zhao, Quantifying of total volatile basic nitrogen (TVB-N) content in chicken using a colorimetric sensor array and nonlinear regression tool Analytical Methods. ,vol. 7, pp. 5682- 5688 ,(2015) , 10.1039/C5AY00596E
J Shermina, Illumination invariant face recognition using Discrete Cosine Transform and Principal Component Analysis international conference on emerging trends in electrical and computer technology. pp. 826- 830 ,(2011) , 10.1109/ICETECT.2011.5760233
Ruiji Fu, Bing Qin, Ting Liu, Open-categorical text classification based on multi-LDA models Soft Computing. ,vol. 19, pp. 29- 38 ,(2015) , 10.1007/S00500-014-1374-X
Donglan Huang, Dahai Zhang, Yusui Liu, Shirong Zhang, Wei Zhu, A KPCA based fault detection approach for feed water treatment process of coal-fired power plant world congress on intelligent control and automation. pp. 3222- 3227 ,(2014) , 10.1109/WCICA.2014.7053247
Youness Aliyari Ghassabeh, Frank Rudzicz, Hamid Abrishami Moghaddam, Fast incremental LDA feature extraction Pattern Recognition. ,vol. 48, pp. 1999- 2012 ,(2015) , 10.1016/J.PATCOG.2014.12.012
R. Jenssen, Kernel Entropy Component Analysis IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 32, pp. 847- 860 ,(2010) , 10.1109/TPAMI.2009.100
Sebastian Mika, Gunnar Rätsch, Jason Weston, Bernhard Schölkopf, KR Müller, Fisher discriminant analysis with kernels ieee workshop on neural networks for signal processing. pp. 41- 48 ,(1999) , 10.1109/NNSP.1999.788121
Ping Jiang, Yingjie Ge, Chen Wang, Research and application of a hybrid forecasting model based on simulated annealing algorithm: A case study of wind speed forecasting Journal of Renewable and Sustainable Energy. ,vol. 8, pp. 015501- ,(2016) , 10.1063/1.4940408
Xie Yong-lin, LDA algorithm and its application to face recognition Computer Engineering and Applications. ,(2010)