Neural Network-Based Deep Encoding for Mixed-Attribute Data Classification

作者: Tinglin Huang , Yulin He , Dexin Dai , Wenting Wang , Joshua Zhexue Huang

DOI: 10.1007/978-3-030-26142-9_14

关键词:

摘要: This paper proposes a neural network-based deep encoding (DE) method for the mixed-attribute data classification. DE first uses existing one-hot (OE) to encode discrete-attribute data. Second, trains an improved network classify OE-attribute corresponding The loss function of not only includes training error but also considers uncertainty hidden-layer output matrix (i.e., DE-attribute data), where is calculated with re-substitution entropy. Third, classification task conducted based on combination previous continuous-attribute and transformed Finally, we compare OE by support vector machine (SVM) (DNN) 4 KEEL sets. experimental results demonstrate feasibility effectiveness show that can help SVM DNN obtain better accuracies than traditional method.

参考文章(21)
Geoffrey E. Hinton, Vinod Nair, Rectified Linear Units Improve Restricted Boltzmann Machines international conference on machine learning. pp. 807- 814 ,(2010)
Yu-Lin He, James N.K. Liu, Xi-Zhao Wang, Yan-Xing Hu, Optimal bandwidth selection for re-substitution entropy estimation Applied Mathematics and Computation. ,vol. 219, pp. 3425- 3460 ,(2012) , 10.1016/J.AMC.2012.08.056
Xi-Zhao Wang, Yu-Lin He, Debby D. Wang, Non-Naive Bayesian Classifiers for Classification Problems With Continuous Attributes IEEE Transactions on Systems, Man, and Cybernetics. ,vol. 44, pp. 21- 39 ,(2014) , 10.1109/TCYB.2013.2245891
Marc Boullé, MODL: A Bayes optimal discretization method for continuous attributes Machine Learning. ,vol. 65, pp. 131- 165 ,(2006) , 10.1007/S10994-006-8364-X
Daniel Svozil, Vladimír Kvasnicka, Jir̂í Pospichal, Introduction to multi-layer feed-forward neural networks Chemometrics and Intelligent Laboratory Systems. ,vol. 39, pp. 43- 62 ,(1997) , 10.1016/S0169-7439(97)00061-0
Ran Wang, Yu-Lin He, Chi-Yin Chow, Fang-Fang Ou, Jian Zhang, Learning ELM-Tree from big data based on uncertainty reduction Fuzzy Sets and Systems. ,vol. 258, pp. 79- 100 ,(2015) , 10.1016/J.FSS.2014.04.028
Zhi-Hua Zhou, Zhao-Qian Chen, Hybrid decision tree Knowledge Based Systems. ,vol. 15, pp. 515- 528 ,(2002) , 10.1016/S0950-7051(02)00038-2
G.A. Babich, O.I. Camps, Weighted Parzen windows for pattern classification IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 18, pp. 567- 570 ,(1996) , 10.1109/34.494647
Chia-Ming Wang, Yin-Fu Huang, Evolutionary-based feature selection approaches with new criteria for data mining: A case study of credit approval data Expert Systems With Applications. ,vol. 36, pp. 5900- 5908 ,(2009) , 10.1016/J.ESWA.2008.07.026
Guang-Bin Huang, Qin-Yu Zhu, Chee-Kheong Siew, Extreme learning machine: Theory and applications Neurocomputing. ,vol. 70, pp. 489- 501 ,(2006) , 10.1016/J.NEUCOM.2005.12.126