Joint Binary Neural Network for Multi-label Learning with Applications to Emotion Classification

作者: Rui Xia , Huihui He

DOI:

关键词: Emotion classificationPattern recognitionDeep learningRepresentation (mathematics)Artificial neural networkFeature learningCross entropyComputer scienceArtificial intelligenceSoftmax functionTime delay neural network

摘要: Recently the deep learning techniques have achieved success in multi-label classification due to its automatic representation ability and end-to-end framework. Existing neural networks can be divided into two kinds: binary relevance network (BRNN) threshold dependent (TDNN). However, former needs train a set of isolate which ignore dependencies between labels heavy computational load, while latter an additional function mechanism transform multi-class probabilities outputs. In this paper, we propose joint (JBNN), address these shortcomings. JBNN, text is fed logistic functions instead softmax function, multiple classifications are carried out synchronously one Moreover, relations captured via training on cross entropy (JBCE) loss. To better meet emotion classification, further proposed incorporate prior label JBCE The experimental results benchmark dataset show that our model performs significantly than state-of-the-art methods, both performance efficiency.

参考文章(11)
Fernando Perez-Cruz, Jesse Read, Deep Learning for Multi-label Classification arXiv: Learning. ,(2014)
ROBERT PLUTCHIK, A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION Emotion : Theory, research, and experience. pp. 3- 33 ,(1980) , 10.1016/B978-0-12-558701-3.50007-7
Min-Ling Zhang, Zhi-Hua Zhou, Multilabel Neural Networks with Applications to Functional Genomics and Text Categorization IEEE Transactions on Knowledge and Data Engineering. ,vol. 18, pp. 1338- 1351 ,(2006) , 10.1109/TKDE.2006.162
A neural probabilistic language model Journal of Machine Learning Research. ,vol. 3, pp. 1137- 1155 ,(2003) , 10.1162/153244303322533223
Sheng-Jun Huang, Zhi-Hua Zhou, Multi-label learning by exploiting label correlations locally national conference on artificial intelligence. pp. 949- 955 ,(2012)
Aditya Pal, Yichen Wang, Detecting emotions in social media: a constrained optimization approach international conference on artificial intelligence. pp. 996- 1002 ,(2015)
Fuji Ren, N. Kumar, Changqin Quan, A. Fadl, O. Tepper, Mh Choi, M. Quan, Ns Karp, K. Small, Sentence Emotion Analysis and Recognition Based on Emotion Words Using Ren-CECps ∗ ,(2010)
Deyu ZHOU, Xuan Zhang, Yin Zhou, Quan Zhao, Xin Geng, Emotion Distribution Learning from Texts Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. pp. 638- 647 ,(2016) , 10.18653/V1/D16-1061
Ladislav Lenc, Pavel Král, Deep Neural Networks for Czech Multi-label Document Classification arXiv: Computation and Language. ,(2017) , 10.1007/978-3-319-75487-1_36
Ilya Sutskever, Tomas Mikolov, Greg Corrado, Kai Chen, Jeffrey Dean, Distributed Representations of Words and Phrases and their Compositionality arXiv: Computation and Language. ,(2013)