Semi-supervised Target-level Sentiment Analysis via Variational Autoencoder.

作者: Ying Tan , Weidi Xu

DOI:

关键词:

摘要: Aspect-term sentiment analysis (ATSA) is a longstanding challenge in natural language understanding. It requires fine-grained semantical reasoning about target entity appeared the text. As manual annotation over aspects laborious and time-consuming, amount of labeled data limited for supervised learning. This paper proposes semi-supervised method ATSA problem by using Variational Autoencoder based on Transformer (VAET), which models latent distribution via variational inference. By disentangling representation into aspect-specific lexical context, our induces underlying prediction unlabeled data, then benefits classifier. Our classifier agnostic, i.e., an independent module various advanced can be integrated. Experimental results are obtained SemEval 2014 task 4 show that effective with four classical classifiers. The proposed outperforms two general semisupervised methods achieves state-of-the-art performance.

参考文章(21)
Daan Wierstra, Shakir Mohamed, Danilo Jimenez Rezende, Stochastic Backpropagation and Approximate Inference in Deep Generative Models arXiv: Machine Learning. ,(2014)
Andrej Karpathy, Li Fei-Fei, Justin Johnson, Visualizing and Understanding Recurrent Networks arXiv: Learning. ,(2015)
Max Welling, Diederik P Kingma, Auto-Encoding Variational Bayes international conference on learning representations. ,(2014)
Sepp Hochreiter, Jürgen Schmidhuber, Long short-term memory Neural Computation. ,vol. 9, pp. 1735- 1780 ,(1997) , 10.1162/NECO.1997.9.8.1735
Andrew Y. Ng, Christopher Potts, Andrew L. Maas, Dan Huang, Peter T. Pham, Raymond E. Daly, Learning Word Vectors for Sentiment Analysis meeting of the association for computational linguistics. pp. 142- 150 ,(2011)
Noemie Elhadad, Samuel Brody, An Unsupervised Aspect-Sentiment Model for Online Reviews north american chapter of the association for computational linguistics. pp. 804- 812 ,(2010)
Arjun Mukherjee, Bing Liu, Aspect Extraction through Semi-Supervised Modeling meeting of the association for computational linguistics. ,vol. 1, pp. 339- 348 ,(2012)
Jeffrey Pennington, Richard Socher, Christopher Manning, Glove: Global Vectors for Word Representation empirical methods in natural language processing. pp. 1532- 1543 ,(2014) , 10.3115/V1/D14-1162
Maria Pontiki, Dimitris Galanis, John Pavlopoulos, Harris Papageorgiou, Ion Androutsopoulos, Suresh Manandhar, SemEval-2014 Task 4: Aspect Based Sentiment Analysis Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014). pp. 27- 35 ,(2014) , 10.3115/V1/S14-2004
Diego Marcheggiani, Ivan Titov, Discrete-State Variational Autoencoders for Joint Discovery and Factorization of Relations Transactions of the Association for Computational Linguistics. ,vol. 4, pp. 231- 244 ,(2016) , 10.1162/TACL_A_00095