Variational Semi-supervised Aspect-term Sentiment Analysis via Transformer

作者: Wei Chu , Taifeng Wang , Xingyi Cheng , Weidi Xu

DOI:

关键词:

摘要: Aspect-term sentiment analysis (ATSA) is a longstanding challenge in natural language understanding. It requires fine-grained semantical reasoning about target entity appeared the text. As manual annotation over aspects laborious and time-consuming, amount of labeled data limited for supervised learning. This paper proposes semi-supervised method ATSA problem by using Variational Autoencoder based on Transformer (VAET), which models latent distribution via variational inference. By disentangling representation into aspect-specific lexical context, our induces underlying prediction unlabeled data, then benefits classifier. Our classifier agnostic, i.e., an independent module various advanced can be integrated. Experimental results are obtained SemEval 2014 task 4 show that effective with four classical classifiers. The proposed outperforms two general semisupervised methods achieves state-of-the-art performance.

参考文章(32)
Tomas Mikolov, Greg S. Corrado, Kai Chen, Jeffrey Dean, Efficient Estimation of Word Representations in Vector Space international conference on learning representations. ,(2013)
Daan Wierstra, Shakir Mohamed, Danilo Jimenez Rezende, Stochastic Backpropagation and Approximate Inference in Deep Generative Models arXiv: Machine Learning. ,(2014)
Andrej Karpathy, Li Fei-Fei, Justin Johnson, Visualizing and Understanding Recurrent Networks arXiv: Learning. ,(2015)
Max Welling, Diederik P Kingma, Auto-Encoding Variational Bayes international conference on learning representations. ,(2014)
Sepp Hochreiter, Jürgen Schmidhuber, Long short-term memory Neural Computation. ,vol. 9, pp. 1735- 1780 ,(1997) , 10.1162/NECO.1997.9.8.1735
Andrew Y. Ng, Christopher Potts, Andrew L. Maas, Dan Huang, Peter T. Pham, Raymond E. Daly, Learning Word Vectors for Sentiment Analysis meeting of the association for computational linguistics. pp. 142- 150 ,(2011)
Noemie Elhadad, Samuel Brody, An Unsupervised Aspect-Sentiment Model for Online Reviews north american chapter of the association for computational linguistics. pp. 804- 812 ,(2010)
Arjun Mukherjee, Bing Liu, Aspect Extraction through Semi-Supervised Modeling meeting of the association for computational linguistics. ,vol. 1, pp. 339- 348 ,(2012)
Sida Wang, Christopher Manning, Baselines and Bigrams: Simple, Good Sentiment and Topic Classification meeting of the association for computational linguistics. ,vol. 2, pp. 90- 94 ,(2012)
Jeffrey Pennington, Richard Socher, Christopher Manning, Glove: Global Vectors for Word Representation empirical methods in natural language processing. pp. 1532- 1543 ,(2014) , 10.3115/V1/D14-1162