GenSense: A Generalized Sense Retrofitting Model

作者: Hsin-Hsi Chen , Yang-Yin Lee , Hen-Hsen Huang , Yow-Ting Shiue , Ting-Yu Yen

DOI:

关键词: Computer scienceWord embeddingWord (computer architecture)Similarity (psychology)Representation (arts)Relation (database)Theoretical computer scienceSemantic similarityEmbeddingGeneralization

摘要: With the aid of recently proposed word embedding algorithms, study semantic similarity has progressed and advanced rapidly. However, many natural language processing tasks need sense level representation. To address this issue, some researches propose learning algorithms. In paper, we present a generalized model from existing retrofitting model. The generalization takes three major components: relations between senses, relation strength strength. experiment, show that can outperform previous approaches in types experiment: relatedness, contextual difference.

参考文章(26)
Jiang Bian, Bin Gao, Tie-Yan Liu, Knowledge-Powered Deep Learning for Word Embedding european conference on machine learning. pp. 132- 148 ,(2014) , 10.1007/978-3-662-44848-9_9
Jiwei Li, Dan Jurafsky, Do Multi-Sense Embeddings Improve Natural Language Understanding? empirical methods in natural language processing. pp. 1722- 1732 ,(2015) , 10.18653/V1/D15-1200
Manaal Faruqui, Jesse Dodge, Sujay Kumar Jauhar, Chris Dyer, Eduard Hovy, Noah A. Smith, Retrofitting Word Vectors to Semantic Lexicons north american chapter of the association for computational linguistics. pp. 1606- 1615 ,(2015) , 10.3115/V1/N15-1184
John A Bullinaria, Joseph P Levy, None, Extracting semantic representations from word co-occurrence statistics: a computational study. Behavior Research Methods. ,vol. 39, pp. 510- 526 ,(2007) , 10.3758/BF03193020
Antonia Azzini, da Costa Pereira, Mauro Dragoni, Andrea G.B. Tettamanzi, A Neuro-Evolutionary Corpus-Based Method for Word Sense Disambiguation IEEE Intelligent Systems. ,vol. 27, pp. 26- 35 ,(2012) , 10.1109/MIS.2011.108
Kira Radinsky, Eugene Agichtein, Evgeniy Gabrilovich, Shaul Markovitch, A word at a time Proceedings of the 20th international conference on World wide web - WWW '11. pp. 337- 346 ,(2011) , 10.1145/1963405.1963455
Lev Finkelstein, Evgeniy Gabrilovich, Yossi Matias, Ehud Rivlin, Zach Solan, Gadi Wolfman, Eytan Ruppin, Placing search in context Proceedings of the tenth international conference on World Wide Web - WWW '01. pp. 406- 414 ,(2001) , 10.1145/371920.372094
E. Bruni, N. K. Tran, M. Baroni, Multimodal distributional semantics Journal of Artificial Intelligence Research. ,vol. 49, pp. 1- 47 ,(2014) , 10.1613/JAIR.4135
Scott Deerwester, Susan T. Dumais, George W. Furnas, Thomas K. Landauer, Richard Harshman, Indexing by Latent Semantic Analysis Journal of the Association for Information Science and Technology. ,vol. 41, pp. 391- 407 ,(1990) , 10.1002/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9