Distributed Vector Representations of Words in the Sigma Cognitive Architecture

作者: Volkan Ustun , Paul S. Rosenbloom , Kenji Sagae , Abram Demski

DOI: 10.1007/978-3-319-09274-4_19

关键词: Word representationWord (computer architecture)Cognitive architectureArtificial intelligenceCognitive modelMachine learningTheoretical computer scienceSigmaComputer scienceFactor graph

摘要: Recently reported results with distributed-vector word representations in natural language processing make them appealing for incorporation into a general cognitive architecture like Sigma. This paper describes new algorithm learning such from large, shallow information resources, and how this can be implemented via small modifications to The effectiveness speed of the are evaluated comparison an external simulation it state-of-the-art algorithms. more limited experiments Sigma also promising, but work is required reach simulation.

参考文章(22)
Tomas Mikolov, Greg S. Corrado, Kai Chen, Jeffrey Dean, Efficient Estimation of Word Representations in Vector Space international conference on learning representations. ,(2013)
P. D. Turney, P. Pantel, From frequency to meaning: vector space models of semantics Journal of Artificial Intelligence Research. ,vol. 37, pp. 141- 188 ,(2010) , 10.1613/JAIR.2934
Michael N. Jones, Douglas J. K. Mewhort, Representing word meaning and order information in a composite holographic lexicon. Psychological Review. ,vol. 114, pp. 1- 37 ,(2007) , 10.1037/0033-295X.114.1.1
Paul S. Rosenbloom, Abram Demski, Volkan Ustun, Efficient message computation in Sigma’s graphical architecture biologically inspired cognitive architectures. ,vol. 11, pp. 1- 9 ,(2015) , 10.1016/J.BICA.2014.11.009
Gregory E. Cox, George Kachergis, Gabriel Recchia, Michael N. Jones, Toward a scalable holographic word-form representation. Behavior Research Methods. ,vol. 43, pp. 602- 615 ,(2011) , 10.3758/S13428-011-0125-5
Stan Franklin, Tamas Madl, Sidney D'Mello, Javier Snaider, LIDA: A Systems-level Architecture for Cognition, Emotion, and Learning IEEE Transactions on Autonomous Mental Development. ,vol. 6, pp. 19- 41 ,(2014) , 10.1109/TAMD.2013.2277589
Andriy Mnih, Koray Kavukcuoglu, Learning word embeddings efficiently with noise-contrastive estimation neural information processing systems. ,vol. 26, pp. 2265- 2273 ,(2013)
Paul S. Rosenbloom, The Sigma cognitive architecture and system AISB Quarterly. ,(2013)
Ronan Collobert, Jason Weston, A unified architecture for natural language processing Proceedings of the 25th international conference on Machine learning - ICML '08. pp. 160- 167 ,(2008) , 10.1145/1390156.1390177
A neural probabilistic language model Journal of Machine Learning Research. ,vol. 3, pp. 1137- 1155 ,(2003) , 10.1162/153244303322533223