SemEval-2013 Task 2: Sentiment Analysis in Twitter

作者: Preslav Nakov , Zornitsa Kozareva , Sara Rosenthal , Veselin Stoyanov , Alan Ritter

DOI:

关键词: SemEvalWorld Wide WebComputer scienceResearch communitySocial mediaTask (project management)Artificial intelligenceShort Message ServiceSentiment analysisInformation retrievalCrowdsourcing

摘要: In recent years, sentiment analysis in social media has attracted a lot of research interest and been used for number applications. Unfortunately, hindered by the lack suitable datasets, complicating comparison between approaches. To address this issue, we have proposed SemEval-2013 Task 2: Sentiment Analysis Twitter, which included two subtasks: A, an expression-level subtask, B, messagelevel subtask. We crowdsourcing on Amazon Mechanical Turk to label large Twitter training dataset along with additional test sets SMS messages both subtasks. All datasets evaluation are released community. The task significant total 149 submissions from 44 teams. bestperforming team achieved F1 88.9% 69% subtasks A respectively.

参考文章(14)
Andrea Esuli, Stefano Baccianella, Fabrizio Sebastiani, SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining. language resources and evaluation. ,(2010)
Julio Villena-Román, Sara Lana-Serrano, Eugenio Martínez-Cámara, José Carlos González-Cristóbal, None, TASS - Workshop on Sentiment Analysis at SEPLN Procesamiento Del Lenguaje Natural. ,vol. 50, pp. 37- 44 ,(2013)
Patrick Paroubek, Alexander Pak, Twitter Based System: Using Twitter for Disambiguating Sentiment Ambiguous Adjectives meeting of the association for computational linguistics. pp. 436- 439 ,(2010)
Andranik Tumasjan, Isabell M. Welpe, Philipp G. Sandner, Timm Oliver Sprenger, Predicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment international conference on weblogs and social media. ,(2010)
Min-Yen Kan, Tao Chen, Creating a live, public short message service corpus: the NUS SMS corpus language resources and evaluation. ,vol. 47, pp. 299- 335 ,(2012) , 10.1007/S10579-012-9197-9
Janyce Wiebe, Theresa Wilson, Claire Cardie, Annotating Expressions of Opinions and Emotions in Language language resources and evaluation. ,vol. 39, pp. 165- 210 ,(2005) , 10.1007/S10579-005-7880-9
Albert Bifet, Bernhard Pfahringer, Geoffrey Holmes, Ricard Gavaldà, Detecting Sentiment Change in Twitter Streaming Data Journal of Machine Learning Research: Workshop and Conference Proceedings Series. pp. 5- 11 ,(2011)
Bryan R. Routledge, Ramnath Balasubramanyan, Noah A. Smith, Brendan O'Connor, From Tweets to Polls: Linking Text Sentiment to Public Opinion Time Series international conference on weblogs and social media. ,(2010)
Alan Ritter, Mausam, Oren Etzioni, Sam Clark, Open domain event extraction from twitter Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '12. pp. 1104- 1112 ,(2012) , 10.1145/2339530.2339704
Junlan Feng, Luciano Barbosa, Robust Sentiment Detection on Twitter from Biased and Noisy Data international conference on computational linguistics. pp. 36- 44 ,(2010)