An overview of semantic search evaluation initiatives

作者: Khadija M. Elbedweihy , Stuart N. Wrigley , Paul Clough , Fabio Ciravegna

DOI: 10.1016/J.WEBSEM.2014.10.001

关键词:

摘要: Recent work on searching the Semantic Web has yielded a wide range of approaches with respect to underlying search mechanisms, results management and presentation, style input. Each approach impacts upon quality information retrieved user's experience process. However, despite wealth accumulated from evaluating Information Retrieval (IR) systems, evaluation systems largely been developed in isolation mainstream IR far less unified design activities. This led slow progress low interest when compared other established series, such as TREC for or OAEI Ontology Matching. In this paper, we review existing analyse activities systems. Through discussion these, identify their weaknesses highlight future need more comprehensive framework that addresses current limitations.

参考文章(233)
, SUS: A 'Quick and Dirty' Usability Scale Usability Evaluation in Industry. pp. 207- 212 ,(1996) , 10.1201/9781498710411-35
William R. Hersh, Paul Over, The TREC-9 Interactive Track Report text retrieval conference. ,(2000)
Fabio Ciravegna, Stuart N. Wrigley, Khadija Elbedweihy, Abraham Bernstein, Dorothee Reinhard, Evaluating Semantic Search Tools using the SEALS platform IWEST@ISWC. ,(2010)
Jürgen Umbrich, Renaud Delbru, Aidan Hogan, Andreas Harth, Stefan Decker, Sean O'Riain, SWSE: answers before links! international semantic web conference. pp. 137- 144 ,(2007)
Krisztian Balog, Pavel Serdyukov, Arjen P. de Vries, Overview of the TREC 2011 Entity Track. text retrieval conference. ,(2011)
James Blustein, Jean Tague-Sutcliffe, A Statistical Analysis of the TREC-3 Data text retrieval conference. pp. 385- 398 ,(1995)
S. E. Robertson, Stephen Robertson, The methodology of information retrieval experiment ,(1981)
Frances C. Johnson, Richard J. Hartley, Jillian R. Griffiths, Task dimensions of user evaluation of information retrieval systems Information Research. ,vol. 8, ,(2003)
Aaron Clemmer, Stephen Davies, Smeagol: A “Specific-to-General” Semantic Web Query Interface Paradigm for Novices Lecture Notes in Computer Science. pp. 288- 302 ,(2011) , 10.1007/978-3-642-23088-2_21