Towards Stochastic Simulations of Relevance Profiles

作者: Kevin Roitero , Andrea Brunello , Julián Urbano , Stefano Mizzaro

DOI: 10.1145/3357384.3358123

关键词:

摘要: Recently proposed methods allow the generation of simulated scores representing values an effectiveness metric, but they do not investigate actual lists retrieved documents. In this paper we address limitation: present approach that exploits evolutionary algorithm and, given a metric score, creates relevance profile (i.e., ranked list values) produces score. We show how profiles are realistic under various analyses.

参考文章(21)
Mark Newman, Networks: An Introduction ,(2010)
Michael D. Cooper, A simulation model of an information retrieval system Information Storage and Retrieval. ,vol. 9, pp. 13- 32 ,(1973) , 10.1016/0020-0271(73)90004-1
Stephen E. Robertson, Evangelos Kanoulas, On per-topic variance in IR evaluation Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval - SIGIR '12. pp. 891- 900 ,(2012) , 10.1145/2348283.2348402
William Webber, Alistair Moffat, Justin Zobel, A similarity measure for indefinite rankings ACM Transactions on Information Systems. ,vol. 28, pp. 20- ,(2010) , 10.1145/1852102.1852106
Ryen W. White, Using searcher simulations to redesign a polyrepresentative implicit feedback interface Information Processing & Management. ,vol. 42, pp. 1185- 1202 ,(2006) , 10.1016/J.IPM.2006.02.005
Feza Baskaya, Heikki Keskustalo, Kalervo Järvelin, Modeling behavioral factors ininteractive information retrieval conference on information and knowledge management. pp. 2297- 2302 ,(2013) , 10.1145/2505515.2505660
Ryen W. White, Ian Ruthven, Joemon M. Jose, C. J. Van Rijsbergen, Evaluating implicit feedback models using searcher simulations ACM Transactions on Information Systems. ,vol. 23, pp. 325- 361 ,(2005) , 10.1145/1080343.1080347
Jean Tague, Michael Nelson, Harry Wu, Problems in the simulation of bibliographic retrieval systems international acm sigir conference on research and development in information retrieval. pp. 236- 255 ,(1980) , 10.5555/636669.636684
Rabia Nuray, Fazli Can, Automatic ranking of information retrieval systems using data fusion Information Processing and Management. ,vol. 42, pp. 595- 614 ,(2006) , 10.1016/J.IPM.2005.03.023