Methods for Evaluating Interactive Information Retrieval Systems with Users
作者： Diane Kelly
DOI:
关键词: Validity 、 Data collection 、 Human–computer information retrieval 、 Research ethics 、 Data analysis 、 Cognitive models of information retrieval 、 Compiler 、 Computer science 、 Information retrieval 、 Relevance (information retrieval)
摘要: This paper provides overview and instruction regarding the evaluation of interactive information retrieval systems with users. The primary goal this article is to catalog compile material related topic into a single source. (1) historical background on development user-centered approaches systems; (2) describes major components system evaluation; (3) different experimental designs sampling strategies; (4) presents core instruments data collection techniques measures; (5) explains basic analysis techniques; reviews discusses previous studies. also validity reliability issues respect both measures methods, research ethics some ethical which are specific studies (IIR). Finally, concludes discussion outstanding challenges future directions.
acm.org
amazon.com
openlibrary.org参考文章(290)
Preben Hansen, Katriina Byström, Conceptual framework for tasks in information studies: Book Reviews Journal of the Association for Information Science and Technology. ,vol. 56, pp. 1050- 1061 ,(2005) , 10.1002/ASI.V56:10
Kalervo Järvelin, Peter Ingwersen, The Turn: Integration of Information Seeking and Retrieval in Context (The Information Retrieval Series) ,(2005)
Pertti Vakkari, Kalervo Järvelin, Explanation in Information Seeking and Retrieval Springer, Dordrecht. pp. 113- 138 ,(2005) , 10.1007/1-4020-4014-8_7
Bryce Allen, Information needs: a person-in-situation approach ISIC '96 Proceedings of an international conference on Information seeking in context. pp. 111- 122 ,(1997)
Susan T. Dumais, Nicholas J. Belkin, The TREC Interactive Tracks: Putting the User into Search ,(2005)
Susan T. Dumais, George Furnas, Thomas Landauer, Louis M. Gomez, The Vocabulary Problem in Human-System Communication: an Analysis and a Solution Communications of The ACM. ,(1987)
Soo Young Rieh, Nicholas J. Belkin, Colleen Cool, Soyeon Park, Kwong Bor Ng, A. Cabezas, K. Kim, Hong (Iris) Xie, R. Pressman, Pamela A. Savage-Knepshield, Rutgers interactive track at TREC-5 text retrieval conference. pp. 257- 265 ,(1996)
Eytan Adar, User 4XXXXX9: Anonymizing Query Logs ,(2007)
Donna K. Harman, The TREC Test Collections The TREC Test Collections. ,(2005)
Ellen M. Voorhees, Donna K. Harman, TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing) The MIT Press. ,(2005)