Evaluating Summarisation Technologies: A Task Oriented Approach
作者： Iadh Ounis , Anastasios Tombros , Joemon M. Jose , Paul McLellan , Miles Whitehead
DOI:
关键词:
摘要: This paper presents a novel task-oriented approach for the evaluation of automatic text summarisation systems. Evaluation systems has traditionally been troublesome area in research. We propose scheme that evaluates three existing by determining their relative effectiveness an interactive search task, under conditions approximate intended use
mariapinto.es 参考文章(13)
Manuel J. Maña López, Manuel de Buenaga Rodríguez, José María Gómez Hidalgo, Using and Evaluating User Directed Summaries to Improve Information Access european conference on research and advanced technology for digital libraries. pp. 198- 214 ,(1999) , 10.1007/3-540-48155-9_14
G. Salton, The SMART Retrieval System—Experiments in Automatic Document Processing Prentice-Hall, Inc.. ,(1971)
Michael Eisenberg, Carol Barry, Order Effects: A Study of the Possible Influence of Presentation Order on User Judgments of Document Relevance. Journal of the Association for Information Science and Technology. ,vol. 39, pp. 293- 300 ,(1988) , 10.1002/(SICI)1097-4571(198809)39:5<293::AID-ASI1>3.0.CO;2-I
Kathleen McKeown, Jacques Robin, Karen Kukich, Generating concise natural language summaries Information Processing and Management. ,vol. 31, pp. 703- 733 ,(1995) , 10.1016/0306-4573(95)00026-D
J. E. Rush, R. Salvador, A. Zamora, Automatic abstracting and indexing. II. Production of indicative abstracts by application of contextual inference and syntactic coherence criteria Journal of the American Society for Information Science. ,vol. 22, pp. 260- 274 ,(1971) , 10.1002/ASI.4630220405
Richard S. Marcus, Peter Kugel, Alan R. Benenfeld, Catalog information and text as indicators of relevance Journal of the Association for Information Science and Technology. ,vol. 29, pp. 15- 30 ,(1978) , 10.1002/ASI.4630290105
Kathleen McKeown, Dragomir R. Radev, Generating summaries of multiple news articles Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '95. pp. 74- 82 ,(1995) , 10.1145/215206.215334
Michael G. Christel, David B. Winkler, C. Roy Taylor, Multimedia abstractions for a digital video library acm international conference on digital libraries. pp. 21- 29 ,(1997) , 10.1145/263690.263776
Pia Borlund, Peter Ingwersen, The development of a method for the evaluation of interactive information retrieval systems Journal of Documentation. ,vol. 53, pp. 225- 250 ,(1997) , 10.1108/EUM0000000007198
Chris D. Paice, Constructing literature abstracts by computer: techniques and prospects Information Processing and Management. ,vol. 26, pp. 171- 186 ,(1990) , 10.1016/0306-4573(90)90014-S