Seven Years of Image Retrieval Evaluation

摘要: In this chapter we discuss evaluation of Information Retrieval (IR) systems and in particular ImageCLEF, a large–scale campaign that has produced several publicly–accessible resources required for evaluating visual information retrieval is the focus book. This sets scene book by describing purpose system user–centred evaluation, test collections, role campaigns such as TREC CLEF, our motivations starting ImageCLEF then summary tracks run over seven years (data, tasks participants). The will also provide an insight into lessons learned experiences gained spent organising main highlights.