Interactive Evaluation of the Ostensive ModelUsing a New Test Collection of Images with Multiple Relevance Assessments

摘要: The Ostensive Model proposes a manner of structuring the uncertainty associated with individual relevance judgements as sources evidence in feedback. It temporal profiles uncertainty, motivating application particular class discount function respect to age evidence. This paper presents an initial evaluation relative effectiveness different functions. A novel direct manipulation interface multimedia retrieval system embodying is outlined briefly. describes construction and characteristics new image test collection utilising multiple binary assessments. use such assessments interpretations them are discussed. environment detailed terms interface, collection, tasks set users. Multiple results, statistical significance comparisons presented. The results obtained consistent proposals Model—reinforcing profile. give clear pointers further, more specific, evaluations.