Reflections on Mira: Interactive evaluation in information retrieval

摘要: Evaluation in information retrieval (IR) has focussed largely on noninteractive evaluation of text systems. This is increasingly at odds with how people use modern IR systems: highly interactive settings to access linked, multimedia information. Furthermore, this approach ignores potential improvements through better interface design. In 1996 the Commission European Union Information Technologies Programme, funded a three year working group, Mira, discuss and advance research area frameworks for applications. Led by Keith van Rijsbergen, Steve Draper myself from Glasgow University, group brought together many leading researchers domain both human computer interaction (HCI) communities. paper presents my personal view main lines discussion that took place throughout Mira: importing adapting techniques HCI, evaluating different levels as appropriate, against types relevance new challenges drive need rethinking old approaches. The concludes we consider more varied forms complement engine evaluation.