Let's stop pushing the envelope and start addressing it: a reference task agenda for HCI

摘要: We identify a problem with the process of research in human-computer interaction (HCI) community-an overemphasis on "radical invention" at price achieving common focus. Without such focus, it is difficult to build previous work, compare different techniques objectively, and make progress developing theory. These problems level have implications for practice, too; as researchers we often are unable give principled design advice builders new systems. propose that HCI community try achieve focus around notion reference tasks. offer arguments advantages this approach well consider potential difficulties. explain how tasks been highly effective focusing into information retrieval speech recognition. discuss what factors be considered selecting present an example task (for searching archives). This illustrates nature points issues involved constructing using them. conclude recommendations about steps need taken execute agenda. involves both technical needs done changes way operates. The identification important user by systematic requirements gathering, definition operationalization evaluation metrics, execution task-based evaluation, along judicious use field trials. Perhaps more important, also suggested practice must adopt idea work. create forums discussion methods which people can systems techniques. Only doing integrated development, enabling desperately needs.