Evaluating a Web-Based Tool for Crowdsourced Navigation Stress Tests

作者: Florian Meier , Alexander Bazo , Manuel Burghardt , Christian Wolff

DOI: 10.1007/978-3-642-39253-5_27

关键词: Test (assessment)World Wide WebWeb applicationLaboratory testStress (linguistics)Asynchronous communicationHuman–computer interactionInformation architectureCrowdsourcingComputer science

摘要: We present a web-based tool for evaluating the information architecture of website. The allows use crowdsourcing platforms like Amazon's MTurk as means recruiting test persons, and to conduct asynchronous remote navigation stress tests (cf. Instone 2000). also report on an evaluation study which compares our tool-based crowdsourced approach more traditional laboratory setting. Results this comparison indicate that although there are interesting differences between two testing approaches, both lead similar results.

参考文章(8)
Peter Morville, Louis Rosenfeld, Information Architecture for the World Wide Web ,(1998)
HR Hartson, JC Castillo, J Kelso, WC Neale, Remote evaluation Proceedings of the SIGCHI conference on Human factors in computing systems common ground - CHI '96. pp. 228- 235 ,(1996) , 10.1145/238386.238511
Stefano Bussolon, Barbara Russi, Fabio Del Missier, Online card sorting: as good as the paper version european conference on cognitive ergonomics. pp. 113- 114 ,(2006) , 10.1145/1274892.1274912
Anders Bruun, Peter Gull, Lene Hofmeister, Jan Stage, Let your users do the testing: a comparison of three remote asynchronous usability testing methods human factors in computing systems. pp. 1619- 1628 ,(2009) , 10.1145/1518701.1518948
José C. Castillo, H. Rex Hartson, Deborah Hix, Remote usability evaluation: can users report their own critical incidents? human factors in computing systems. pp. 253- 254 ,(1998) , 10.1145/286498.286736
Aniket Kittur, Ed H. Chi, Bongwon Suh, Crowdsourcing user studies with Mechanical Turk Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI '08. pp. 453- 456 ,(2008) , 10.1145/1357054.1357127