Explanatory Debugging: Supporting End-User Debugging of Machine-Learned Programs

作者: Todd Kulesza , Simone Stumpf , Margaret Burnett , Weng-Keen Wong , Yann Riche

DOI: 10.1109/VLHCC.2010.15

关键词:

摘要: Many machine-learning algorithms learn rules of behavior from individual end users, such as task-oriented desktop organizers and handwriting recognizers. These form a “program” that tells the computer what to do when future inputs arrive. Little research has explored how an user can debug these programs they make mistakes. We present our progress toward enabling users learned via Natural Programming methodology. began with formative study exploring reason about correct text-classification program. From results, we derived prototyped concept based on “explanatory debugging”, then empirically evaluated it. Our results contribute methods for exposing program’s logic eliciting corrections improve predictions.

参考文章(25)
Alona Fyshe, Brett Poulin, Brandon Pearcy, Russ Greiner, Cam MacDonell, D. S. Wishart, Duane Szafron, John Anvik, Roman Eisner, Paul Lu, Visual explanation of evidence in additive classifiers innovative applications of artificial intelligence. pp. 1822- 1829 ,(2006)
Georges G. Grinstein, Andreas Wierse, Usama Fayyad, Information Visualization in Data Mining and Knowledge Discovery ,(2001)
Najmedin Meshkati, Peter A. Hancock, Human Mental Workload ,(1988)
Clifford Konold, Informal Conceptions of Probability Cognition and Instruction. ,vol. 6, pp. 59- 98 ,(1989) , 10.1207/S1532690XCI0601_3
Pinar Dönmez, Carolyn Rosé, Karsten Stegmann, Armin Weinberger, Frank Fischer, Supporting CSCL with automatic corpus analysis technology computer supported collaborative learning. pp. 125- 134 ,(2005) , 10.3115/1149293.1149310
IGOR KONONENKO, INDUCTIVE AND BAYESIAN LEARNING IN MEDICAL DIAGNOSIS Applied Artificial Intelligence. ,vol. 7, pp. 317- 337 ,(1993) , 10.1080/08839519308949993
Alyssa Glass, Deborah L. McGuinness, Michael Wolverton, Toward establishing trust in adaptive agents Proceedings of the 13th international conference on Intelligent user interfaces - IUI '08. pp. 227- 236 ,(2008) , 10.1145/1378773.1378804
David Maulsby, Ian H. Witten, Cima: An interactive concept learning system for end-user applications Applied Artificial Intelligence. ,vol. 11, pp. 653- 671 ,(1997) , 10.1080/088395197117975
Joe Tullio, Anind K. Dey, Jason Chalecki, James Fogarty, How it works: a field study of non-technical users interacting with an intelligent system human factors in computing systems. pp. 31- 40 ,(2007) , 10.1145/1240624.1240630
Jesse Vig, Shilad Sen, John Riedl, Tagsplanations Proceedingsc of the 13th international conference on Intelligent user interfaces - IUI '09. pp. 47- 56 ,(2008) , 10.1145/1502650.1502661