Mining biometric data to predict programmer expertise and task difficulty

作者: Seolhwa Lee , Danial Hooshyar , Hyesung Ji , Kichun Nam , Heuiseok Lim

DOI: 10.1007/S10586-017-0746-2

关键词:

摘要: Programming mistakes frequently waste software developers’ time and may lead to the introduction of bugs into their software, causing serious risks for customers. Using correlation between various process metrics defects, earlier work has traditionally attempted spot such bug risks. However, this study departs from previous works in examining a more direct method using psycho-physiological sensors data detect difficulty program comprehension tasks programmer level expertise. By conducting with 38 expert novice programmers, we investigated how well an electroencephalography eye-tracker can be utilized predicting expertise (novice/expert) task (easy/difficult). both sensors, could predict 64.9 97.7% precision 68.6 96.4% recall, respectively. The result shows it is possible perceived developers data. In addition, found that while single biometric sensor good results, composition best overall performance.

参考文章(31)
T C Hankins, G F Wilson, A comparison of Heart rate, eye activity, eeg and subjective measures of pilot Mental workload during flight Aviation, Space, and Environmental Medicine. ,vol. 69, pp. 360- 367 ,(1998)
Dennis Gannon, Randall Bramley, Geoffrey Fox, Shava Smallen, Al Rossi, Rachana Ananthakrishnan, Felipe Bertrand, Ken Chiu, Matt Farrellee, Madhu Govindaraju, Sriram Krishnan, Lavanya Ramakrishnan, Yogesh Simmhan, Alek Slominski, Yu Ma, Caroline Olariu, Nicolas Rey-Cenvaz, Programming the Grid: Distributed Software Components, P2P and Grid Web Services for Scientific Applications Cluster Computing. ,vol. 5, pp. 325- 336 ,(2002) , 10.1023/A:1015633507128
Thomas Fritz, Andrew Begel, Sebastian C. Müller, Serap Yigit-Elliott, Manuela Züger, Using psycho-physiological measures to assess task difficulty in software development international conference on software engineering. pp. 402- 413 ,(2014) , 10.1145/2568225.2568266
Marco Pedrotti, Shengguang Lei, Jeronimo Dzaack, Matthias Rötting, A data-driven algorithm for offline pupil signal preprocessing and eyeblink detection in low-speed eye-tracking protocols. Behavior Research Methods. ,vol. 43, pp. 372- 383 ,(2011) , 10.3758/S13428-010-0055-7
Nasir Ali, Zohreh Sharafi, Yann-Gaël Guéhéneuc, Giuliano Antoniol, An empirical study on the importance of source code entities for requirements traceability Empirical Software Engineering. ,vol. 20, pp. 442- 478 ,(2015) , 10.1007/S10664-014-9315-Y
Michael E. Smith, Alan Gevins, Neurophysiologic monitoring of mental workload and fatigue during operation of a flight simulator Biomonitoring for Physiological and Cognitive Performance during Military Operations. ,vol. 5797, pp. 116- 126 ,(2005) , 10.1117/12.602181
Janet Siegmund, Christian Kästner, Sven Apel, Chris Parnin, Anja Bethmann, Thomas Leich, Gunter Saake, André Brechmann, Understanding understanding source code with functional magnetic resonance imaging international conference on software engineering. ,vol. 2014, pp. 378- 389 ,(2014) , 10.1145/2568225.2568252
Joseph H Goldberg, Xerxes P Kotval, Computer interface evaluation using eye movements: methods and constructs International Journal of Industrial Ergonomics. ,vol. 24, pp. 631- 645 ,(1999) , 10.1016/S0169-8141(98)00068-7
Jeff Klingner, Rakshit Kumar, Pat Hanrahan, Measuring the task-evoked pupillary response with a remote eye tracker Proceedings of the 2008 symposium on Eye tracking research & applications - ETRA '08. pp. 69- 72 ,(2008) , 10.1145/1344471.1344489
Jaana Simola, Jarkko Salojärvi, Ilpo Kojo, Using hidden Markov model to uncover processing states from eye movements in information search tasks Cognitive Systems Research. ,vol. 9, pp. 237- 251 ,(2008) , 10.1016/J.COGSYS.2008.01.002