摘要: Intuitively we know, some software errors are more complex than others. If the error can be fixed by changing one faulty statement, it is a simple error. The substantial fix must be, consider In this work, formally define and quantify complexity of an w.r.t. error's least complex, correct fix. As concrete measure for such fixes, introduce Cyclomatic Change Complexity which inspired existing program metrics. Moreover, CoREBench, collection 70 regression systematically extracted from several open-source C-projects compare their with that seeded in two most popular benchmarks, SIR Siemens Suite. We find significantly less i.e., require compared to actual errors. For example, among 42% 8% ones. This concern external validity studies based on propose CoREBench controlled study testing, debugging, repair techniques.
acm.org
sci-hub.se 参考文章(26)
T.J. McCabe, A Complexity Measure IEEE Transactions on Software Engineering. ,vol. SE-2, pp. 308- 320 ,(1976) , 10.1109/TSE.1976.233837
Hyunsook Do, Sebastian Elbaum, Gregg Rothermel, Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact Empirical Software Engineering. ,vol. 10, pp. 405- 435 ,(2005) , 10.1007/S10664-005-3861-2
David Hovemeyer, William Pugh, Finding bugs is easy conference on object-oriented programming systems, languages, and applications. pp. 132- 136 ,(2004) , 10.1145/1028664.1028717
A. Jefferson Offutt, Investigations of the software testing coupling effect ACM Transactions on Software Engineering and Methodology. ,vol. 1, pp. 5- 20 ,(1992) , 10.1145/125489.125473
J. H. Andrews, L. C. Briand, Y. Labiche, Is mutation an appropriate tool for testing experiments international conference on software engineering. pp. 402- 411 ,(2005) , 10.1145/1062455.1062530
Satish Chandra, Abhik Roychoudhury, Dawei Qi, Hoang Duong Thien Nguyen, SemFix: program repair via semantic analysis international conference on software engineering. pp. 772- 781 ,(2013) , 10.5555/2486788.2486890
S. Henry, D. Kafura, Software Structure Metrics Based on Information Flow IEEE Transactions on Software Engineering. ,vol. 7, pp. 510- 518 ,(1981) , 10.1109/TSE.1981.231113
R.A. DeMillo, R.J. Lipton, F.G. Sayward, Hints on Test Data Selection: Help for the Practicing Programmer Computer. ,vol. 11, pp. 34- 41 ,(1978) , 10.1109/C-M.1978.218136
Jacob Cohen, A Coefficient of agreement for nominal Scales Educational and Psychological Measurement. ,vol. 20, pp. 37- 46 ,(1960) , 10.1177/001316446002000104
Akbar Siami Namin, Sahitya Kakarla, The use of mutation in testing experiments and its sensitivity to external threats Proceedings of the 2011 International Symposium on Software Testing and Analysis - ISSTA '11. pp. 342- 352 ,(2011) , 10.1145/2001420.2001461