Empirical evaluation of a nesting testability transformation for evolutionary testing

作者: Phil McMinn , David Binkley , Mark Harman

DOI: 10.1145/1525880.1525884

关键词: OverfittingComputer scienceTest data generationTest Management ApproachMachine learningEvolutionary algorithmSearch-based software engineeringTheoretical computer scienceTest dataArtificial intelligenceNesting (computing)Testability

摘要: Evolutionary testing is an approach to automating test data generation that uses evolutionary algorithm search a object's input domain for data. Nested predicates can cause problems testing, because information needed guiding the only becomes available as each nested conditional satisfied. This means process overfit early information, making it harder, and sometimes near impossible, satisfy constraints become apparent later in search. The article presents testability transformation allows evaluation of all conditionals at once. Two empirical studies are presented. first study shows form nesting handled prevalent practice. second how improves generation.

参考文章(39)
B.F. Jones, H.H. Sthamer X. Yang, D.E. Eyres, The Automatic Generation Of Software Test Data Sets Using Adaptive Search Techniques WIT Transactions on Information and Communication Technologies. ,vol. 14, ,(1970) , 10.2495/SQM950392
Matthias Grochtmann, Harmen Sthamer, Joachim Wegener, Bryan Jones, Klaus Grimm, Systematic Testing of Real-Time Systems ,(2000)
André Baresel, Robert M. Hierons, Harmen Sthamer, Mark Harman, Lin Hu, Improving Evolutionary Testing By Flag Removal genetic and evolutionary computation conference. pp. 1359- 1366 ,(2002)
Joachim Wegener, Matthias Grochtmann, Verifying Timing Constraints of Real-Time Systems by Means of Evolutionary Testing Real-time Systems. ,vol. 15, pp. 275- 298 ,(1998) , 10.1023/A:1008096431840
André Baresel, Harmen Sthamer, Evolutionary testing of flag conditions genetic and evolutionary computation conference. pp. 2442- 2454 ,(2003) , 10.1007/3-540-45110-2_148
André Baresel, Harmen Sthamer, Michael Schmidt, Fitness Function Design To Improve Evolutionary Structural Testing genetic and evolutionary computation conference. pp. 1329- 1336 ,(2002)
David Binkley, Phil McMinn, Mark Harman, Testability Transformation for Efficient Automated Test Data Search in the Presence of Nesting UK Software Testing Workshop (UKTest 2005). pp. 165- 182 ,(2005)
P. Puschner, R. Nossal, Testing the results of static worst-case execution-time analysis real time systems symposium. pp. 134- 143 ,(1998) , 10.1109/REAL.1998.739738
N. Tracey, J. Clark, K. Mander, J. McDermid, An automated framework for structural test-data generation automated software engineering. pp. 285- 288 ,(1998) , 10.1109/ASE.1998.732680