Increasing Validity of Simulation Models Through Metamorphic Testing

作者: Megan Olsen , Mohammad Raunak

DOI: 10.1109/TR.2018.2850315

关键词: ExecutableVerification and validation of computer simulation modelsData miningOracleSoftwareSoftware verificationMetamorphic testingSimulation modelingData modelingComputer science

摘要: Simulation validation, demonstrating that a simulation accurately represents the system it studies, poses particularly potent form of oracle problem. A must be validated for its results to reliable, but often no exists due nature simulations. We propose taking metamorphic testing (MT) approach from realm software verification and applying validating executable models. By establishing pseudo-oracles based on relations between parameters behaviors within an model, we can create methodical overall framework guidelines apply MT with details two prevalent approaches: agent-based models (ABM), discrete-event (DES) modeling. Through three case demonstrate successful application toward different models: ABM gossip propagation, cancer, DES airport check-in security.

参考文章(51)
Jeff Offutt, Paul Ammann, Introduction to Software Testing ,(2016)
Benoît Calvez, Guillaume Hutzler, Parameter Space Exploration of Agent-Based Models Lecture Notes in Computer Science. pp. 633- 639 ,(2005) , 10.1007/11554028_88
Tsong Yueh Chen, Fei-Ching Kuo, Huai Liu, Shengqiong Wang, Conformance Testing of Network Simulators Based on Metamorphic Testing Technique Formal Techniques for Distributed Systems. pp. 243- 248 ,(2009) , 10.1007/978-3-642-02138-1_19
Andreas Tolk, Katherine L. Morse, Levent Yilmaz, Justyna Zander, Simon J. E. Taylor, Azam Khan, Grand challenges on the theory of modeling and simulation Proceedings of the Symposium on Theory of Modeling & Simulation - DEVS Integrative M&S Symposium. pp. 34- ,(2013) , 10.5555/2499634.2499668
Zhi Quan Zhou, Fei-Ching Kuo, Zuohua Ding, Mingyue Jiang, Tsong Yueh Chen, Testing model transformation programs using metamorphic testing software engineering and knowledge engineering. pp. 94- 99 ,(2014)
Osman Balci, Verification, Validation, and Testing Handbook of Simulation. pp. 335- 393 ,(2007) , 10.1002/9780470172445.CH10
Liming Chen, A. Avizienis, N-VERSION PROGRAMMINC: A FAULT-TOLERANCE APPROACH TO RELlABlLlTY OF SOFTWARE OPERATlON ieee international symposium on fault tolerant computing. pp. 113- ,(1995) , 10.1109/FTCSH.1995.532621
Jack P.C. Kleijnen, Verification and validation of simulation models European Journal of Operational Research. ,vol. 82, pp. 145- 162 ,(1995) , 10.1016/0377-2217(94)00016-6