Metamorphic validation for agent-based simulation models

作者: Mohammad Raunak , Megan Olsen

DOI:

关键词:

摘要: Effective validation of complex simulation models is often very difficult, especially when data does not exist to perform result through comparison outputs a run against the real world. This situation similar problem faced during verification computer programs for which there an "oracle" test correctness output. Software Engineering researchers have developed alternate technique known as metamorphic testing, that uses set related input-output combinations called "pseudooracles." We propose modified version testing can be applied model validation, validation. Our new approach highly effective in building confidence toward establishing validity systematic process discovery and application relations. present detailed applying this on agent-based simulations. then utilize case-study show successful validating previously published multi-scale cancer.

参考文章(17)
Xiaoyuan Xie, Joshua W.K. Ho, Christian Murphy, Gail Kaiser, Baowen Xu, Tsong Yueh Chen, Testing and validating machine learning classifiers by metamorphic testing international conference on quality software. ,vol. 84, pp. 544- 558 ,(2011) , 10.1016/J.JSS.2010.11.920
Christian Murphy, Leon Osterweil, M. S. Raunak, Andrew King, Sanjian Chen, Christopher Imbriano, Gail Kaiser, Insup Lee, Oleg Sokolsky, Lori Clarke, On effective testing of health care simulation software software engineering in health care. pp. 40- 47 ,(2011) , 10.1145/1987993.1988003
Tsong Chen, Joshua WK Ho, Huai Liu, Xiaoyuan Xie, An innovative approach for testing bioinformatics programs using metamorphic testing BMC Bioinformatics. ,vol. 10, pp. 24- 24 ,(2009) , 10.1186/1471-2105-10-24
D.R. Miller, Sensitivity analysis and validation of simulation models Journal of Theoretical Biology. ,vol. 48, pp. 345- 360 ,(1974) , 10.1016/S0022-5193(74)80005-6
E. J. Weyuker, On Testing Non-Testable Programs The Computer Journal. ,vol. 25, pp. 465- 470 ,(1982) , 10.1093/COMJNL/25.4.465
Gail Kaiser, Christian Murphy, Metamorphic testing techniques to detect defects in applications without test oracles Metamorphic testing techniques to detect defects in applications without test oracles. pp. 232- 232 ,(2010) , 10.7916/D81261JW
Sergio Segura, Robert M. Hierons, David Benavides, Antonio Ruiz-Cortés, Automated metamorphic testing on the analyses of feature models Information & Software Technology. ,vol. 53, pp. 245- 258 ,(2011) , 10.1016/J.INFSOF.2010.11.002
James M. Bieman, Upulee Kanewala, Techniques for testing scientific programs without an Oracle computational science and engineering. pp. 48- 57 ,(2013) , 10.5555/2663370.2663378