Emulation of CPU-demanding reactive transport models: a comparison of Gaussian processes, polynomial chaos expansion, and deep neural networks

作者: Eric Laloy , Diederik Jacques

DOI: 10.1007/S10596-019-09875-Y

关键词:

摘要: This paper presents a detailed comparison between 3 methods for emulating CPU-intensive reactive transport models (RTMs): Gaussian processes (GPs), polynomial chaos expansion (PCE), and deep neural networks (DNNs). State-of-the-art open source libraries are used each emulation method while the CPU-time incurred by one forward run of considered RTMs varies from 1 h to 30 min 5 days. Besides direct simulated uranium concentration time series, replacing original RTM its emulator is also investigated global sensitivity analysis (GSA), uncertainty propagation, probabilistic calibration using Markov chain Monte Carlo (MCMC) sampling. The selected DNN found be superior both GPs PCE in reproducing input–output behavior 8-dimensional 13-dimensional RTMs. even though training sets small, 75 500 samples. Furthermore, two variants, standard sparse (sPCE), appear always provide least accuracy not differing much performance. As consequence better capabilities, outperforms other propagation. For GSA application, GP offer equally good approximations true first-order total-order Sobol’ indices does less well. Most surprisingly, despite skills, approach leads worst solution synthetic inverse problem which involves 1224 measurement data with low noise. apparently contradicting at partially due small but complicated deterministic noise that affects DNN-based predictions. Indeed, this complex error structure can drive emulated solutions far away posterior distribution case high-quality data. Among methods, only allows retrieving jointly (1) fit appropriate level (log-likelihood value) (2) most closely model parameter values. Overall, our findings indicate when available set relatively (75 input-output examples) fixed beforehand, best choice Instead, or DNNs should preferred. However, deliver overly biased results. In contrast, performs fairly well across all tasks: emulation, analysis, calibration.

参考文章(45)
O. P. Le Maître, Omar M. Knio, Spectral Methods for Uncertainty Quantification Spectral Methods for Uncertainty Quantification: With Applications to Computational Fluid Dynamics. ,(2010) , 10.1007/978-90-481-3520-2
Brian Borchers, Richard C. Aster, Clifford H. Thurber, Parameter estimation and inverse problems (paperback) Recherche. ,(2012)
Richard C. Aster, Brian Borchers, Clifford H. Thurber, Nonlinear Inverse Problems Parameter Estimation and Inverse Problems (Second Edition). pp. 239- 252 ,(2013) , 10.1016/B978-0-12-385048-5.00010-0
Roger G. Ghanem, Pol D. Spanos, Stochastic Finite Elements: A Spectral Approach ,(1990)
Christopher K I Williams, Carl Edward Rasmussen, Gaussian Processes for Machine Learning ,(2005)
Bertrand Iooss, Paul Lemaître, A Review on Global Sensitivity Analysis Methods Uncertainty Management in Simulation-Optimization of Complex Systems. pp. 101- 122 ,(2015) , 10.1007/978-1-4899-7547-8_5
Eric Laloy, Niklas Linde, Diederik Jacques, Jasper A Vrugt, None, Probabilistic inference of multi-Gaussian fields from indirect hydrological data using circulant embedding and dimensionality reduction Water Resources Research. ,vol. 51, pp. 4224- 4243 ,(2015) , 10.1002/2014WR016395
N. Petford, J.A. Miller, J. Briggs, The automated counting of fission tracks in an external detector by image analysis Computers & Geosciences. ,vol. 19, pp. 585- 591 ,(1993) , 10.1016/0098-3004(93)90084-I
CI Steefel, CAJ Appelo, Bhavna Arora, Diederik Jacques, Thomas Kalbacher, O Kolditz, Vincent Lagneau, PC Lichtner, K Ulrich Mayer, JCL Meeussen, Sergi Molins, D Moulton, Haibing Shao, J Šimůnek, N Spycher, SB Yabusaki, GT Yeh, Reactive transport codes for subsurface environmental simulation Computational Geosciences. ,vol. 19, pp. 445- 478 ,(2015) , 10.1007/S10596-014-9443-X
Kurt Hornik, Approximation capabilities of multilayer feedforward networks Neural Networks. ,vol. 4, pp. 251- 257 ,(1991) , 10.1016/0893-6080(91)90009-T