Resolving structural uncertainty in natural resources management using POMDP approaches

作者: Byron K. Williams

DOI: 10.1016/J.ECOLMODEL.2010.12.015

关键词: MathematicsResource managementMarkov decision processMathematical optimizationProcess (engineering)Natural resource managementPartially observable Markov decision processNatural resourceResource (project management)Optimization problem

摘要: In recent years there has been a growing focus on the uncertainties of natural resources management, and importance accounting for uncertainty in assessing management effectiveness. This paper focuses resource terms discrete-state Markov decision processes (MDP) under structural partial observability. It describes treatment with approaches developed partially observable systems. particular, I show how value iteration MDPs (POMDP) can be extended to structurally uncertain MDPs. A key difference between these process classes is that require tracking system state as well probability structure uncertainty, whereas POMDPs only observation uncertainty. The added complexity optimization problem compensated by reduced dimensionality search optimal strategy. solution algorithm outlined simple example conservation biology. By building conceptual framework POMDPs, analysts makers who confront take advantage rapid growth POMDP methods approaches, thereby produce better strategies over larger class problems.

参考文章(41)
James A. Dubovsky, William L. Kendall, Fred A. Johnson, Conditions and Limitations on Learning in the Adaptive Management of Mallard Harvests Wildlife Society Bulletin. ,vol. 30, pp. 176- 185 ,(2002)
Anthony Rocco Cassandra, Leslie Pack Kaelbling, Exact and approximate algorithms for partially observable markov decision processes Brown University. ,(1998)
Anthony Cassandra, Michael L. Littman, Nevin L. Zhang, Incremental pruning: a simple, fast, exact method for partially observable Markov decision processes uncertainty in artificial intelligence. pp. 54- 61 ,(1997)
Michael Lederman Littman, Algorithms for Sequential Decision Making Brown University. ,(1996)
Sebastian Thrun, Joelle Pineau, Geoff Gordon, Point-based value iteration: an anytime algorithm for POMDPs international joint conference on artificial intelligence. pp. 1025- 1030 ,(2003)
Anthony R. Cassandra, Optimal Policies for Partially Observable Markov Decision Processes Brown University. ,(1994)
N. L. Zhang, W. Zhang, Speeding up the convergence of value iteration in partially observable Markov decision processes Journal of Artificial Intelligence Research. ,vol. 14, pp. 29- 51 ,(2001) , 10.1613/JAIR.761
Byron K. Williams, Uncertainty, learning, and the optimal management of wildlife Environmental and Ecological Statistics. ,vol. 8, pp. 269- 288 ,(2001) , 10.1023/A:1011395725123
Byron K. Williams, James D. Nichols, Systems identification and the adaptive management of waterfowl in the United States Wildlife Biology. ,vol. 7, pp. 223- 236 ,(2001) , 10.2981/WLB.2001.027