Nonstationary Markov decision problems with converging parameters

作者: A. Federgruen , P. J. Schweitzer

DOI: 10.1007/BF00935474

关键词:

摘要: This paper considers the solution of Markov decision problems whose parameters can be obtained only via approximating schemes, or where it is computationally preferable to approximate parameters, rather than employing exact algorithms for their computation.

参考文章(35)
D.J. White, ELIMINATION OF NON-OPTIMAL ACTIONS IN MARKOV DECISION PROCESSES Dynamic Programming and its Applications#R##N#Proceedings of the International Conference on Dynamic Programming and its Applications, University of British Columbia, Vancouver, British Columbia, Canada, April 14–16, 1977. pp. 131- 160 ,(1978) , 10.1016/B978-0-12-568150-6.50012-X
Matthew J. Sobel, Optimal Operation of Queues Springer, Berlin, Heidelberg. pp. 231- 261 ,(1974) , 10.1007/978-3-642-80838-8_12
William S. Jewell, MARKOV-RENEWAL PROGRAMMING Defense Technical Information Center. ,(1962) , 10.21236/AD0402064
P.J Schweitzer, Contraction mappings underlying undiscounted Markov decision problems—II Journal of Mathematical Analysis and Applications. ,vol. 132, pp. 154- 170 ,(1978) , 10.1016/0022-247X(88)90051-0
E. V. Denardo, B. L. Fox, Multichain Markov Renewal Programs SIAM Journal on Applied Mathematics. ,vol. 16, pp. 468- 487 ,(1968) , 10.1137/0116038
N. A. J. Hastings, J. M. C. Mello, Tests for Suboptimal Actions in Discounted Markov Programming Management Science. ,vol. 19, pp. 1019- 1022 ,(1973) , 10.1287/MNSC.19.9.1019
Arthur F. Veinott, Discrete Dynamic Programming with Sensitive Discount Optimality Criteria Annals of Mathematical Statistics. ,vol. 40, pp. 1635- 1660 ,(1969) , 10.1214/AOMS/1177697379
P. J. Schweitzer, A. Federgruen, Geometric convergence of value-iteration in multichain Markov decision problems Advances in Applied Probability. ,vol. 11, pp. 188- 217 ,(1979) , 10.2307/1426774
J. L. Goffin, On convergence rates of subgradient optimization methods Mathematical Programming. ,vol. 13, pp. 329- 347 ,(1977) , 10.1007/BF01584346
Eric V. Denardo, Markov Renewal Programs with Small Interest Rates Annals of Mathematical Statistics. ,vol. 42, pp. 477- 496 ,(1971) , 10.1214/AOMS/1177693399