Technical Note—An Equivalence Between Continuous and Discrete Time Markov Decision Processes

摘要: A continuous time Markov decision process with uniformly bounded transition rates is shown to be equivalent a simpler discrete for both the discounted and average reward criteria on an infinite horizon. This result clarifies some earlier work in this area.