Overview: To the best of our knowledge, it is the first book completely devoted to continuous-time Markov Decision Processes.It studies continuous-time MDPs allowing unbounded transition rates, which is the cas.Continuous-time Markov decision processes (MDPs), also known as controlled Markov chains, are used for modeling decision-making problems that arise in operations research (for instance, inventory, manufacturing, and queueing systems), computer science, communications engineering, control of populations (such as fisheries and epidemics), and management science, among many other fields. T
|