The Community for Technology Leaders
Quantitative Evaluation of Systems, International Conference on (2005)
Torino, Italy
Sept. 19, 2005 to Sept. 22, 2005
ISBN: 0-7695-2427-3
pp: 54-62
Doina Precup , McGill University Montreal, Quebec, Canada
Alexandre Bouchard-Cote , McGill University Montreal, Quebec, Canada
Prakash Panangaden, , McGill University Montreal, Quebec, Canada
Norm Ferns , McGill University Montreal, Quebec, Canada
ABSTRACT
Approximation techniques for labelled Markov processes on continuous state spaces were developed by Desharnais, Gupta, Jagadeesan and Panangaden. However, it has not been clear whether this scheme could be used in practice since it involves inverting a stochastic kernel.We describe aMonte-Carlobased implementation scheme for this approximation algorithm. This is, to the best of our knowledge, the first implementation of this approximation scheme. The implementation involves some novel ideas about how to estimate infs using sampling and also replacing the explicit description of subsets of the state space by tests for membership. It is hoped that this work will enable more applications of continuous probabilistic LMP theory to emerge.
INDEX TERMS
null
CITATION
Doina Precup, Alexandre Bouchard-Cote, Prakash Panangaden,, Norm Ferns, "An approximation algorithm for labelled Markov processes: towards realistic approximation", Quantitative Evaluation of Systems, International Conference on, vol. 00, no. , pp. 54-62, 2005, doi:10.1109/QEST.2005.4
97 ms
(Ver 3.3 (11022016))