|
| This Article | ||
| ||
| Share | ||
| Bibliographic References | ||
| Add to: | ||
| | ||
| Search | ||
| ||
Second International Conference on the Quantitative Evaluation of Systems (QEST'05)
An approximation algorithm for labelled Markov processes: towards realistic approximation
Torino, Italy
September 19-September 22
ISBN: 0-7695-2427-3
| ASCII Text | x | ||
| Alexandre Bouchard-Cote, Norm Ferns, Prakash Panangaden,, Doina Precup, "An approximation algorithm for labelled Markov processes: towards realistic approximation," Quantitative Evaluation of Systems, International Conference on, pp. 54-62, Second International Conference on the Quantitative Evaluation of Systems (QEST'05), 2005. | |||
| BibTex | x | ||
| @article{ 10.1109/QEST.2005.4, author = {Alexandre Bouchard-Cote and Norm Ferns and Prakash Panangaden, and Doina Precup}, title = {An approximation algorithm for labelled Markov processes: towards realistic approximation}, journal ={Quantitative Evaluation of Systems, International Conference on}, volume = {0}, year = {2005}, isbn = {0-7695-2427-3}, pages = {54-62}, doi = {http://doi.ieeecomputersociety.org/10.1109/QEST.2005.4}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, } | |||
| RefWorks Procite/RefMan/Endnote | x | ||
| TY - CONF JO - Quantitative Evaluation of Systems, International Conference on TI - An approximation algorithm for labelled Markov processes: towards realistic approximation SN - 0-7695-2427-3 SP54 EP62 A1 - Alexandre Bouchard-Cote, A1 - Norm Ferns, A1 - Prakash Panangaden,, A1 - Doina Precup, PY - 2005 KW - null VL - 0 JA - Quantitative Evaluation of Systems, International Conference on ER - | |||
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/QEST.2005.4
Approximation techniques for labelled Markov processes on continuous state spaces were developed by Desharnais, Gupta, Jagadeesan and Panangaden. However, it has not been clear whether this scheme could be used in practice since it involves inverting a stochastic kernel.We describe aMonte-Carlobased implementation scheme for this approximation algorithm. This is, to the best of our knowledge, the first implementation of this approximation scheme. The implementation involves some novel ideas about how to estimate infs using sampling and also replacing the explicit description of subsets of the state space by tests for membership. It is hoped that this work will enable more applications of continuous probabilistic LMP theory to emerge.
Citation:
Alexandre Bouchard-Cote, Norm Ferns, Prakash Panangaden,, Doina Precup, "An approximation algorithm for labelled Markov processes: towards realistic approximation," qest, pp.54-62, Second International Conference on the Quantitative Evaluation of Systems (QEST'05), 2005
Usage of this product signifies your acceptance of the Terms of Use.
