loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Fourth International Conference on the Quantitative Evaluation of Systems (QEST 2007)
Signature-based Symbolic Algorithm for Optimal Markov Chain Lumping
Edinburgh, Scotland, UK
September 17-September 19
ISBN: 0-7695-2883-X
Salem Derisavi, Carleton University, Canada
Many approaches to tackle the state-space explosion problem ofMarkov chains are based on the notion of lumpa- bility (a.k.a. probabilistic bisimulation), which allows com- putation of measures using the quotient Markov chain, which, in some cases, has much smaller state space than the original one. We present a new signature-based algorithm for computing the optimal (i.e., smallest possible) quotient Markov chain, prove its correctness, and implement it sym- bolically for Markov chains represented as Multi-Terminal BDDs (MTBDDs). The algorithm is very time-efficient be- cause we translate the core operation of the algorithm, i.e., the computation of the signatures, into symbolic operations. Our experiments on various configurations of three example models with different levels of lumpability show that the al- gorithm (1) handles significantly larger state spaces than an explicit algorithm, (2) outperforms a very efficient explicit algorithm for significantly lumpableMarkov chains while it is not prohibitively slower in the worst case, and (3) out- performs our previous optimal symbolic algorithm [10] in terms of running time although it has higher space require- ment for most of the configurations.
Citation:
Salem Derisavi, "Signature-based Symbolic Algorithm for Optimal Markov Chain Lumping," qest, pp.141-150, Fourth International Conference on the Quantitative Evaluation of Systems (QEST 2007), 2007
Usage of this product signifies your acceptance of the Terms of Use.