loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
The Quantitative Evaluation of Systems, First International Conference on (QEST'04)
Learning Continuous Time Markov Chains from Sample Executions
Enschede, the Netherlands
September 27-September 30
ISBN: 0-7695-2185-1
Koushik Sen, University of Illinois at Urbana Champaign
Mahesh Viswanathan, University of Illinois at Urbana Champaign
Gul Agha, University of Illinois at Urbana Champaign
Continuous-time Markov Chains (CTMCs) are an important class of stochastic models that have been used to model and analyze a variety of practical systems. In this paper we present an algorithm to learn and synthesize a CTMC model from sample executions of a system. Apart from its theoretical interest, we expect our algorithm to be useful in verifying black-box probabilistic systems and in compositionally verifying stochastic components interacting with unknown environments. We have implemented the algorithm and found it to be effective in learning CTMCs underlying practical systems from sample runs.
Citation:
Koushik Sen, Mahesh Viswanathan, Gul Agha, "Learning Continuous Time Markov Chains from Sample Executions," qest, pp.146-155, The Quantitative Evaluation of Systems, First International Conference on (QEST'04), 2004
Usage of this product signifies your acceptance of the Terms of Use.