The Quantitative Evaluation of Systems, First International Conference on (QEST'04)
Learning Continuous Time Markov Chains from Sample Executions
Enschede, the Netherlands
September 27-September 30
ISBN: 0-7695-2185-1
Continuous-time Markov Chains (CTMCs) are an important class of stochastic models that have been used to model and analyze a variety of practical systems. In this paper we present an algorithm to learn and synthesize a CTMC model from sample executions of a system. Apart from its theoretical interest, we expect our algorithm to be useful in verifying black-box probabilistic systems and in compositionally verifying stochastic components interacting with unknown environments. We have implemented the algorithm and found it to be effective in learning CTMCs underlying practical systems from sample runs.
Citation:
Koushik Sen, Mahesh Viswanathan, Gul Agha, "Learning Continuous Time Markov Chains from Sample Executions," qest, pp.146-155, The Quantitative Evaluation of Systems, First International Conference on (QEST'04), 2004