CSDL Home IEEE Transactions on Dependable and Secure Computing 2011 vol.8 Issue No.06 - November/December

Subscribe

Issue No.06 - November/December (2011 vol.8)

pp: 798-809

Juan A. Carrasco , Universitat Politècnica de Catalunya, Barcelona

Víctor Suñé , Universitat Politècnica de Catalunya, Barcelona

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TDSC.2010.49

ABSTRACT

Markov reward models have interesting modeling applications, particularly those addressing fault-tolerant hardware/software systems. In this paper, we consider a Markov reward model with a reward structure including only reward rates associated with states, in which both positive and negative reward rates are present and null reward rates are allowed, and develop a numerical method to compute the distribution function of the cumulative reward till exit of a subset of transient states of the model. The method combines a model transformation step with the solution of the transformed model using a randomization construction with two randomization rates. The method introduces a truncation error, but that error is strictly bounded from above by a user-specified error control parameter. Further, the method is numerically stable and takes advantage of the sparsity of the infinitesimal generator of the transformed model. Using a Markov reward model of a fault-tolerant hardware/software system, we illustrate the application of the method and analyze its computational cost. Also, we compare the computational cost of the method with that of the (only) previously available method for the problem. Our numerical experiments seem to indicate that the new method can be efficient and that for medium size and large models can be substantially faster than the previously available method.

INDEX TERMS

Fault tolerance, modeling techniques, Markov reward models, numerical algorithms.

CITATION

Juan A. Carrasco, Víctor Suñé, "A Numerical Method for the Evaluation of the Distribution of Cumulative Reward till Exit of a Subset of Transient States of a Markov Reward Model",

*IEEE Transactions on Dependable and Secure Computing*, vol.8, no. 6, pp. 798-809, November/December 2011, doi:10.1109/TDSC.2010.49REFERENCES