This Article 
 Bibliographic References 
 Add to: 
Refinable Bounds for Large Markov Chains
October 1995 (vol. 44 no. 10)
pp. 1216-1222

Abstract—A method to bound the steady-state solution of large Markov chains is presented. It integrates the concepts of eigenvector polyhedron and of aggregation and is iterative in nature.

The bounds are obtained by considering a subset only of the system state space. This makes the method specially attractive for problems which are too large to be dealt with by traditional methods. The quality of the bounds depends on the locality of the system which is studied: when the system spends most of its time in a small subset of states, tight bounds can be obtained by considering this subset only. Finally, the bounds are refinable in the sense that the tightness of the bounds can be improved by enlarging the subset of states which is considered.

The method is illustrated on a model of a repairable fault-tolerant system with 16 million states. Tight bounds on its availability are obtained by considering less than 0.1 percent of its state space.

[1] A. Berman and R.J. Plemmons,Nonnegative Matrices in the Mathematical Sciences.New York: Academic Press, 1979.
[2] P.-J. Courtois,Decomposability: Queueing and Computer System Application.New York: Academic Press, 1977.
[3] P.J. Courtois and P. Semal,“Bounds for the positive eigenvectors of nonnegative matrices and for their approximations by decomposition,” JACM, vol. 31, 1984.
[4] P.-J. Courtois and P. Semal,“On polyhedra of Perron-Frobenius eigenvectors,” LAA, vol. 65, 1985.
[5] J.C.S. Lui and R.R. Muntz,“Evaluating bounds on steady-state availabilityof repairable systems from Markov models,” Numerical Solution of Markov Chains, W.J. Stewart, ed., New York: Marcel Dekker Inc., 1991.
[6] R.R. Muntz,E. De Souza Silva,, and A. Goyal,“Bounding availability of repairable systems,” SIGMETRICS, 1989.
[7] P. Semal,“Analysis of large Markov models: Bounding techniques and applications,” PhD dissertation, Univ. Catholique de Louvain, Louvain-la-Neuve, Belgium, 1992.
[8] G.W. Stewart,Introduction to Matrix Computations,New York: Academic Press, 1973.
[9] Numerical Solution of Markov Chains, W.J. Stewart, ed., New York: Marcel Dekker Inc., 1991.
[10] R.S. Varga,Matrix Iterative Analysis.Englewood Cliffs, N.J.: Prentice Hall, 1962.

Index Terms:
Large Markov chains, steady-state analysis, aggregation, bounding technique, repairable fault-tolerant system, availability.
Pierre Semal, "Refinable Bounds for Large Markov Chains," IEEE Transactions on Computers, vol. 44, no. 10, pp. 1216-1222, Oct. 1995, doi:10.1109/12.467696
Usage of this product signifies your acceptance of the Terms of Use.