This Article 
 Bibliographic References 
 Add to: 
Software Reliability Trend Analyses from Theoretical to Practical Considerations
September 1994 (vol. 20 no. 9)
pp. 740-747

This paper addresses the problem of reliability growth characterization and analysis. It is intended to show how reliability trend analyses can help the project manager in controlling the progress of the development activities and in appreciating the efficiency of the test programs. Reliability trend change may result from various reasons, some of them are desirable and expected (such as reliability growth due to fault removal) and some of them are undesirable (such as slowing down Of the testing effectiveness). Identification in time of the latter allows the project manager to take the appropriate decisions very quickly in order to avoid problems which may manifest later. The notions of reliability growth over a given interval and local reliability trend change are introduced through the subadditive property, allowing: better definition and understanding of the reliability growth phenomena; the already existing trend tests are then revisited using these concepts. Emphasis is put on the way trend tests can be used to help the management of the testing and validation process and on practical results that can be derived from their use; it is shown that, for several circumstances, trend analyses give information of prime importance to the developer.

[1] E. N. Adams, "Optimizing preventive service of software products,"IBM J. of Res. and Develop., vol. 28, no. 1, pp. 2-14, Jan. 1984.
[2] H. Ascher and H. Feingold, "Repairable systems reliability: modeling, inference, misconceptions and their causes,"Lecture Notes in Statistics, vol. 7, 1984.
[3] H. Ascher and H. Feingold, "Application of Laplace's test to repairable systems reliability," inFirst Int. Conf. on Reliability and Maintainability, Paris, 1978, pp. 254-258.
[4] D. R. Cox and P. A. W. Lewis,The Statistical Analysis of Series of Events. London: Chapman&Hall, 1966.
[5] O. Gaudoin, "Statistical tools for software reliability evaluation," Ph.D. thesis, Joseph Fournier Univ. Grenoble I, Dec. 1990, (in French).
[6] M. E. Graden and P. S. Horsley, "The effects of software inspections on a major telecommunications project,"AT&T Tech. J., vol. 65, no. 3, pp. 32-40, 1986.
[7] B. V. Gnedenko, Yu. K. Belyayev, and A. D. Solovyev,Mathematical Methods of Reliability Theory. New York: Academic Press, 1969.
[8] R.B. Grady and D.L. Caswell,Software Metrics: Establishing a Company-Wide Program. Englewood Cliffs, NJ: Prentice Hall, 1987.
[9] M. Hollander and F. Proschan, "A test for superadditivity for the mean value function of a non-homogeneous Poisson process,"Stochastic Processing and Their Applicat., vol. 2, 1974, pp. 195-209.
[10] K. Kanoun and T. Sabourin, "Software dependability of a telephone switching system," inProc. 17th IEEE Int. Symp. on Fault-Tolerant Comp. (FTCS-17), Pittsburgh, PA, July 1987, pp. 236-241.
[11] K. Kanoun, M. Bastes Martini and J. Moreira De Souza, "A method for software reliability analysis and prediction application to the TROPICOR switching System,"IEEE Trans. Software Eng.vol. 17, pp. 334-344, Apr. 1991.
[12] K. Kanoun and J. C. Laprie, "The role of trend analysis in software development and validation," inProc. of Safecomp '91, Trondheim, Norway, Oct. 30-Nov. 1, 1991, pp. 169-174.
[13] K. Kanoun, M. Kaâniche, and J. C. Laprie, "Experience in software reliability: from data collection to quantitative evaluation," inProc. Fourth Int. Symp. on Software Rel. Eng., (ISSRE '93), Denver, CO, Nov. 1993, pp. 234-246.
[14] G. Q. Kenney and M. A. Vouk, "Measuring the Field Quality of Wide-Distributed Commercial Software," inProc. Third Int. Symp. on Software Rel. Eng. ISSRE '92, Research Triangle Park, NC, Oct. 1992, pp. 351-357.
[15] J. C. Laprie, "Dependability: basic concepts and terminology,"Dependable Computing and Fault-Tolerant Systems, J.-C. Laprie Ed. New York: Springer Verlag, Wien, 1992, vol. 5.
[16] B. Littlewood, "How to measure software reliability and how not to,"IEEE Trans. Rel., vol. R-28, no. 2, pp. 103-110, June 1979.
[17] J. D. Musa, "Software reliability data,"Data and Analysis Centre for Software, Rome Air Development Centre (RADC), Rome, NY, 1979.
[18] J. D. Musaet al., Software Reliability Measurement, Prediction, Application. New York: McGraw-Hill International, 1987.
[19] M. Ohba, "Software reliability analysis models,"IBM J. Res. Develop., vol. 21, no. 4, pp. 428-443, July 1984.
[20] N. Ross, "The collection and use of data for monitoring software projects,"Measurement for Software Control and Assurance, B. A. Kitchenham and B. Littlewood, Eds. New York: Elsevier Applied Science, 1989, pp. 125-154.
[21] V. Valette, "An environment for software reliability evaluation," inProc. of Software Eng.&its Applicat., Toulouse, France, Dec. 1988, pp. 879-897.
[22] S. Yamada, "Software quality/reliability measurement and assessment: software reliability growth models and data analysis,"J. Inform. Proc., vol. 14, no. 3, 1991, pp. 254-266.

Index Terms:
software reliability; project management; software reliability trend analyses; software reliability growth characterization; reliability trend analyses; project manager; software testing; software validation
K. Kanoun, J.C. Laprie, "Software Reliability Trend Analyses from Theoretical to Practical Considerations," IEEE Transactions on Software Engineering, vol. 20, no. 9, pp. 740-747, Sept. 1994, doi:10.1109/32.317434
Usage of this product signifies your acceptance of the Terms of Use.