This Article 
 Bibliographic References 
 Add to: 
On the Reliability of AI Planning Software in Real-Time Applications
February 1995 (vol. 7 no. 1)
pp. 4-13

Abstract—We define the reliability of a real-time system incorporating AI planning programs as the probability that, for each problem-solving request issued from the environment, the embedded system can successfully plan and execute a response within a specified real-time deadline. A methodology is developed for evaluating the reliability of such systems taking into consideration the fact that, other than program bugs, the intrinsic characteristics of AI planning programs may also cause the embedded system to fail even after all software bugs are removed from the program. The utility of the methodology is demonstrated by applying it to the reliability evaluation of two AI planning algorithms embedded in a real-time multicriteria route-finding system.

[1] R.E. Barlow,F. Proschan,Statistical Theory of Reliability and Life Testing,New York: Holt, Rinehart and Winston, Inc., 1975.
[2] M. Boddy,“Anytime problem solving using dynamic programming,” 9th National Conf. Artificial Intelligence, pp. 738-743, 1991.
[3] I.R. Chen and F.B. Bastani,“Effect of Artificial Intelligenceplanning-procedures on system reliability,” IEEE Trans. Reliability, pp.364-369, Aug., 1991.
[4] I.R. Chen and B. Poole,“Performance of rule grouping on a real-time expertsystem architecture,” IEEE Trans. Knowledge and Data Eng., vol. 6, no. 6, pp. 883-891, Dec., 1994.
[5] I.R. Chen,F.B. Bastani, and T.W. Tsao,“On the Intrinsic Faults of Real-Time AIPlanning Programs,” Technical Report UMCIS-1993-10, Dept. of Computer Science,University of Mississippi, 1993.
[6] T. Dean, and M. Boddy,“An analysis of time-dependent planning,” 7th National Conf. Artificial Intelligence, pp. 49-54, August, 1988.
[7] A.C. Diaz,An Overview of Realtime Expert Systems, National Research Council Canada, ERA-380, NRC No. 31759, April 1990.
[8] J. J. Grimm,G.B. Lamont,, and A.J. Terzuoli,“A parallelized search strategyfor solving a multicriteria aircraft routing problem,” Proc. 1993 ACM/SIGAPP Symposium on Applied Computing,Indianapolis, pp. 570-577, 1993.
[9] A. Gupta, Parallelism in Production Systems.Los Altos, Calif.: Morgan Kaufmann, 1987.
[10] B. Hamidzadeh, and S. Shekhar,“DYNORA: A real-time planning algorithm to meetresponse-time constraints in dynamic environments,” Proc. 3rd Int. Conf. Tools for AI,San Jose, pp. 228-235, 1991.
[11] P.G. Hoel,S.C. Port,, and C.J. Stone,Introduction to Probability Theory,Boston: Houghton Mifflin Co., 1971.
[12] T. Ishida,“Parallel rule firing in production systems,” IEEE Trans. on Knowledge and Data Engineering, vol. 3, No. 1, pp 11-17, March 1991.
[13] B.W. Johnson, Design and Analysis of Fault-Tolerant Digital Systems, pp. 394-402. Reading, Mass.: Addison-Wesley, June 1989.
[14] R.E. Korf,“Real-time heuristic search,” Artificial Intelligence, vol. 42, nos. 2-3, pp. 189-211, Mar. 1990.
[15] T.J. Laffey,P.A. Cox,J.L. Schmidt,S.M. Kao, and J.Y. Read,"Real-time knowledge-based systems," AI Magazine, pp. 27-45, Spring 1988.
[16] D.P. Miranker and B.J. Lofaso,"The organization and performance of a TREAT-based production system compiler," IEEE Trans. Knowledge and Data Engineering, vol. 3, no. 1, pp. 3-10, Mar. 1991.
[17] J.D. Musa and K. Okumoto, "A Logarithmic Poisson Execution Time Model for Software Reliability Measurement," Proc. Seventh Int'l Conf. Software Eng., IEEE CS Press, Los Alamitos, Calif., 1984, pp. 230-238.
[18] J.D. Musa,A. Iannino,, and K. Okumoto,Software Reliability: Measurement, Prediction and Application.New York: McGraw-Hill, 1987.
[19] J. Pearl,Heuristics, Addison-Wesley, 1984.
[20] C.V. Ramamoorthy, and F.B. Bastani,“Software reliability - status and perspective,” IEEE Trans. Soft. Eng., pp. 354-371, July 1982.
[21] E. Rich,Artificial Intelligence, 2nd. Ed., McGraw-Hill, 1991.
[22] S. M. Ross,Introduction to Probability Models, 4th Ed., Academic Press, 1989.
[23] B.W. Wah, and L.C. Chu,“TCA*- A time constrained approximation A*search algorithm,” Proc. 2nd Inter. Conf. Tools for AI,Washington D.C., pp. 314-320, 1990.
[24] P.H. Winston, Artificial Intelligence. Reading, Mass.: Addison-Wesley, 1984.
[25] L.A. Zadeh,“Fuzzy sets and information granularity,” Advances in Fuzzy Set Theory and Application (edited by M.M. Gupta, R.D. Ragade, and R.R. Yager), North-Holland, 1979.

Index Terms:
Artificial intelligence (AI), heuristics, AI planning software, real-time, reliability analysis, overall hardware/software system reliability.
Ing-Ray Chen, Farokh B. Bastani, Ta-Wei Tsao, "On the Reliability of AI Planning Software in Real-Time Applications," IEEE Transactions on Knowledge and Data Engineering, vol. 7, no. 1, pp. 4-13, Feb. 1995, doi:10.1109/69.368522
Usage of this product signifies your acceptance of the Terms of Use.