This Article 
 Bibliographic References 
 Add to: 
An Evaluation of Expert Systems for Software Engineering Management
June 1989 (vol. 15 no. 6)
pp. 747-759

The development of four separate, prototype expert systems to aid in software engineering management is described. Given the values for certain metrics, these systems provide interpretations which explain any abnormal patterns of these values during the development of a software project. The four expert systems which solve the same problem, were built using two different approaches to knowledge acquisition, a bottom-up approach and a top-down approach and two different expert system methods, rule-based deduction and frame-based abduction. In a comparison to see which methods might better suit the needs of this field, it was found that the bottom-up approach led to better results that did the top-down approach, and the rule-based deduction systems using simple rules provided more complete and correct solutions than did the frame-based abduction systems.

[1] "Annotated bibliography of Software Engineering Laboratory (SEL) literature, SEL-82-006," Software Eng. Lab., NASA Goddard Space Flight Center, Greenbelt, MD, Nov. 1982.
[2] V. R. Basili and B. T. Perricone, "Software errors and complexity: An empirical investigation,"Commun. ACM, vol. 27, no. 1, p. 42-52, Jan. 1984.
[3] V. R. Basili and C. L. Ramsey, "ARROWSMITH-P--A prototype expert system for software engineering management," inProc. Expert Systems in Government Symposium, IEEE, McLean, VA, Oct. 1985, pp. 252-264.
[4] V.R. Basili and H.D. Rombach, "The Tame Project: Towards Improvement-Oriented Software Environments,"IEEE Trans. Software Eng., Vol. SE-14, No. 6, June 1988, pp. 758-773.
[5] V. R. Basili and D. M. Weiss, "A methodology for collecting valid software engineering data,"IEEE Trans. Software Eng., vol. SE-10, no. 6, pp. 728-738, Nov. 1984.
[6] V. R. Basili and M. V. Zelkowitz, "Analyzing medium scale software developments," inProc. Third Int. Conf. Software Engineering, Atlanta, GA, May 1978, pp. 116-123.
[7] V. R. Basili, M. V. Zelkowitz, F. E. McGarry, R. W. Reiter, Jr., W. F. Truszkowksi, and D. M. Weiss, "The Software Engineering Laboratory, SEL-77-001," Software Eng. Lab., NASA Goddard Space Flight Center, Greenbelt, MD, May 1977.
[8] A. N. Campbell. V. F. Hollister, R. O. Duda, and P. E. Hart, "Recognition of a hidden mineral deposit by an artificial program,"Science, vol. 217, pp. 927-928, Sept. 1982.
[9] D. N. Card, F. E. McGarry, J. Page, S. Eslinger, and V. R. Basili, "The Software Engineering Laboratory, SEL-81-104," Software Eng. Lab., NASA Goddard Space Flight Center, Greenbelt, MD, Feb. 1982.
[10] J. Cohen, "Weighted Kappa: Nominal scale agreement with provision for scaled disagreement or partial credit,"Psychol. Bull., vol. 70, pp. 213-220, 1968.
[11] J. deKleer and B. Williams, "Reasoning about multiple faults," inProc. Fifth Nat. Conf. Artificial Intelligence, Philadelphia, PA, Aug. 11-15, 1986, pp. 132-139.
[12] C. Doerflinger and V. R. Basili, "Monitoring software development through dynamic variables,"IEEE Trans. Software Eng., vol. 11, no. 9, pp. 978-985, Sept. 1985.
[13] F. Hayes-Roth, D. Waterman, and D. Lenat, "Principles of Pattern-directed inference systems," inPattern-Directed Inference Systems, Waterman and Hayes-Roth, Eds. New York: Academic, 1978, pp. 577-601.
[14] R. Miller, H. Pople, and J. Myers, "Internist-1: An experimental computer-based diagnostic consultant for general internal medicine,"New England J. Med., vol. 307, pp. 468-476, 1982.
[15] M. Minsky, "A framework for representing knowledge," inThe Psychology of Computer Vision, P. Winston, Ed. New York: McGraw-Hill, 1975, pp. 211-277.
[16] D. S. Nau and J. A. Reggia, "Relationships between deductive and abductive inference in knowledge-based diagnostic expert systems," inProc. First Int. Workshop Expert Database Systems, 1984, pp. 500- 509.
[17] S. G. Pauker, G. A. Gorry, J. P. Kassirer, and W. B. Schwartz, "Towards the simulation of clinical cognition,"Amer. J. Med., vol. 60, no. 7, pp. 981-996, June 1976.
[18] Y. Peng and J. A. Reggia, "A probabilistic causal model for diagnostic problem-solving,"IEEE Trans. Syst., Man, Cybern., vol. 17, pp. 146-162, 395-406, 1987.
[19] Y. Peng and J. A. Reggia, "Plausibility of diagnostic hypotheses: The nature of simplicity," inProc. Fifth Nat. Conf. Artificial Intelligence. Philadelphia, PA, Aug. 11-15, 1986, pp. 140-145.
[20] C. L. Ramsey and V. R. Basili, "An evaluation of expert systems for software engineering management," Dep. Comput. Sci., Univ. Maryland, College Park, Tech. Rep. TR-1708, Sept. 1986.
[21] C. L. Ramsey, J. A. Reggia, D. S. Nau, and A. Ferrentino, "A comparative analysis of methods for expert systems,"Int. J. Man-Machine Studies, vol. 24, no. 5, pp. 475-499, May 1986.
[22] J. Reggia, "Computer-assisted-medical decision making," inApplication of Computers in Medicine, M. Schwartz, Ed. New York: IEEE Press, 1982, pp. 198-213.
[23] J. A. Reggia, D. S. Nau, and P. Wang, "Diagnostic expert systems based on a set covering model,"Int. J. Man-Machine Studies, vol. 19, no. 5, pp. 437-460, Nov. 1983.
[24] J. A. Reggia, D. S. Nau, P. Y. Wang, and Y. Peng, "A formal model of diagnosis inference, I. Problem formulation and decomposition,"Inform. Sci., vol. 37, pp. 227-256, 1985.
[25] J. A. Reggia and B. Perricone, "KMS reference manual," Dep. Comput. Sci., Univ. Maryland, College Park, Tech. Rep. TR-1136, 1982.
[26] E. Shortliffe,Computer-Based Medical Consultations: MYCIN. New York: Elsevier, 1976.
[27] H. Shubin and J. Ulrich, "IDT: An intelligent diagnostic tool," inProc. Nat. Conf. Artificial Intelligence, AAAI, 1982, pp. 290-295.
[28] R. Spitzer, J. Cohen, J. Fleiss, and J. Endicott, "Quantification of agreement in psychiatric diagnosis,"Archives General Psychiatry, vol. 17, pp. 83-87, 1967.
[29] J. D. Valett, W. Decker, and J. Buell, "Software management environment," inProc. SEL Workshop 1988, NASA Goddard Space Flight Center, Greenbelt, MD, Dec. 1988.
[30] D. M. Weiss and V. R. Basili, "Evaluating software development by analysis of changes: Some data from the software engineering laboratory,"IEEE Trans. Software Eng., vol. SE-11, no. 2, pp. 157- 168, Feb. 1985.

Index Terms:
expert systems evaluation; prototype expert systems; software engineering management; abnormal patterns; software project; knowledge acquisition; bottom-up approach; top-down approach; expert system methods; rule-based deduction; frame-based abduction; simple rules; expert systems; knowledge acquisition; performance evaluation; software engineering
C.L. Ramsey, V.R. Basili, "An Evaluation of Expert Systems for Software Engineering Management," IEEE Transactions on Software Engineering, vol. 15, no. 6, pp. 747-759, June 1989, doi:10.1109/32.24728
Usage of this product signifies your acceptance of the Terms of Use.