This Article 
 Bibliographic References 
 Add to: 
Rule-Induction and Case-Based Reasoning: Hybrid Architectures Appear Advantageous
January/February 1999 (vol. 11 no. 1)
pp. 166-174

Abstract—Researchers have embraced a variety of machine learning (ML) techniques in their efforts to improve the quality of learning programs. The recent evolution of hybrid architectures for machine learning systems has resulted in several approaches that combine rule-induction methods with case-based reasoning techniques to engender performance improvements over more-traditional one-representation architectures. We briefly survey several major rule-induction and case-based reasoning ML systems. We then examine some interesting hybrid combinations of these systems, and explain their strengths and weaknesses as learning systems. We present a balanced approach to constructing a hybrid architecture, along with arguments in favor of this balance and mechanisms for achieving a proper balance. Finally, we present some initial empirical results from testing our ideas and draw some conclusions based on those results.

[1] A. Aamodt and E. Plaza, "Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches," in AICOM, Vol. 7, No. 1, 1994, pp. 39-59.
[2] K. Althoff, S. Wess, and R. Traphoner, "INRECA—A Seamless Integration of Induction and Case-Based Reasoning for Decision Support Tasks," Proc. Eighth Workshop German SIG on Machine Learning, 1995.
[3] A. An, N. Cercone, C. Chan, N. Shan, and X. Huang, "ELEM: A Method for Inducing Rules from Examples," Proc. 15th Ann. Conf. British Computer Soc. Specialist Group on Expert Systems,Cambridge, U.K., pp. 85-99, 1995.
[4] A. An, "Analysis Methodologies for Integrated and Enhanced Problem Solving," PhD thesis, Dept. of Computer Science, Univ. of Regina, Sask., Canada, 1997.
[5] A. An and N. Cercone, "ELEM2: A Learning System for More Accurate Classifications," Proc. 12th Biennial Conf. Canadian Soc. Computational Studies of Intelligence, AI '98,Vancouver, B.C., Canada, 1998.
[6] E.R. Bareiss and C.C. Wier, "Protos: An Exemplar-Based Learning Apprentice," Proc. Fourth Int'l Workshop Machine Learning,Irvine, Calif., 1987.
[7] M.M. Beaulieu, M. Gatford, X. Huang, S.E. Robertson, S. Walker, and P. Williams, "Okapi at TREC-5," E.M. Voorhees, and D.K. Harman, eds., Proc. Fifth Text REtrieval Conf. (TREC-5): Information Technology, NIST Special Publication No. 500-238, 1997.
[8] W.S. Cooper, "On Selecting a Measure of Retrieval Effectiveness," J. Am. Soc. Information Science, vol. 24, 1973.
[9] P. Clark, "Machine Learning: Techniques and Recent Developments," A.R. Mirzai, ed., Artificial Intelligence: Concepts and Applications in Eng.,London, Chapman and Hall, 1990.
[10] P. Clark and R. Boswell, "Rule Induction with CN2: Some Recent Improvements," Proc. European Working Session Learning,Porto, Portugal, pp. 151-163, 1991.
[11] R.H. Creecy et al., "Trading MIPS and Memory for Knowledge Engineering," Comm. ACM, Vol. 35, No. 8, Aug. 1992, pp. 48-63.
[12] P. Domingos, "Rule Induction and Instance-Based Learning: A Unified Approach," Proc. IJCAI-95,Montreal, Que., Canada, pp. 1,226-1,232, 1995.
[13] U.M. Fayyad and K.B. Irani, "Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning," Proc. IJCAI-93, pp. 1,022-1,027, 1993.
[14] A.R. Golding and P.S. Rosenbloom, "Improving Rule-Based Systems Through Case-Based Reasoning," Proc. AAAI-91, pp. 22-27, 1991.
[15] P. Koton, "Using Experience in Learning and Problem Solving," PhD dissertation, Techncial Report No. MIT/LCS/TR-441, Laboratory of Computer Science, Massachusetts Inst. of Tech nology, 1989.
[16] P. Langley and H.A. Simon, "Applications of Machine Learning and Rule Induction," CACM, 1995, to appear.
[17] D.B. Leake, "CBR in Context: The Present and Future," Case-Based Reasoning: Experiences, Lessons, and Future Directions, D.B. Leake, ed., Menlo Park, Calif., AAAI Press, 1996.
[18] R.S. Michalski, I. Mozetic, J. Hong, and N. Lavrac, "The Multi-Purpose Incremental Learning System AQ15 and Its Testing Application to Three Medical Domains," Proc. AAAI 1986, pp. 1,041-1,045, 1986.
[19] P.M. Murphy and D.W. Aha, "UCI Repository of Machine Learning Databases," 1994; URL: . html; for information, contact
[20] S.K. Murthy, S. Kasif, and S. Salzberg, "A System for Induction of Oblique Decision Trees," J. Artificial Intelligence Research, no. 2, pp. 1-32, 1994.
[21] J.R. Quinlan, C4.5: Programs for Machine Learning, Morgan Kaufmann, San Mateo, Calif., 1993.
[22] S.E. Robertson and K. Spark Jones, "Relevance Weighting of Search Terms," J. Am. Soc. Information Science, vol. 27, pp. 129-146, 1976.
[23] S.E. Robertson, "The Probability Ranking Principle in IR," J. Documentation, vol. 33, no. 4, 1977.
[24] S.E. Robertson, S. Walker, and M. Hancock-Beaulieu, "Large Test Collection, Experiments on an Operational, Interactive System: OKAPI at TREC," Information Processing and Management, vol. 31, no. 3, pp. 345-360, 1995.
[25] D.B. Skalak and E.L. Rissland, "Inductive Learning in a Mixed Paradigm Setting," Proc. AAAI-90, pp. 840-847, 1990.
[26] I. Watson, "Case-Based Reasoning Tools: An Overview," Proc. Second U.K. Workshop Case-Based Reasoning, 1996.
[27] C. Mohan, H. Pirahesh, and R. Lorie, “Efficient and Flexible Methods for Transient Versioning of Records to Avoid Locking by Read-Only Transactions,” Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 124–133, June 1992.

Index Terms:
Case-based reasoning, rule induction, machine learning, classification, numeric prediction.
Nick Cercone, Aijun An, Christine Chan, "Rule-Induction and Case-Based Reasoning: Hybrid Architectures Appear Advantageous," IEEE Transactions on Knowledge and Data Engineering, vol. 11, no. 1, pp. 166-174, Jan.-Feb. 1999, doi:10.1109/69.755625
Usage of this product signifies your acceptance of the Terms of Use.