This Article 
 Bibliographic References 
 Add to: 
Effective Data Mining Using Neural Networks
December 1996 (vol. 8 no. 6)
pp. 957-961

Abstract—Classification is one of the data mining problems receiving great attention recently in the database community. This paper presents an approach to discover symbolic classification rules using neural networks. Neural networks have not been thought suited for data mining because how the classifications were made is not explicitly stated as symbolic rules that are suitable for verification or interpretation by humans. With the proposed approach, concise symbolic rules with high accuracy can be extracted from a neural network. The network is first trained to achieve the required accuracy rate. Redundant connections of the network are then removed by a network pruning algorithm. The activation values of the hidden units in the network are analyzed, and classification rules are generated using the result of this analysis. The effectiveness of the proposed approach is clearly demonstrated by the experimental results on a set of standard data mining test problems.

[1] R. Agrawal, T. Imielinski, and A. Swami, Database Mining: A Performance Perspective IEEE Trans. Knowledge and Data Eng., vol. 5, no. 6, Dec. 1993.
[2] J.E. Dennis Jr. and R.B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations.Englewood Cliffs, N.J.: Prentice Hall, 1983.
[3] H. Liu and S.T. Tan, "X2R: A Fast Rule Generator," Proc. IEEE Int'l Conf. Systems, Man, and Cybernetics. IEEE, 1995.
[4] H. Lu, R. Setiono, and H. Liu, "Neurorule: A Connectionist Approach to Data Mining," Proc, VLDB '95, pp. 478-489, 1995.
[5] D. Michie, D.J. Spiegelhalter, and C.C. Taylor, Machine Learning, Neural and Statistical Classification. Ellis Horwood Series in Artificial Intelligence, 1994.
[6] J.R. Quinlan, C4.5: Programs for Machine Learning,San Mateo, Calif.: Morgan Kaufman, 1992.
[7] J.R. Quinlan, "Comparing Connectionist and Symbolic Learning Methods," in Computational Learning Theory and Natural Learning Systems, S.J. Hanson, G.A. Drastall, and R.L. Rivest, eds., MIT Press, Cambridge, Mass., 1994, pp. 445-456.
[8] J.W. Shavlik, R.J. Mooney, and G. G. Towell, “Symbolic and Neural Learning Algorithms: An Experimental Comparison,” Machine Learning, vol. 6, pp.111–143, 1991.
[9] R. Setiono, "A Neural Network Construction Algorithm which Maximizes the Likelihood Function," Connection Science, vol. 7, no. 2, pp. 147-166, 1995.
[10] R. Setiono, "A Penalty Function Approach for Pruning Feedforward Neural Networks," Neural Computation, vol. 9, no. 1, pp. 301-320, 1997.

Index Terms:
Data mining, neural networks, rule extraction, network pruning, classification.
Hongjun Lu, Rudy Setiono, Huan Liu, "Effective Data Mining Using Neural Networks," IEEE Transactions on Knowledge and Data Engineering, vol. 8, no. 6, pp. 957-961, Dec. 1996, doi:10.1109/69.553163
Usage of this product signifies your acceptance of the Terms of Use.