First IEEE International Conference on Data Mining (ICDM'01)
Functional Trees for Classification
San Jose, California
November 29-December 02
ISBN: 0-7695-1119-8
The design of algorithms that explore multiple representation languages and explore different search space has an intuitive appeal. In this context of classification problems, algorithms that generate multivariate trees are able to explore multiple representation languages by using decision test based on a combination of attributes. The same applies to models threes algorithms, in regression domains, but using linear models at leaf nodes. In this paper we study where to use combinations of attributes in decision tree learning. We present an algorithm for multivariate tree learning that combines a univariate decision tree with a discriminant function by means of constructive induction. This algorithm is able to use decision nodes with multivariate tests, and leaf nodes that predict a class using a discrimnant. Multivariate decision nodes are built when growing the tree, while functional leaves are built when pruning the tree. Functional trees can be seen as a generalization of multivariate trees. Our algorithm was compared against to its components and two simplified versions using 30 benchmark datasets. The experimental evaluation shows that our algorithm has clear Advantages with respect to the generalization ability and model sizes at statistically significant.
Citation:
João Gama, "Functional Trees for Classification," icdm, pp.147, First IEEE International Conference on Data Mining (ICDM'01), 2001
Usage of this product signifies your acceptance of the
Terms of Use.
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||