This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Classifier Ensembles with a Random Linear Oracle
April 2007 (vol. 19 no. 4)
pp. 500-508
Juan J. Rodr?guez, IEEE Computer Society
We propose a combined fusion-selection approach to classifier ensemble design. Each classifier in the ensemble is replaced by a miniensemble of a pair of subclassifiers with a random linear oracle to choose between the two. It is argued that this approach encourages extra diversity in the ensemble while allowing for high accuracy of the individual ensemble members. Experiments were carried out with 35 data sets from UCI and 11 ensemble models. Each ensemble model was examined with and without the oracle. The results showed that all ensemble methods benefited from the new approach, most markedly so random subspace and bagging. A further experiment with seven real medical data sets demonstrates the validity of these findings outside the UCI data collection.
Index Terms:
Classifier ensembles, fusion and selection, random hyperplane, multivariate (oblique) decision trees.
Citation:
Ludmila I. Kuncheva, Juan J. Rodr?guez, "Classifier Ensembles with a Random Linear Oracle," IEEE Transactions on Knowledge and Data Engineering, vol. 19, no. 4, pp. 500-508, April 2007, doi:10.1109/TKDE.2007.1016
Usage of this product signifies your acceptance of the Terms of Use.