This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Random Projection Random Discretization Ensembles—Ensembles of Linear Multivariate Decision Trees
May 2014 (vol. 26 no. 5)
pp. 1-1
Amir Ahmad, Faculty of Computing and Information Technology, King Abdulaziz University, Rabigh, Saudi Arabia
Gavin Brown, School of Computer Science, University of Manchester, Manchester, U.K.
In this paper, we present a novel ensemble method random projection random discretization ensembles(RPRDE) to create ensembles of linear multivariate decision trees by using a univariate decision tree algorithm. The present method combines the better computational complexity of a univariate decision tree algorithm with the better representational power of linear multivariate decision trees. We develop random discretization (RD) method that creates random discretized features from continuous features. Random projection (RP) is used to create new features that are linear combinations of original features. A new dataset is created by augmenting discretized features (created by using RD) with features created by using RP. Each decision tree of a RPRD ensemble is trained on one dataset from the pool of these datasets by using a univariate decision tree algorithm. As these multivariate decision trees (because of features created by RP) have more representational power than univariate decision trees, we expect accurate decision trees in the ensemble. Diverse training datasets ensure diverse decision trees in the ensemble. We study the performance of RPRDE against other popular ensemble techniques using C4.5 tree as the base classifier. RPRDE matches or outperforms other popular ensemble methods. Experiments results also suggest that the proposed method is quite robust to the class noise.
Index Terms:
Decision trees,Vegetation,Training,Bagging,Principal component analysis,Educational institutions,Noise,Data mining,Clustering,classification,and association rules
Citation:
Amir Ahmad, Gavin Brown, "Random Projection Random Discretization Ensembles—Ensembles of Linear Multivariate Decision Trees," IEEE Transactions on Knowledge and Data Engineering, vol. 26, no. 5, pp. 1-1, May 2014, doi:10.1109/TKDE.2013.134
Usage of this product signifies your acceptance of the Terms of Use.