Issue No. 09 - September (2009 vol. 31)
Oriol Ramos Terrades , Universitat Automous of Barcelona, Bellaterra
Ernest Valveny , Universitat Automous of Barcelona, Bellaterra
Salvatore Tabbone , LORIA and University of Nancy2, France
The combination of the output of classifiers has been one of the strategies used to improve classification rates in general purpose classification systems. Some of the most common approaches can be explained using the Bayes' formula. In this paper, we tackle the problem of the combination of classifiers using a non-Bayesian probabilistic framework. This approach permits us to derive two linear combination rules that minimize misclassification rates under some constraints on the distribution of classifiers. In order to show the validity of this approach we have compared it with other popular combination rules from a theoretical viewpoint using a synthetic data set, and experimentally using two standard databases: the MNIST handwritten digit database and the GREC symbol database. Results on the synthetic data set show the validity of the theoretical approach. Indeed, results on real data show that the proposed methods outperform other common combination schemes.
Classifier fusion, linear combination rules, random variable.
Oriol Ramos Terrades, Ernest Valveny, Salvatore Tabbone, "Optimal Classifier Fusion in a Non-Bayesian Probabilistic Framework", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 31, no. , pp. 1630-1644, September 2009, doi:10.1109/TPAMI.2008.224