Issue No. 05 - May (1996 vol. 18)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/34.494648
<p><b>Abstract</b>—It is widely believed in the pattern recognition field that when a fixed number of training samples is used to design a classifier, the generalization error of the classifier tends to increase as the number of features gets large. In this paper, we will discuss the generalization error of the artificial neural network (ANN) classifiers in high-dimensional spaces, under a practical condition that the ratio of the training sample size to the dimensionality is small. Experimental results show that the generalization error of ANN classifiers seems much less sensitive to the feature size than 1-NN, Parzen and quadratic classifiers.</p>
Artificial neural networks, generalization error, dimensionality, training sample size, peaking phenomenon, 1-NN classifier, Parzen classifier.
Yoshihiko Hamamoto, Shunji Uchimura, Shingo Tomita, "On the Behavior of Artificial Neural Network Classifiers in High-Dimensional Spaces", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 18, no. , pp. 571-574, May 1996, doi:10.1109/34.494648