Issue No.10 - October (2009 vol.21)
Bo Chen , Xidian University , Xi'an
Hongwei Liu , Xidian University, Xian
Jing Chai , Xidian University, Xi'an
Zheng Bao , Xidian University, Xi'an
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TKDE.2008.238
The problem of feature selection is a difficult combinatorial task in machine learning and of high practical relevance. In this paper, we consider feature selection method for multimodally distributed data, and present a large margin feature weighting method for k-nearest neighbor (kNN) classifiers. The method learns the feature weighting factors by minimizing a cost function, which aims at separating different classes by large local margins and pulling closer together points from the same class, based on using as few features as possible. The consequent optimization problem can be efficiently solved by Linear Programming. Finally, the proposed approach is assessed through a series of experiments with UCI and microarray data sets, as well as a more specific and challenging task, namely, radar high-resolution range profiles (HRRP) automatic target recognition (ATR). The experimental results demonstrate the effectiveness of the proposed algorithms.
Feature selection, feature weighting, large margin, linear programming.
Bo Chen, Hongwei Liu, Jing Chai, Zheng Bao, "Large Margin Feature Weighting Method via Linear Programming", IEEE Transactions on Knowledge & Data Engineering, vol.21, no. 10, pp. 1475-1488, October 2009, doi:10.1109/TKDE.2008.238