Publication 2013 Issue No. 5 - May Abstract - Trace Ratio Optimization-Based Semi-Supervised Nonlinear Dimensionality Reduction for Marginal Manifold Visualization
 This Article Share Bibliographic References Add to: Digg Furl Spurl Blink Simpy Google Del.icio.us Y!MyWeb Search Similar Articles Articles by Zhao Zhang Articles by Tommy W.S. Chow Articles by Mingbo Zhao
Trace Ratio Optimization-Based Semi-Supervised Nonlinear Dimensionality Reduction for Marginal Manifold Visualization
May 2013 (vol. 25 no. 5)
pp. 1148-1161
 ASCII Text x Zhao Zhang, Tommy W.S. Chow, Mingbo Zhao, "Trace Ratio Optimization-Based Semi-Supervised Nonlinear Dimensionality Reduction for Marginal Manifold Visualization," IEEE Transactions on Knowledge and Data Engineering, vol. 25, no. 5, pp. 1148-1161, May, 2013.
 BibTex x @article{ 10.1109/TKDE.2012.47,author = {Zhao Zhang and Tommy W.S. Chow and Mingbo Zhao},title = {Trace Ratio Optimization-Based Semi-Supervised Nonlinear Dimensionality Reduction for Marginal Manifold Visualization},journal ={IEEE Transactions on Knowledge and Data Engineering},volume = {25},number = {5},issn = {1041-4347},year = {2013},pages = {1148-1161},doi = {http://doi.ieeecomputersociety.org/10.1109/TKDE.2012.47},publisher = {IEEE Computer Society},address = {Los Alamitos, CA, USA},}
 RefWorks Procite/RefMan/Endnote x TY - JOURJO - IEEE Transactions on Knowledge and Data EngineeringTI - Trace Ratio Optimization-Based Semi-Supervised Nonlinear Dimensionality Reduction for Marginal Manifold VisualizationIS - 5SN - 1041-4347SP1148EP1161EPD - 1148-1161A1 - Zhao Zhang, A1 - Tommy W.S. Chow, A1 - Mingbo Zhao, PY - 2013KW - ManifoldsKW - Data visualizationKW - KernelKW - OptimizationKW - Laplace equationsKW - Symmetric matricesKW - VectorsKW - marginal manifold visualizationKW - Semi-supervised manifold learningKW - trace ratio optimizationKW - nonlinear dimensionality reductionKW - multimodality preservationKW - pairwise constraintsVL - 25JA - IEEE Transactions on Knowledge and Data EngineeringER -
Zhao Zhang, City University of Hong Kong, Hong Kong
Tommy W.S. Chow, City University of Hong Kong, Hong Kong
Mingbo Zhao, City University of Hong Kong, Hong Kong
Visualizing similarity data of different objects by exhibiting more separate organizations with local and multimodal characteristics preserved is important in multivariate data analysis. Laplacian Eigenmaps (LAE) and Locally Linear Embedding (LLE) aim at preserving the embeddings of all similarity pairs in the close vicinity of the reduced output space, but they are unable to identify and separate interclass neighbors. This paper considers the semi-supervised manifold learning problems. We apply the pairwise Cannot-Link and Must-Link constraints induced by the neighborhood graph to specify the types of neighboring pairs. More flexible regulation on supervised information is provided. Two novel multimodal nonlinear techniques, which we call trace ratio (TR) criterion-based semi-supervised LAE ($({\rm S}^2{\rm LAE})$) and LLE ($({\rm S}^2{\rm LLE})$), are then proposed for marginal manifold visualization. We also present the kernelized $({\rm S}^2{\rm LAE})$ and $({\rm S}^2{\rm LLE})$. We verify the feasibility of $({\rm S}^2{\rm LAE})$ and $({\rm S}^2{\rm LLE})$ through extensive simulations over benchmark real-world MIT CBCL, CMU PIE, MNIST, and USPS data sets. Manifold visualizations show that $({\rm S}^2{\rm LAE})$ and $({\rm S}^2{\rm LLE})$ are able to deliver large margins between different clusters or classes with multimodal distributions preserved. Clustering evaluations show they can achieve comparable to or even better results than some widely used methods.
Index Terms:
Manifolds,Data visualization,Kernel,Optimization,Laplace equations,Symmetric matrices,Vectors,marginal manifold visualization,Semi-supervised manifold learning,trace ratio optimization,nonlinear dimensionality reduction,multimodality preservation,pairwise constraints
Citation:
Zhao Zhang, Tommy W.S. Chow, Mingbo Zhao, "Trace Ratio Optimization-Based Semi-Supervised Nonlinear Dimensionality Reduction for Marginal Manifold Visualization," IEEE Transactions on Knowledge and Data Engineering, vol. 25, no. 5, pp. 1148-1161, May 2013, doi:10.1109/TKDE.2012.47