Sparse Manifold Learning and Its Applications in Image Classification
Authors: 
Wangmu Li, Jun YuAuthors Info & Claims
Wangmu Li, Jun YuAuthors Info & ClaimsPages 32 - 37
Abstract
Graph-based dimensionality reduction algorithms are important and have been commonly applied in image classification and computer vision applications. To date many approaches have been proposed, e.g. Laplacian Eigenmaps (LE), Locally Linear Embedding (LLE), Locality Preserving Projections (LPP) and ISOMAP and so on. However, all these methods need to set the k nearest neighbor parameter to address the problem. In this paper, we proposed Sparse Patch Alignment Framework to settle it. Patch Alignment Framework which unified manifold learning algorithms through two stages: local patch optimization and whole alignment. We use Sparse Coding to construct the local patch instead of using KNN, thus, the k nearest neighbor parameter is set adaptively. A lot of experiments are done to show the performance of our method. The experiment results illustrate that our method is stable and robust.
References
[1]
Belhumeur, P., Hespanda, J., and Kiregeman, D. 1997. Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection. IEEE Trans. Patten Anal. Mach. Intell. 19, 711--720.
[2]
Yan, S., Xu, D., Zhang, B., Yang, Q., Zhang, H., and Lin, S. 2007. Graph embedding and extensions: A general framework for dimensionality reduction. IEEE Trans. Pattern Analysis and Machine Intelligence. 29 (1), 40--51.
[3]
Roweis, S. and Saul, L. 2000. Nonlinear dimensionlity redutction by locally linear embedding. Science. 290(5500), 2323--2326
[4]
Belkin, M. and Niyogi, P. 2002. Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering. Advances in Neural Information Processing Systems. 14, 585--591.
[5]
Cai, D., He, X., and Han, J. 2007. Semi-supervised discriminant analysis. Int. Conf. Comput. Vision.
[6]
Wang, M., Li, H., Tao, D. C., Lu, K., and Wu, X. 2012. Multimodal Graph-Based Reranking for Web Image Search. IEEE Transactions on Image Processing. 21(11), 4649--4661.
[7]
Cai, D., He, X., and Han, J. 2005. Document Clustering Using Locality Preserving Indexing. IEEE Trans. Knowledge and Data Engineering. 17(12), 1624--1637.
[8]
Koren, Y. and Carmel, L. 2004. Robust Linear Dimensionality Reduction. IEEE Trans. Visualization and Computer Graphics. 10(4), 459--470.
[9]
Schellewald, C. and Schnorr, C. 2005. Probablistic Subgraph Matching Approach Based on Convex Relaxation. EMMCVPR.
[10]
Zhou, D., Bousquet, O., Lal, T., Weston, J., and Schoelkopr, B. 2004. Learning with local and global consistency. NIPS.
[11]
Zhu, X., Ghahramani, Z., and Lafferty, J. 2003. Semi-supervised learning using Gaussian fields and harmonic functions. ICML.
[12]
Roweis, S. and Saul, L. 2000. Nonlinear Dimensionality Reduction by Locally Linear Embedding. Science. 290, 2323--2326.
[13]
Belkin, M. and Niyogi, P. 2003. Laplacian eigenmaps for dimensionality reduction and data representation. Nerual Computation. 15(6), 1373--1396.
[14]
Zhang, Z. and Zha, H. 2005. Principal Manifolds and Nonlinear Dimension Reduction via Local Tangent Space Alignment. SLAM J. Scientific Computing. 26(1), 313--338.
[15]
He, X. and Niyogi, P. 2004. Locality Preserving Projections. Advacnes in Neural Information Processing System. 16.
[16]
Zhang, T., Tao, D. C., Li, X., and Yang, J. 2009. Patch Alignment for Dimensionlity Reduction. TKDE. 21(9), 1299--1313.
[17]
Belkin, M., Niyogi, P., Sindhwani, V. 2005. On manifold regularization. AI Statistics. 17--24.
[18]
Wu, M., Schölkopf, B. 2007. Transductive classification via local learning regularization. AI Statistics. 628--635.
[19]
Tenenbaum, J., Silva, V., and Langford, J. 2000. A Global Geometric Framework for Nonlinear Dimensionlity Reduction. Science. 290, 2319--2323.
[20]
Tibshirani, R. 1996. Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society Series B-Methodologial. 58(1), 267--288.
[21]
Efron, B., Hastie, T., and Johnstone, I. 2004. Least angle regression. Annals of Statistics. 32(2), 494--499.
[22]
Samaria, F. and Harter, A. 1994. Parameterisation of a stochastic model for human face identification. Proc. Workshop Appl. Conput. Vis. 138--142.
[23]
Graham, D. and Allinson, N. 1998. Characterizing Virtual Eigensignatures for General purpose Face Recognition. Face Recognition: From Theory to Applications, NANO ASI Series F, Computer and Systems Science. 163, 446--456.
[24]
Belhumeour, P., Hespanha, J., and Kriegman, D. 1997. Eigenface vs. Fisherface: Recognition Using Class Specific Linear Projection. IEEE Trans. Pattern Analysis and Machine Intelligence. 19(7), 711--720.
[25]
Gao, S., Tsang, I., and Chia, L. 2013. Laplacian Sparse Coding, Hypergraph Laplacian Sparse Coding and Applications. IEEE Trans. Pattern Analysis and Machine Intelligence. 35(1), 92--104.
[26]
Yu, J., Liu, D., Tao, D. C., and Seah, H. 2011. Complex Object Correspondence Construction in Two-Dimensional Animation. IEEE Transactions on Image Processing. 20(11), 3527--3269.
[27]
Li, P., Wnag, M., Cheng, J., Xu, C., and Lu, H. 2013. Spectral Hashing with Semantically Consistent Graph for Image Indexing. IEEE Transations on Multimedia. 15(1), 141--152.
[28]
Wang, M., Ni, B., Hua, X., and Chua, T., 2012. Assistive Tagging: A Survey of Multimedia Tagging with Human-Computer Joint Exploration. ACM Computing Surveys. 4(4), Article 25.
[29]
Wang, M. and Hua, X. 2011. Active Learning in Multimedia Annotation and Retrieval: A Survey. ACM Transactions on Intelligent Systems and Technology. 2(2), 10--13.
[30]
Yu, J., Rui, Y., Tao, D. C. 2014. Click Prediction for Web Image Reranking using Multimodal Sparse Coding. IEEE Transactions on Image Processing. 23(5), 2019--2032.
[31]
Yu, J., Rui, Y., Tang, Y., Tao, D. C. 2014. High-order Distance based Multiview Stochastic Learing in Image Classification. IEEE Transactions on Cybernetics. DOI=http://dx.doi.org/10.1109/TCYB.2014.2307862.
[32]
Yu, J., Tao, D. C., Li, J., Cheng, J. 2014. Semantic preserving distance metric learning and applications. Information Science. DOI=http://dx.doi.org/10.1016/j.ins.2014.01.025.
Index Terms
- Sparse Manifold Learning and Its Applications in Image Classification
Recommendations
Discriminative information preservation for face recognition
It is usually difficult to find the optimal low dimensional subspace for face recognition. Patch alignment framework (PAF) is an important systematic framework that can be applied to understand the common thought and essential differences of a numerous ...
Learning dictionary on manifolds for image classification
At present, dictionary based models have been widely used in image classification. The image features are approximated as a linear combination of bases selected from the dictionary in a sparse space, resulting in compact patterns. The features applied ...
Image classification with manifold learning for out-of-sample data
The successful applications of manifold learning in computer vision and multimedia research show that the geodesic distance along the manifold is more meaningful than Euclidean distance in the linear space. Therefore, in order to get better performance ...
Comments
Information & Contributors
Information
Published In
July 2014
430 pages
ISBN:9781450328104
DOI:10.1145/2632856
- General Chairs:
- Hanzi Wang,
- Larry Davis,
- Program Chairs:
- Wenwu Zhu,
- Stephan Kopf,
- Yanyun Qu,
- Publications Chairs:
- Jun Yu,
- Jitao Sang,
- Tao Mei
Copyright © 2014 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
In-Cooperation
- NSF of China: National Natural Science Foundation of China
- Beijing ACM SIGMM Chapter
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 10 July 2014
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICIMCS '14
ICIMCS '14: International Conference on Internet Multimedia Computing and Service
July 10 - 12, 2014
Xiamen, China
Acceptance Rates
Overall Acceptance Rate 163 of 456 submissions, 36%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 119Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 21 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in