Issue No. 04 - July-Aug. (2014 vol. 16)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/MCSE.2014.52
Lizhe Wang , Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing, China
Ke Lu , University of the Chinese Academy of Sciences, Beijing, China
Peng Liu , Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing, China
Rajiv Ranjan , CSIRO Computational Informatics, Canberra, Australia
Lajiao Chen , Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing, China
A large group of dictionary learning algorithms focus on adaptive sparse representation of data. Almost all of them fix the number of atoms in iterations and use unfeasible schemes to update atoms in the dictionary learning process. It's difficult, therefore, for them to train a dictionary from Big Data. A new dictionary learning algorithm is proposed here by extending the classical K-SVD method. In the proposed method, when each new batch of data samples is added to the training process, a number of new atoms are selectively introduced into the dictionary. Furthermore, only a small group of new atoms as subspace controls the current orthogonal matching pursuit, construction of error matrix, and SVD decomposition process in every training cycle. The information, from both old and new samples, is explored in the proposed incremental K-SVD (IK-SVD) algorithm, but only the current atoms are adaptively updated. This makes the dictionary better represent all the samples without the influence of redundant information from old samples.
Dictionaries, Remote sensing, Information management, Data handling, Data storage systems, Big data, Mathematical model, Learning systems, Spatial analysis
L. Wang, K. Lu, P. Liu, R. Ranjan and L. Chen, "IK-SVD: Dictionary Learning for Spatial Big Data via Incremental Atom Update," in Computing in Science & Engineering, vol. 16, no. 4, pp. 41-52, 2014.