This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Image Transformation Based on Learning Dictionaries across Image Spaces
Feb. 2013 (vol. 35 no. 2)
pp. 367-380
Kui Jia, Adv. Digital Sci. Center, Univ. of Illinois at Urbana-Champaign, Urbana, IL, USA
Xiaogang Wang, Dept. of Electron. Eng., Chinese Univ. of Hong Kong, Shatin, China
Xiaoou Tang, Dept. of Inf. Eng., Chinese Univ. of Hong Kong, Shatin, China
In this paper, we propose a framework of transforming images from a source image space to a target image space, based on learning coupled dictionaries from a training set of paired images. The framework can be used for applications such as image super-resolution and estimation of image intrinsic components (shading and albedo). It is based on a local parametric regression approach, using sparse feature representations over learned coupled dictionaries across the source and target image spaces. After coupled dictionary learning, sparse coefficient vectors of training image patch pairs are partitioned into easily retrievable local clusters. For any test image patch, we can fast index into its closest local cluster and perform a local parametric regression between the learned sparse feature spaces. The obtained sparse representation (together with the learned target space dictionary) provides multiple constraints for each pixel of the target image to be estimated. The final target image is reconstructed based on these constraints. The contributions of our proposed framework are three-fold. 1) We propose a concept of coupled dictionary learning based on coupled sparse coding which requires the sparse coefficient vectors of a pair of corresponding source and target image patches to have the same support, i.e., the same indices of nonzero elements. 2) We devise a space partitioning scheme to divide the high-dimensional but sparse feature space into local clusters. The partitioning facilitates extremely fast retrieval of closest local clusters for query patches. 3) Benefiting from sparse feature-based image transformation, our method is more robust to corrupted input data, and can be considered as a simultaneous image restoration and transformation process. Experiments on intrinsic image estimation and super-resolution demonstrate the effectiveness and efficiency of our proposed method.
Index Terms:
regression analysis,dictionaries,feature extraction,image representation,image resolution,image restoration,learning (artificial intelligence),pattern clustering,image restoration,source image space,target image space,image superresolution,image intrinsic component estimation,image shading,albedo,local parametric regression approach,sparse feature representation,coupled dictionary learning,sparse coefficient vectors,easily retrievable local clusters,image patch,sparse representation,target image pixel,image reconstruction,sparse coding,space partitioning scheme,high-dimensional sparse feature space,query patch,sparse feature-based image transformation,Dictionaries,Training,Vectors,Encoding,Image coding,Image resolution,Estimation,super-resolution,Image transformation,image mapping,sparse coding,intrinsic images
Citation:
Kui Jia, Xiaogang Wang, Xiaoou Tang, "Image Transformation Based on Learning Dictionaries across Image Spaces," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 2, pp. 367-380, Feb. 2013, doi:10.1109/TPAMI.2012.95
Usage of this product signifies your acceptance of the Terms of Use.