No-Reference Quality Assessment for Stitched Panoramic Images Using Convolutional Sparse Coding and Compound Feature Selection
2018 IEEE International Conference on Multimedia and Expo (ICME) (2018)
San Diego, CA, USA
July 23, 2018 to July 27, 2018
Suiyi Ling , University of Nantes, LS2N, IPI, Polytech Nantes, Rue Christian Pauc, Nantes, 44306, France
Gene Cheung , National Institute of Informatics 2-1-2, Hitotsubashi, Chiyoda-ku, Tokyo, 101-8430, Japan
Patrick Le Callet , University of Nantes, LS2N, IPI, Polytech Nantes, Rue Christian Pauc, Nantes, 44306, France
Image stitching-composition of different viewpoint images to form a 360-degree panoramic image-is an essential component towards immersive applications like VR and AR. A no-reference (NR) quality metric specifically designed to evaluate stitched panoramic images is highly desirable when ground-truth reference images are not available. In this paper, we use Convolutional Sparse Coding (CSC) with a set of convolutional filters to locate stitching-specific distortions in a target image, and design trained kernels to quantify the compound effects of multiple distortion types in a local region. Specifically, our contributions are: i) a training database labeled with location information of the distortion regions is released; ii) a NR metric is proposed to accurately assess stitching-specific artifacts like ghosting using convolutional sparse coding; and iii) a novel sequential feature selection algorithm is proposed to quantify the aforementioned compound distortion effects. In extensive experiments, we show that the performance of our proposed NR metric is comparable to the state-of-the-art full-reference metrics designed for stitched images.
Kernel, Feature extraction, Measurement, Distortion, Convolutional codes, Image coding, Training
S. Ling, G. Cheung and P. Le Callet, "No-Reference Quality Assessment for Stitched Panoramic Images Using Convolutional Sparse Coding and Compound Feature Selection," 2018 IEEE International Conference on Multimedia and Expo (ICME), San Diego, CA, USA, 2018, pp. 1-6.