This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Retargeting Images and Video for Preserving Information Saliency
September/October 2007 (vol. 27 no. 5)
pp. 80-88
Vidya Setlur, Nokia Research Center, Palo Alto
Tom Lechner, Northwestern University
Marc Nienhaus, University of Potsdam
Bruce Gooch, University of Victoria
A nonphotorealistic algorithm for retargeting images adapts large images so that important objects in the image are still recognizable when displayed at a lower target resolution. Unlike existing image manipulation techniques such as cropping and scaling, the retargeting algorithm can handle multiple important objects in an image. The authors' approach constructs a topologically constrained epitome of an image based on a visual attention model that is both comprehensible and size varying, making the method suitable for display-critical applications. They extend this algorithm to other types of imagery such as medical data.

1. V. Setlur et al., "Automatic Image Retargeting," Proc. 4th Int'l Conf. Mobile and Ubiquitous Multimedia (MUM), ACM Press, 2005, pp. 59–68.
2. P. Meer and B. Georgescu, "Edge Detection with Embedded Confidence," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 12, 2001, pp. 1351–1365.
3. M. Swain and D. Ballard, "Color Indexing," Int'l J. Computer Vision, vol. 7, no. 1, 1991, pp. 11–32.
4. L. Itti, C. Koch, and E. Niebur, "A Model of Saliency-Based Visual Attention for Rapid Scene Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, 1998, pp. 1254–1259.
5. W. Niblack et al., "The Qbic Project: Querying Images by Content, Using Color, Texture, and Shape," Proc. SPIE, SPIE, vol. 1908, 1993, pp. 173–187.
6. P. Harrison, "A Non-hierarchical Procedure for Re-synthesis of Complex Textures," Proc. 9th Int'l Conf. Computer Graphics, Visualization, and Computer Vision (WSCG), 2001, pp. 190–197.
7. A. Agarwala et al., "Interactive Digital Photomontage," ACM Siggraph, ACM Press, 2004, pp. 294–302.
8. V. Kwatra et al., "Graphcut Textures: Image and Video Synthesis Using Graph Cuts," ACM Trans. Graphics, vol. 22, no. 3, 2003, pp. 277–286.
9. F. Liu and M. Gleicher, "Automatic Image Retargeting with Fisheyeview Warping," Proc. 18th Ann. ACM Symp. User Interface Software and Technology (UIST), ACM Press, 2005, pp. 153–162.
10. B. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," Proc. 7th Int'l Joint Conf. Artificial Intelligence, 1981, pp. 674–679.
11. H. Winnemoller, S.C. Olsen, and B. Gooch, "Real-time Video Abstraction," ACM Siggraph, ACM Press, 2006, pp. 1221–1226.
1. B. Suh et al., "Automatic Thumbnail Cropping and Its Effectiveness," Proc. ACM Symp. User Interface Software and Technology, ACM Press, 2003, pp. 11–99.
2. L. Itti, C. Koch, and E. Niebur, "A Model of Saliency-Based Visual Attention for Rapid Scene Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, 1998, pp. 1254–1259.
3. H.A. Rowley, S. Baluja, and T. Kanade, "Human Face Detection in Visual Scenes, Advances in Neural Information Processing Systems, vol. 8, D.S. Touretzky, M.C. Mozer, and M.E. Hasselmo, eds., MIT Press, 1996, pp. 875–881.
4. C. Bregler and J. Malik, "Tracking People with Twists and Exponential Maps," Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, IEEE CS Press, 1998, pp. 8–15.
5. H. Schneiderman and T. Kanade, "A Statistical Model for 3D Object Detection Applied to Faces and Cars," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), vol. 1, IEEE Press, 2000, pp. 746–751.
6. L.-Q. Chen et al., "A Visual Attention Model for Adapting Images on Small Displays," ACM Multimedia Systems J., vol. 9, no. 4, 2003, pp. 353–364.
7. H. Liu et al., "Automatic Browsing of Large Pictures on Mobile Devices," Proc. 11th ACM Int'l Conf. Multimedia, ACM Press, 2003, pp. 148–155.
8. N. Jojic, B. Frey, and A. Kannan, "Epitomic Analysis of Appearance and Shape," Proc. 9th IEEE Int'l Conf. Computer Vision, IEEE CS Press, 2003, pp. 34–41.
9. F. Liu and M. Gleicher, "Video Retargeting: Automating Pan and Scan," Proc. 14th Ann. ACM Int'l Conf. Multimedia, ACM Press, 2006, pp. 241–250.
10. A. Santella et al., "Gaze-based Interaction for Semi-automatic Photo Cropping," Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI), ACM Press, 2006, pp. 771–780.
11. C. Rother et al., "Digital Tapestry," Proc. 2005 IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition (CVPR), vol. 1, IEEE CS Press, 2005, pp. 589–596.
12. M.S.T. Carpendale and C. Montagnese, "A Framework for Unifying Presentation Space," Proc. 14th Ann. ACM Symp. User Interface Software and Technology, ACM Press, 2001, pp. 82–92.

Index Terms:
small displays, image and video adaptation, saliency, visual perception, non-photorealistic rendering, functional realism
Citation:
Vidya Setlur, Tom Lechner, Marc Nienhaus, Bruce Gooch, "Retargeting Images and Video for Preserving Information Saliency," IEEE Computer Graphics and Applications, vol. 27, no. 5, pp. 80-88, Sept.-Oct. 2007, doi:10.1109/MCG.2007.133
Usage of this product signifies your acceptance of the Terms of Use.