This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Mosaicing on Adaptive Manifolds
October 2000 (vol. 22 no. 10)
pp. 1144-1154

Abstract—Image mosaicing is commonly used to increase the visual field of view by pasting together many images or video frames. Existing mosaicing methods are based on projecting all images onto a predetermined single manifold: A plane is commonly used for a camera translating sideways, a cylinder is used for a panning camera, and a sphere is used for a camera which is both panning and tilting. While different mosaicing methods should therefore be used for different types of camera motion, more general types of camera motion, such as forward motion, are practically impossible for traditional mosaicing. A new methodology to allow image mosaicing in more general cases of camera motion is presented. Mosaicing is performed by projecting thin strips from the images onto manifolds which are adapted to the camera motion. While the limitations of existing mosaicing techniques are a result of using predetermined manifolds, the use of more general manifolds overcomes these limitations.

[1] F. Aurenhammer, "Voronoi Diagrams: A Survey of a Fundamental Geometric Data Structure," ACM Computing Surveys, vol. 23, no. 3, 1991, pp. 345-405.
[2] J.R. Bergen, P. Anandan, K.J. Hanna, and R. Hingorani, “Hiercharchical Model-Based Motion Estimation,” Proc. European Conf. Computer Vision, pp. 237-252, 1992.
[3] P.J. Burt and E.H. Adelson, “A Multiresolution Spline with Application to Image Mosaics,” ACM Trans. Graphics, vol. 2, no. 4, pp. 217-236, Oct. 1983.
[4] P.J. Burt and P. Anandan, “Image Stabilization by Registration to a Reference Mosaic,” Proc. DARPA Image Understanding Workshop '94, pp. 424-434, Nov. 1994.
[5] S.E. Chen, "QuickTime VR—An Image-Based Approach to Virtual Environment Navigation," Siggraph 95 Conf. Proc., ACM Press, New York, 1995, pp. 29-38.
[6] S.E. Chen and L. Williams, “View Interpolation for Image Synthesis,” Proc. ACM SIGGRAPH '93, pp. 279-288, Aug. 1993.
[7] M. Hansen, P. Anandan, K. Dana, G. van der Wal,, and P.J. Burt, “Real-Time Scene Stabilization and Mosaic Construction,” Proc. DARPA Image Understanding Workshop '94, pp. 457-465, Nov. 1994.
[8] R. Hartley and R. Gupta, “Linear Pushbroom Cameras,” Proc. Third European Conf. Computer Vision, J.O. Eklundh, ed., pp. 555-566, May 1994.
[9] R.I. Hartley, “Theory and Practice of Projective Rectification,” Int'l J. Computer Vision, vol. 35, no. 2, pp. 1-16, Nov. 1999.
[10] M. Irani, P. Anandan, and S. Hsu, “Mosaic Based Representations of Video Sequences and Their Applications,” Proc. Fifth Int'l Conf. Computer Vision, pp. 605-611, June 1995.
[11] P. Jaillon and A. Montanvert, “Image Mosaicing Applied to Three-Dimensional Surfaces,” Proc. 12th Int'l Conf. Pattern Recognition, pp. 253-257, Oct. 1994.
[12] A. Krishnan and N. Ahuja, “Panoramic Image Acquisition,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 379-384, June 1996.
[13] R. Kumar, P. Anandan, M. Irani, J. Bergen, and K. Hanna, “Representation of Scenes from Collections of Images,“ Proc. IEEE Workshop Representation of Visual Scenes, pp. 10-17, June 1995.
[14] C. Loop and Z. Zhang, “Computing Rectifying Homographies for Stereo Vision,” Proc. Computer Vision and Pattern Recognition '99, vol. I, pp. 125-131, 1999.
[15] S. Mann and R. Picard, “Virtual Bellows: Constructing High Quality Stills from Video,” Proc. First IEEE Int'l Conf. Image Processing, vol. I, pp. 363-367, Nov. 1994.
[16] L. McMillan and G. Bishop, "Plenoptic Modeling: An Image-Based Rendering System," Siggraph 95 Conf. Proc., ACM Press, New York, 1995, pp. 39-46.
[17] D.L. Milgram, “Computer Methods for Creating Photomosaics,” IEEE Trans. Computers, vol. 24, pp. 1,113-1,119, 1975.
[18] D.L. Milgram, “Adaptive Techniques for Photomosaicing,“ IEEE Trans. Computers, vol. 26, pp. 1,175-1,180, 1977.
[19] S.K. Nayar, “Catadioptric Omnidirectional Cameras,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 482-488, June 1997.
[20] S. Peleg, “Elimination of Seams from Photomosaics,” Computer Graphics and Image Processing, vol. 16, pp. 90-94, May 1981.
[21] S. Peleg and J. Herman, “Panoramic Mosaics by Manifold Projection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 338-343, June 1997.
[22] P. Rademacher and Gary Bishop, “Multiple-Center-of-Projection Images,” Proc. ACM SIGGRAPH '98, pp. 199-206, July 1998.
[23] B. Rousso, S. Peleg, and I. Finci, “Generalized Panoramic Mosaics,” Proc. DARPA Image Understanding Workshop '97, pp. 255-260, May 1997.
[24] B. Rousso, S. Peleg, I. Finci, and A. Rav-Acha, “Universal Mosaicing Using Pipe Projection,” Proc. Sixth Int'l Conf. Computer Vision, pp. 945-952, Jan. 1998.
[25] S. Roy, J. Meunier, and I. Cox, “Cylindrical Rectification to Minimize Epipolar Distortion,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 393-399, June 1997.
[26] H.S. Sawhney, S. Ayer, and M. Gorkani, “Model-Based 2D and 3D Dominant Motion Estimation for Mosaicing and Video Representation,” Proc. Fifth Int'l Conf. Computer Vision, pp. 583-590, June 1995.
[27] S. Seitz and C. Dyer, “Physically Valid View Synthesis by Image Interpolation,” Proc. IEEE Workshop Representation of Visual Scenes, pp. 18-95, June 1995.
[28] H.Y. Shum and R. Szeliski, “Construction of Panoramic Image Mosaics with Global and Local Alignment,” Int'l J. Computer Vision, vol. 36, no. 2, pp. 101-130, Feb. 2000.
[29] R. Szeliski, “Video Mosaics for Virtual Environments,” IEEE Computer Graphics and Applications, pp. 22-30, Mar. 1996.
[30] D.N. Wood, A. Finkelstein, J.F. Hughes, C.E. Thayer, and D.H. Salesin, “Multiperspective Panoramas for Cel Animation,” Proc. ACM SIGGRAPH '97, pp. 243-250, Aug. 1997.
[31] J.Y. Zheng and S. Tsuji, “Panoramic Representation for Route Recognition by a Mobile Robot,” Int'l J. Computer Vision, vol. 9, pp. 55-76, 1992.
[32] J.Y. Zheng and S. Tsuji, “Generating Dynamic Projection Images for Scene Representation and Understanding,” Computer Vision and Image Understanding, vol. 72, pp. 237-256, Dec. 1998.
[33] A. Zomet, S. Peleg, and C. Arora, “Rectified Mosaicing: Mosaics without the Curl,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 459-465, June 2000.

Index Terms:
Mosaicing, motion analysis, image alignment.
Citation:
Shmuel Peleg, Benny Rousso, Alex Rav-Acha, Assaf Zomet, "Mosaicing on Adaptive Manifolds," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1144-1154, Oct. 2000, doi:10.1109/34.879794
Usage of this product signifies your acceptance of the Terms of Use.