This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Mosaicing New Views: The Crossed-Slits Projection
June 2003 (vol. 25 no. 6)
pp. 741-754

Abstract—We introduce a new kind of mosaicing, where the position of the sampling strip varies as a function of the input camera location. The new images that are generated this way correspond to a new projection model defined by two slits, termed here the Crossed-Slits (X-Slits) projection. In this projection model, every 3D point is projected by a ray defined as the line that passes through that point and intersects the two slits. The intersection of the projection rays with the imaging surface defines the image. X-Slits mosaicing provides two benefits. First, the generated mosaics are closer to perspective images than traditional pushbroom mosaics. Second, by simple manipulations of the strip sampling function, we can change the location of one of the virtual slits, providing a virtual walkthrough of a X-slits camera; all this can be done without recovering any 3D geometry and without calibration. A number of examples where we translate the virtual camera and change its orientation are given; the examples demonstrate realistic changes in parallax, reflections, and occlusions.

[1] R. Chellappa, C.L. Wilson, and S. Sirohey, “Human and Machine Recognition of Faces: A Survey,” Proc. IEEE, vol. 83, no. 5, pp. 705-740, 1995.
[1] D. Aliaga and I. Carlbom, Plenoptic Stitching: A Scalable Method for Reconstructing Interactive Walkthroughs Proc. ACM SIGGRAPH '01, pp. 443-450, 2001.
[2] S.C. Dass and A.K. Jain, “Markov Face Models,” Proc. Eighth IEEE Int'l Conf. Computer Vision, pp. 680-687, 2001.
[2] M. Ben-Ezra and S. Peleg, Multi-View Omni-Directional Imaging Technical Report-00-21, Hebrew Univ., Dec. 2000.
[3] K. Fukunaga, Introduction to Statistical Pattern Recognition. second ed. Academic Press, 1991.
[3] J. Bergen, P. Anandan, K. Hanna, and R. Hingorani, Hierarchical Model-Based Motion Estimation Proc. European Conf. Computer Vision, pp. 237-252, 1992.
[4] B. Heisele, T. Poggio, and M. Pontil, “Face Detection in Still Gray Images,” A.I. memo AIM-1687, Artificial Intelligence Laboratory, MIT, 2000.
[4] C. Buehler, M. Bosse, S. Gortler, M. Cohen, and L. McMillan, Unstructured Lumigraph Rendering Proc. ACM SIGGRAPH '01, pp. 425-432, 2001.
[5] E. Hjelmas and B.K. Low, “Face Detection: A Survey,” Computer Vision and Image Understanding, vol. 83, pp. 236-274, 2001.
[5] S. Gortler, R. Grzeszczuk, R. Szeliski, and M. Cohen, The Lumigraph Proc. ACM SIGGRAPH '96, pp. 43-54, 1996.
[6] P. Ho, “Rotation Invariant Real-Time Face Detection and Recognition System,” A.I. memo AIM-2001-010, Artificial Intelligence Laboratory, MIT, 2001.
[6] R. Gupta and R. Hartley, Linear Pushbroom Cameras IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 9, pp. 963-975, Sept. 1997.
[7] R.L. Hsu, M. Abdel-Mottaleb, and A.K. Jain, “Face Detection in Color Images,” Proc. Int'l Conf. Image Processing, pp. 1046-1049, 2001.
[7] R.I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge Univ. Press, 2000.
[8] C. Liu and H. Wechsler, “Evolutionary Pursuit and Its Application to Face Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 6, pp. 570-582, June 2000.
[8] H. Ishiguro, M. Yamamoto, and S. Tsuji, Omni-Directional Stereo IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 257-262, 1992.
[9] C. Liu and H. Wechsler, “Robust Coding Schemes for Indexing and Retrieval from Large Face Databases,” IEEE Trans. Image Processing, vol. 9, no. 1, pp. 132-137, 2000.
[9] S. Kang, A Survey of Image-Based Rendering Techniques Videometric VI, vol. 3641, pp. 2-16, Jan. 1999.
[10] C. Liu and H. Wechsler, “A Shape and Texture Based Enhanced Fisher Classifier for Face Recognition,” IEEE Trans. Image Processing, vol. 10, no. 4, pp. 598-608, 2001.
[10] R. Kingslake, Optics in Photography. SPIE Optical Eng., Press, 1992.
[11] C. Liu and H. Wechsler, “Gabor Feature Based Classification Using the Enhanced Fisher Linear Discriminant Model for Face Recognition,” IEEE Trans. Image Processing, vol. 11, no. 4, pp. 467-476, 2002.
[11] A. Klein, P. Sloan, A. Colburn, A. Finkelstein, and M. Cohen, Video Cubism Technical Report MSR-TR-2001-45, Microsoft Research Technical Report, 2001.
[12] B. Moghaddam and A. Pentland, “Probabilistic Visual Learning for Object Representation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 696-710, July 1997.
[12] M. Levoy and P. Hanrahan, Light Field Rendering Proc. ACM SIGGRAPH '96, pp. 31-42, 1996.
[13] A. Mohan, C. Papageorgiou, and T. Poggio, “Example-Based Object Detection in Images by Components,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 4, pp. 349-361, Apr. 2001.
[13] L. McMillan and G. Bishop, Plenoptic Modeling: An Image-Based Rendering System Proc. ACM SIGGRAPH '95, pp. 39-46, Aug. 1995.
[14] C.P. Papageorgiou, M. Oren, and T. Poggio, “A General Framework for Object Detection,” Proc. Int'l Conf. Computer Vision, pp. 555-562, Jan. 1998.
[14] B. Newhall, The History of Photography, from 1839 to the Present Day. The Museum of Modern Art, p. 162, 1964.
[15] A. Pentland, B. Moghaddam, and T. Starner, “View-Based and Modular Eigenspaces for Face Recognition,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 84-91, 1994.
[15] T. Pajdla, Stereo with Oblique Cameras Int'l J. Computer Vision, vol. 47, nos. 1/2/3, pp. 161-170, 2002.
[16] P.J. Phillips, H. Wechsler, J. Huang, and P. Rauss, “The FERET Database and Evaluation Procedure for Face-Recognition Algorithms,” Image and Vision Computing, vol. 16, pp. 295-306, 1998.
[16] S. Peleg, B. Rousso, A. Rav-Acha, and A. Zomet, Mosaicing on Adaptive Manifolds IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1144-1154, Oct. 2000.
[17] R.J. Qian and T.S. Huang, “Object Detection Using Hierarchical MRF and MAP Estimation,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 186-192, 1997.
[17] S. Peleg, M. Ben-Ezra, and Y. Pritch, Omnistereo: Panoramic Stereo Imaging IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 3, pp. 279-290, 2001.
[18] H.A. Rowley, S. Baluja, and T. Kanade, “Neural Network-Based Face Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 1, pp. 23-38, Jan. 1998.
[18] S.M. Seitz, The Space of All Stereo Images Proc. Int'l Conf. Computer Vision '01, vol. I, pp. 26-33, July 2001.
[19] H.A. Rowley, S. Baluja, and T. Kanade, “Rotation Invariant Neural Network-Based Face Detection,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 38-44, June 1998.
[19] J. Semple and G. Kneebone, Algebraic Projective Geometry. Oxford: Clarendon Press, 1998.
[20] A. Samal and P.A. Iyengar, “Automatic Recognition and Analysis of Human Faces and Facial Expression: A Survey,” Pattern Recognition, vol. 25, no. 1, pp. 65-77, 1992.
[20] H. Shum and L. He, Rendering with Concentric Mosaics Proc. ACM SIGGRAPH '99, pp. 299-306, Aug. 1999.
[21] H. Schneiderman and T. Kanade, “Probabilistic Modeling of Local Appearance and Spatial Relationships for Object Recognition,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 45-51, June 1998.
[21] P.J. Sloan, M.F. Cohen, and S.J. Gortler, Time Critical Lumigraph Rendering Proc. Symp. Interactive 3D Graphics, pp. 17-24, Apr. 1997.
[22] H. Schneiderman and T. Kanade, “A Statistical Method for 3D Object Detection Applied to Faces and Cars,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 746-751, 2000.
[22] T. Takahashi, H. Kawasaki, K. Ikeuchi, and M. Sakauchi, “Arbitrary View Position and Direction Rendering for Large-Scale Scenes,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 296-303, 2000.
[23] K.K. Sung, “Learning and Example Selection for Object and Pattern Detection,” PhD thesis, AI Lab, MIT, 1996.
[23] D. Weinshall, M. Lee, T. Brodsky, M. Trajkovic, and D. Feldman, New View Generation with a Bi-Centric Camera Proc. Seventh European Conf. Computer Vision, pp. 614-628, May 2002.
[24] K.K. Sung and T. Poggio, “Example-Based Learning for View-Based Human Face Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 1, pp. 39-51, Jan. 1998.
[24] D. Wood, A. Finkelstein, J. Hughes, C. Thayer, and D. Salesin, Multiperspective Panoramas for Cel Animation Proc. ACM SIGGRAPH '97, pp. 243-250, Aug. 1997.
[25] P. Viola and M. Jones, “Rapid Object Detection Using a Boosted Cascade of Simple Features,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 511-518, 2001.
[25] J.Y. Zheng and S. Tsuji, Panoramic Representation for Route Recognition by a Mobile Robot Int'l J. Computer Vision, vol. 9, no. 1, pp. 55-76, Oct. 1992.
[26] M.H. Yang, N. Ahuja, and D. Kriegman, “Face Detection Using Mixtures of Linear Subspaces,” Proc. Fifth Int'l Conf. Automatic Face and Gesture Recognition, pp. 70-76, 2000.
[27] M.H. Yang, D. Kriegman, and N. Ahuja, “Detecting Faces in Images: A Survey,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 1, pp. 34-58, Jan. 2002.
[28] A.L. Yuille, “Deformable Templates from Face Recognition,” J. Cognitive Neuroscience, vol. 3, no. 1, pp. 59-70, 1991.

Index Terms:
Nonstationary mosaicing, crossed-slits projection, pushbroom camera, virtual walkthrough, image-based rendering.
Citation:
Assaf Zomet, Doron Feldman, Shmuel Peleg, Daphna Weinshall, "Mosaicing New Views: The Crossed-Slits Projection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 6, pp. 741-754, June 2003, doi:10.1109/TPAMI.2003.1201823
Usage of this product signifies your acceptance of the Terms of Use.