This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Appearance Derivatives for Isonormal Clustering of Scenes
August 2009 (vol. 31 no. 8)
pp. 1375-1385
ASCII Text
x 
 
Sanjeev J. Koppal, Srinivasa G. Narasimhan, "Appearance Derivatives for Isonormal Clustering of Scenes," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 8, pp. 1375-1385, August, 2009.
 
 
BibTex
x
 
@article{ 10.1109/TPAMI.2008.148,
author = {Sanjeev J. Koppal and Srinivasa G. Narasimhan},
title = {Appearance Derivatives for Isonormal Clustering of Scenes},
journal ={IEEE Transactions on Pattern Analysis and Machine Intelligence},
volume = {31},
number = {8},
issn = {0162-8828},
year = {2009},
pages = {1375-1385},
doi = {http://doi.ieeecomputersociety.org/10.1109/TPAMI.2008.148},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Pattern Analysis and Machine Intelligence
TI - Appearance Derivatives for Isonormal Clustering of Scenes
IS - 8
SN - 0162-8828
SP1375
EP1385
EPD - 1375-1385
A1 - Sanjeev J. Koppal,
A1 - Srinivasa G. Narasimhan,
PY - 2009
KW - Appearance modeling
KW - physics-based vision
KW - scene reconstruction
KW - active illumination
KW - material invariants
KW - relighting.
VL - 31
JA - IEEE Transactions on Pattern Analysis and Machine Intelligence
ER -
 
Sanjeev J. Koppal, Carnegie Mellon University, Pittsburgh
Srinivasa G. Narasimhan, Carnegie Mellon Univeristy, Pittsburgh
A new technique is proposed for scene analysis, called "appearance clustering.” The key result of this approach is that the scene points can be clustered according to their surface normals, even when the geometry, material, and lighting are all unknown. This is achieved by analyzing an image sequence of a scene as it is illuminated by a smoothly moving distant light source. In such a scenario, the brightness measurements at each pixel form a "continuous appearance profile.” When the source path follows an unstructured trajectory (obtained, say, by smoothly hand-waving a light source), the locations of the extrema of the appearance profile provide a strong cue for the scene point's surface normal. Based on this observation, a simple transformation of the appearance profiles and a distance metric are introduced that, together, can be used with any unsupervised clustering algorithm to obtain isonormal clusters of a scene. We support our algorithm empirically with comprehensive simulations of the Torrance-Sparrow and Oren-Nayar analytic BRDFs, as well as experiments with 25 materials obtained from the MERL database of measured BRDFs. The method is also demonstrated on 45 examples from the CURET database, obtaining clusters on scenes with real textures such as artificial grass and ceramic tile, as well as anisotropic materials such as satin and velvet. The results of applying our algorithm to indoor and outdoor scenes containing a variety of complex geometry and materials are shown. As an example application, isonormal clusters are used for lighting-consistent texture transfer. Our algorithm is simple and does not require any complex lighting setup for data collection.

[1] R.J. Woodham, “Photometric Stereo,” MIT AI Memo, 1978.
[2] G.J. Klinker, S.A. Shafer, and T. Kanade, “A Physical Approach to Color Image Understanding,” Int'l J. Computer Vision, 1990.
[3] M. Oren and S.K. Nayar, “Generalization of the Lambertian Model and Implications for Machine Vision,” Int'l J. Computer Vision, 1995.
[4] D. Goldman, B. Curless, A. Hertzmann, and S. Seitz, “Shape and Spatially-Varying BRDFs from Photometric Stereo,” Proc. 10th IEEE Int'l Conf. Computer Vision, 2005.
[5] K.E. Torrance and E.M. Sparrow, “Theory for Off-Specular Reflection from Roughened Surfaces,” J. Optical Soc. Am., 1967.
[6] E. Coleman and R. Jain, “Obtaining 3-Dimensional Shape of Textured and Specular Surfaces Using Four-Source Photometry,” Proc. Int'l Conf. Color in Graphics and Image Processing, 1982.
[7] A. Shashua, “On Photometric Issues in 3D Visual Recognition from a Single 2D Image,” Int'l J. Computer Vision, 1997.
[8] S. Mallick, T. Zickler, D. Kriegman, and P. Belhumeur, “Beyond Lambert: Reconstructing Specular Surfaces Using Color,” Proc. 10th IEEE Int'l Conf. Computer Vision, 2005.
[9] H.D. Tagare and R.J.P. deFigueiredo, “A Theory of Photometric Stereo for a Class of Diffuse Non-Lambertian Surfaces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 2, pp.133-152, Feb. 1991.
[10] S. Mallick, T. Zickler, D. Kriegman, and P. Belhumeur, “Beyond Lambert: Reconstructing Surfaces with Arbitrary BRDFs,” Proc. Eighth Int'l Conf. Computer Vision, 2001.
[11] Y. Sato, M.D. Wheeler, and K. Ikeuchi, “Object Shape and Reflectance Modeling from Observation,” Proc. ACM SIGGRAPH, 1997.
[12] S. Marschner, S. Westin, E. Lafortune, K. Torrance, and D. Greenberg, “Image-Based BRDF Measurement Including Human Skin,” Proc. Eurographics Workshop Rendering Techniques, 1999.
[13] R. Ramamoorthi and P. Hanrahan, “A Signal-Processing Framework for Inverse Rendering,” Proc. ACM SIGGRAPH, 2001.
[14] A. Hertzmann and S. Seitz, “Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 8, pp. 1254-1264, Aug. 2005.
[15] S.K. Nayar, K. Ikeuchi, and T. Kanade, “Surface Reflection: Physical and Geometrical Perspectives,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 611-634, July 1991.
[16] S.K. Nayar, K. Ikeuchi, and T. Kanade, “Determining Shape and Reflectance of Hybrid Surfaces by Photometric Sampling,” IEEE Trans. Robotics and Automation, 1990.
[17] A.S. Georghiades, “Recovering 3D Shape and Reflectance from a Small Number of Photographs,” Proc. Eurographics Workshop Rendering Techniques, 2003.
[18] R. Basri and D.W. Jacobs, “Photometric Stereo with General, Unknown Lighting,” Int'l J. Computer Vision, 2006.
[19] G. Healey and L.Z. Wang, “Segmenting Surface Shape Using Colored Illumination,” Proc. 10th Scandinavian Conf. Image Analysis, 1997.
[20] L. Zhang, B. Curless, and S. Seitz, “Spacetime Stereo: Shape Recovery for Dynamic Scenes,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
[21] H. Hayakawa, “Photometric Stereo under a Light-Source with Arbitrary Motion,” J. Optical Soc. Am., 1994.
[22] S.G. Narasimhan, V. Ramesh, and S.K. Nayar, “A Class of Photometric Invariants: Separating Material from Shape and Illumination,” Proc. Ninth Int'l Conf. Computer Vision, 2003.
[23] P. Debevec, T. Hawkins, C. Tchou, H. Duiker, W. Sarokin, and M. Sagar, “Acquiring the Reflectance Field of a Human Face,” Proc. ACM SIGGRAPH, 2000.
[24] J. DeYoung and A. Fournier, “Properties of Tabulated Bidirectional Reflectance Distribution,” Proc. Graphics Interface Conf., 1997.
[25] A. Fournier, “Separating Reflection Functions for Linear Radiosity,” Proc. Eurographics Workshop Rendering Techniques, 1995.
[26] S. Rusinkiewicz, “A New Change of Variables for Efficient BRDF Representation,” Proc. Eurographics Workshop Rendering Techniques, 1998.
[27] J. Kautz and M.D. McCool, “Interactive Rendering with Arbitrary BRDFs Using Separable Approximations,” Proc. Eurographics Workshop Rendering Techniques, 1999.
[28] G. Salton, Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer. Addison-Wesley, 1989.
[29] K.J. Dana, B.V. Ginneken, S.K. Nayar, and J.J. Koenderink, “Reflectance and Texture of Real World Surfaces,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997.
[30] S.G. Narasimhan, C. Wang, and S.K. Nayar, “All the Images of an Outdoor Scene,” Proc. Seventh European Conf. Computer Vision, 2002.
[31] H.P.A. Lensch, J. Kautz, M. Goesele, W. Heidrick, and H. Seidel, “Image-Based Reconstruction of Spatial Appearance and Geometric Detail,” ACM Trans. Graphics, 2003.
[32] M. Pharr and G. Humphreys, Physically Based Rendering: From Theory to Implementation. Elsevier, 2004.
[33] S.J. Koppal and S. Narasimhan, Appearance Clustering Web Page, http://www.cs.cmu.edu/~koppalclustering.html , 2006.
[34] W. Matusik, H. Pfister, M., Brand, and L. McMillan, “A Data-Driven Reflectance Model,” ACM Trans. Graphics, 2003.

Index Terms:
Appearance modeling, physics-based vision, scene reconstruction, active illumination, material invariants, relighting.
Citation:
Sanjeev J. Koppal, Srinivasa G. Narasimhan, "Appearance Derivatives for Isonormal Clustering of Scenes," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 8, pp. 1375-1385, Aug. 2009, doi:10.1109/TPAMI.2008.148
Usage of this product signifies your acceptance of the Terms of Use.