This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Light-Efficient Photography
November 2011 (vol. 33 no. 11)
pp. 2203-2214
ASCII Text
x 
 
Samuel W. Hasinoff, Kiriakos N. Kutulakos, "Light-Efficient Photography," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 11, pp. 2203-2214, November, 2011.
 
 
BibTex
x
 
@article{ 10.1109/TPAMI.2011.62,
author = {Samuel W. Hasinoff and Kiriakos N. Kutulakos},
title = {Light-Efficient Photography},
journal ={IEEE Transactions on Pattern Analysis and Machine Intelligence},
volume = {33},
number = {11},
issn = {0162-8828},
year = {2011},
pages = {2203-2214},
doi = {http://doi.ieeecomputersociety.org/10.1109/TPAMI.2011.62},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Pattern Analysis and Machine Intelligence
TI - Light-Efficient Photography
IS - 11
SN - 0162-8828
SP2203
EP2214
EPD - 2203-2214
A1 - Samuel W. Hasinoff,
A1 - Kiriakos N. Kutulakos,
PY - 2011
KW - Computational photography
KW - computer vision
KW - computer graphics
KW - shape-from-focus.
VL - 33
JA - IEEE Transactions on Pattern Analysis and Machine Intelligence
ER -
 
Samuel W. Hasinoff, Toyota Technological Institute at Chicago, Chicago
Kiriakos N. Kutulakos, University of Toronto, Toronto
In this paper, we consider the problem of imaging a scene with a given depth of field at a given exposure level in the shortest amount of time possible. We show that by 1) collecting a sequence of photos and 2) controlling the aperture, focus, and exposure time of each photo individually, we can span the given depth of field in less total time than it takes to expose a single narrower-aperture photo. Using this as a starting point, we obtain two key results. First, for lenses with continuously variable apertures, we derive a closed-form solution for the globally optimal capture sequence, i.e., that collects light from the specified depth of field in the most efficient way possible. Second, for lenses with discrete apertures, we derive an integer programming problem whose solution is the optimal sequence. Our results are applicable to off-the-shelf cameras and typical photography conditions, and advocate the use of dense, wide-aperture photo sequences as a light-efficient alternative to single-shot, narrow-aperture photography.

[1] G.E. Healey and R. Kondepudy, "Radiometric CCD Camera Calibration and Noise Estimation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 3, pp. 267-276, Mar. 1994.
[2] S.W. Hasinoff and K.N. Kutulakos, "A Layer-Based Restoration Framework for Variable-Aperture Photography," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
[3] A.P. Pentland, "A New Sense for Depth of Field," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, no. 4, pp. 523-531, July 1987.
[4] E. Krotkov, "Focusing," Int'l J. Computer Vision, vol. 1, no. 3, pp. 223-237, 1987.
[5] S. Hiura and T. Matsuyama, "Depth Measurement by the Multi-Focus Camera," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 953-959, 1998.
[6] M. Watanabe and S.K. Nayar, "Rational Filters for Passive Depth from Defocus," Int'l J. Computer Vision, vol. 27, no. 3, pp. 203-225, 1998.
[7] R. Raskar, A. Agrawal, and J. Tumblin, "Coded Exposure Photography: Motion Deblurring Using Fluttered Shutter," Proc. ACM SIGGRAPH, pp. 795-804, 2006.
[8] L. Yuan, J. Sun, L. Quan, and H.-Y. Shum, "Image Deblurring with Blurred/Noisy Image Pairs," Proc. ACM SIGGRAPH, 2007.
[9] J. Telleen, A. Sullivan, J. Yee, P. Gunawardane, O. Wang, I. Collins, and J. Davis, "Synthetic Shutter Speed Imaging," Proc. Eurographics, pp. 591-598, 2007.
[10] H. Farid and E.P. Simoncelli, "Range Estimation by Optical Differentiation," J. Optical Soc. Am. A, vol. 15, no. 7, pp. 1777-1786, 1998.
[11] W.T. Cathey and E.R. Dowski, "New Paradigm for Imaging Systems," Applied Optics, vol. 41, no. 29, pp. 6080-6092, Oct. 2002.
[12] G. Häusler, "A Method to Increase the Depth of Focus by Two Step Image Processing," Optics Comm., vol. 6, no. 1, pp. 38-42, 1972.
[13] H. Nagahara, S. Kuthirummal, C. Zhou, and S. Nayar, "Flexible Depth of Field Photography," Proc. European Conf. Computer Vision, vol. 4, pp. 60-73, 2008.
[14] A. Zomet and S.K. Nayar, "Lensless Imaging with a Controllable Aperture," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 339-346, June 2006.
[15] A. Levin, R. Fergus, F. Durand, and W.T. Freeman, "Image and Depth from a Conventional Camera with a Coded Aperture," Proc. ACM SIGGRAPH, 2007.
[16] A. Veeraraghavan, R. Raskar, A. Agrawal, A. Mohan, and J. Tumblin, "Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing," Proc. ACM SIGGRAPH, 2007.
[17] A. Levin, S.W. Hasinoff, P. Green, F. Durand, and W.T. Freeman, "4D Frequency Analysis of Computational Cameras for Depth of Field Extension," Proc. ACM SIGGRAPH, 2009.
[18] K. Aizawa, K. Kodama, and A. Kubota, "Producing Object-Based Special Effects by Fusing Multiple Differently Focused Images," IEEE Trans. Circuits and Systems for Video Technology, vol. 10, no. 2, pp. 323-330, Mar. 2000.
[19] S. Chaudhuri, "Defocus Morphing in Real Aperture Images," J. Optical Soc. Am. A, vol. 22, no. 11, pp. 2357-2365, Nov. 2005.
[20] S.W. Hasinoff and K.N. Kutulakos, "Confocal Stereo," Proc. European Conf. Computer Vision, vol. 1, pp. 620-634, 2006.
[21] R. Ng, "Fourier Slice Photography," Proc. ACM SIGGRAPH, pp. 735-744, 2005.
[22] M. Levoy, R. Ng, A. Adams, M. Footer, and M. Horowitz, "Light Field Microscopy," Proc. ACM SIGGRAPH, pp. 924-934, 2006.
[23] P. Debevec and J. Malik, "Recovering High Dynamic Range Radiance Maps from Photographs," Proc. ACM SIGGRAPH, pp. 369-378, 1997.
[24] A. Levin, W.T. Freeman, and F. Durand, "Understanding Camera Trade-Offs through a Bayesian Analysis of Light Field Projections," Proc. European Conf. Computer Vision, vol. 4, pp. 88-101, 2008.
[25] S.W. Hasinoff, K.N. Kutulakos, F. Durand, and W.T. Freeman, "Time-Constrained Photography," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-8, 2009.
[26] A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Colburn, B. Curless, D. Salesin, and M. Cohen, "Interactive Digital Photomontage," Proc. ACM SIGGRAPH, pp. 294-302, 2004.
[27] R. Ng, M. Levoy, M. Brédif, G. Duval, M. Horowitz, and P. Hanrahan, "Light Field Photography with a Hand-Held Plenoptic Camera," Technical Report CTSR 2005-02, Dept. of Computer Science, Stanford Univ., 2005.
[28] J. Ogden, E. Adelson, J.R. Bergen, and P. Burt, "Pyramid-Based Computer Graphics," RCA Engineer, vol. 30, no. 5, pp. 4-15, 1985.
[29] W.J. Smith, Modern Optical Engineering, third ed. McGraw-Hill, 2000.
[30] S.W. Hasinoff, F. Durand, and W.T. Freeman, "Noise-Optimal Capture for High Dynamic Range Photography," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[31] Canon Lens Specifications, http://www.usa.canon.com/eflenses/pdfspec.pdf , 2011.
[32] J. Nocedal and S.J. Wright, Numerical Optimization. Springer, 1999.
[33] Y. Boykov, O. Veksler, and R. Zabih, "Fast Approximate Energy Minimization via Graph Cuts," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 11, pp. 1222-1239, Nov. 2001.
[34] Y.Y. Schechner and N. Kiryati, "Depth from Defocus vs. Stereo: How Different Really Are They?" Int'l J. Computer Vision, vol. 39, no. 2, pp. 141-162, Sept. 2000.
[35] R. Willson and S. Shafer, "What Is the Center of the Image?" J. Optical Soc. Am. A, vol. 11, no. 11, pp. 2946-2955, Nov. 1994.
[36] P. Favaro and S. Soatto, "Seeing beyond Occlusions (and Other Marvels of a Finite Lens Aperture)," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 579-586, 2003.
[37] Technical Innovations, http:/www.robofocus.com/, 2011.
[38] CHDK, http:/chdk.wikia.com/, 2011.
[39] S. Baker and I. Matthews, "Lucas-Kanade 20 Years On: A Unifying Framework," Int'l J. Computer Vision, vol. 56, no. 3, pp. 221-25, 2004.
[40] A. Lumsdaine and T. Georgiev, "The Focused Plenoptic Camera," Proc. Int'l Conf. Computational Photography, 2009.
[41] T. Bishop, S. Zanetti, and P. Favaro, "Light Field Superresolution," Proc. Int'l Conf. Computational Photography, 2009.
[42] T. Georgiev, C. Zheng, S. Nayar, D. Salesin, B. Curless, and C. Intwala, "Spatio-Angular Resolution Tradeoffs in Integral Photography," Proc. Eurographics Symp. Rendering, pp. 263-272, 2006.
[43] A. Levin, S.W. Hasinoff, P. Green, F. Durand, and W.T Freeman, "4D Frequency Analysis of Computational Cameras for Depth of Field Extension," Technical Report MIT-CSAIL-TR-2009-019, Massachusetts Inst. of Tech nology, 2009.
[44] W.T. Welford, "Use of Annular Apertures to Increase Focal Depth," J. Optical Soc. Am. A, vol. 50, no. 8, pp. 749-753, Aug. 1960.

Index Terms:
Computational photography, computer vision, computer graphics, shape-from-focus.
Citation:
Samuel W. Hasinoff, Kiriakos N. Kutulakos, "Light-Efficient Photography," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 11, pp. 2203-2214, Nov. 2011, doi:10.1109/TPAMI.2011.62
Usage of this product signifies your acceptance of the Terms of Use.