Issue No. 04 - April (2004 vol. 26)
Ralph Gross , IEEE
Iain Matthews , IEEE
<p><b>Abstract</b>—Arguably the most important decision to be made when developing an object recognition algorithm is selecting the scene measurements or <it>features</it> on which to base the algorithm. In appearance-based object recognition, the features are chosen to be the pixel intensity values in an image of the object. These pixel intensities correspond directly to the radiance of light emitted from the object along certain rays in space. The set of all such radiance values over all possible rays is known as the <it>plenoptic function</it> or <it>light-field</it>. In this paper, we develop a theory of appearance-based object recognition from light-fields. This theory leads directly to an algorithm for face recognition across pose that uses as many images of the face as are available, from one upwards. All of the pixels, whichever image they come from, are treated equally and used to estimate the (eigen) light-field of the object. The <it>eigen light-field</it> is then used as the set of features on which to base recognition, analogously to how the pixel intensities are used in appearance-based face and object recognition.</p>
Appearance-based object recognition, face recognition, light-fields, eigen light-fields, face recognition across pose.
Simon Baker, Ralph Gross, Iain Matthews, "Appearance-Based Face Recognition and Light-Fields", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 26, no. , pp. 449-465, April 2004, doi:10.1109/TPAMI.2004.1265861