The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - Oct. (2013 vol.35)
pp: 2484-2497
Seyed Mohammad Hassan Anvar , Sch. of Electr. & Electron. Eng., Nanyang Technol. Univ., Singapore, Singapore
Wei-Yun Yau , Inst. for Infocomm Res., A*STAR, Singapore, Singapore
Eam Khwang Teoh , Div. of Control & Instrum., Nanyang Technol. Univ., Singapore, Singapore
ABSTRACT
Most face recognition systems require faces to be detected and localized a priori. In this paper, an approach to simultaneously detect and localize multiple faces having arbitrary views and different scales is proposed. The main contribution of this paper is the introduction of a face constellation, which enables multiview face detection and localization. In contrast to other multiview approaches that require many manually labeled images for training, the proposed face constellation requires only a single reference image of a face containing two manually indicated reference points for initialization. Subsequent training face images from arbitrary views are automatically added to the constellation (registered to the reference image) based on finding the correspondences between distinctive local features. Thus, the key advantage of the proposed scheme is the minimal manual intervention required to train the face constellation. We also propose an approach to identify distinctive correspondence points between pairs of face images in the presence of a large amount of false matches. To detect and localize multiple faces with arbitrary views, we then propose a probabilistic classifier-based formulation to evaluate whether a local feature cluster corresponds to a face. Experimental results conducted on the FERET, CMU, and FDDB datasets show that our proposed approach has better performance compared to the state-of-the-art approaches for detecting faces with arbitrary pose.
INDEX TERMS
Face, Feature extraction, Face detection, Training, Detectors, Manuals, Face recognition,simultaneous face detection and localization, Multiview, image registration, face constellation
CITATION
Seyed Mohammad Hassan Anvar, Wei-Yun Yau, Eam Khwang Teoh, "Multiview Face Detection and Registration Requiring Minimal Manual Intervention", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 10, pp. 2484-2497, Oct. 2013, doi:10.1109/TPAMI.2013.37
REFERENCES
[1] B. Zitova and J. Flusser, "Image Registration Methods: A Survey," Image Vision Computing, vol. 21, no. 11, pp. 977-1000, 2003, doi: 10.1016/s0262-8856(03)00137-9.
[2] J. Wright et al., "Robust Face Recognition via Sparse Representation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 2, pp. 210-227, Feb. 2009, doi: 10.1109/TPAMI.2008.79.
[3] Z. Baochang, G. Yongsheng, Z. Sanqiang, and L. Jianzhuang, "Local Derivative Pattern versus Local Binary Pattern: Face Recognition with High-Order Local Pattern Descriptor," IEEE Trans. Image Processing, vol. 19, no. 2, pp. 533-544, Feb. 2010, doi: 10.1109/TIP.2009.2035882.
[4] M. Meytlis and L. Sirovich, "On the Dimensionality of Face Space," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 7, pp. 1262-1267, July 2007, doi: 10.1109/TPAMI.2007.1033.
[5] P. Viola and M.J. Jones, "Robust Real-Time Face Detection," Int'l J. Computer Vision, vol. 57, no. 2, pp. 137-154, 2004, doi: 10.1023/B:VISI.0000013087.49260.fb.
[6] H. Schneiderman and T. Kanade, "Object Detection Using the Statistics of Parts," Int'l J. Computer Vision, vol. 56, no. 3, pp. 151-177, 2004, doi: 10.1023/B:VISI.0000011202.85607.00.
[7] S.Z. Li and Z. Zhenqiu, "FloatBoost Learning and Statistical Face Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 9, pp. 1112-1123, Sept. 2004, doi: 10.1109/TPAMI.2004.68.
[8] C. Huang, H.Z. Ai, Y. Li, and S.H. Lao, "High-Performance Rotation Invariant Multiview Face Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 4, pp. 671-686, Apr. 2007, doi: 10.1109/TPAMI.2007.1011.
[9] G. Dedeoglu, T. Kanade, and S. Baker, "The Asymmetry of Image Registration and Its Application to Face Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 5, pp. 807-823, May 2007, doi: 10.1109/TPAMI.2007.1054.
[10] A. Gee and R. Cipolla, "Determining the Gaze of Faces in Images," Image Vision Computing, vol. 12, no. 10, pp. 639-647, 1994, doi: 10.1016/0262-8856(94)90039-6.
[11] L. Xiaoming, "Generic Face Alignment Using Boosted Appearance Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[12] L. Gu and T. Kanade, "A Generative Shape Regularization Model for Robust Face Alignment," Proc. European Conf. Computer Vision, pp. 413-426, 2008.
[13] Z. Jianke, G. Luc Van, and S.C.H. Hoi, "Unsupervised Face Alignment by Robust Nonrigid Mapping," Proc. IEEE Int'l Conf. Computer Vision, pp. 1265-1272, 2009.
[14] L. Xiaoming, "Discriminative Face Alignment," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 11, pp. 1941-1954, Nov. 2009, doi: 10.1109/TPAMI.2008.238.
[15] A.U. Batur and M.H. Hayes, "Adaptive Active Appearance Models," IEEE Trans. Image Processing, vol. 14, no. 11, pp. 1707-1721, 2005, doi: 10.1109/TIP.2005.854473.
[16] A.B. Ashraf, S. Lucey, and C. Tsuhan, "Learning Patch Correspondences for Improved Viewpoint Invariant Face Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2008.
[17] L. Liang, R. Xiao, F. Wen, and E. Sun, "Face Alignment via Component-Based Discriminative Search," Proc. European Conf. Computer Vision, pp. 72-85, 2008.
[18] M. Toews and T. Arbel, "Detection, Localization, and Sex Classification of Faces from Arbitrary Viewpoints and under Occlusion," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 9, pp. 1567-1581, Sept. 2009, doi: 10.1109/TPAMI.2008.233.
[19] G.B. Huang, V. Jain, and E. Learned-Miller, "Unsupervised Joint Alignment of Complex Images," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
[20] C.P. Papageorgiou, M. Oren, and T. Poggio, "A General Framework for Object Detection," Proc. IEEE Int'l Conf. Computer Vision, pp. 555-562, 1998.
[21] T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 971-987, July 2002.
[22] K. Mikolajczyk and C. Schmid, "Indexing Based on Scale Invariant Interest Points," Proc. IEEE Int'l Conf. Computer Vision, pp. 525-531, 2001.
[23] D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int'l J. Computer Vision, vol. 60, no. 2, pp. 91-110, 2004, doi: 10.1023/B:VISI.0000029664.99615.94.
[24] K. Mikolajczyk and C. Schmid, "A Performance Evaluation of Local Descriptors," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1615-1630, Oct. 2005, doi: 10.1109/TPAMI.2005.188.
[25] H. Bay, T. Tuytelaars, and L. Van Gool, "SURF: Speeded Up Robust Features," Proc. European Conf. Computer Vision, pp. 404-417, 2006.
[26] S.J. Thomas, B.A. MacDonald, and K.A. Stol, "Real-Time Robust Image Feature Description and Matching," Proc. Asian Conf. Computer Vision, pp. 334-345, 2011.
[27] K. Mikolajczyk and C. Schmid, "Scale & Affine Invariant Interest Point Detectors," Int'l J. Computer Vision, vol. 60, no. 1, pp. 63-86, 2004, doi: 10.1023/B:VISI.0000027790.02288.f2.
[28] M.A. Fischler and R.C. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography," Comm. ACM, vol. 24, no. 6, pp. 381-395, 1981, doi: 10.1145/358669.358692.
[29] J.C. Chen and J.J.J. Lien, "A View-Based Statistical System for Multi-View Face Detection and Pose Estimation," Image Vision Computing, vol. 27, no. 9, pp. 1252-1271, 2009, doi: 10.1016/j.imavis.2008.11.004.
[30] G. Dorko and C. Schmid, Selection of Scale-Invariant Parts for Object Class Recognition, Proc. IEEE Int'l Conf. Computer Vision, pp. 634-640, 2003.
[31] O. Chum and J. Matas, "Optimal Randomized RANSAC," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 8, pp. 1472-1482, Aug. 2008, doi: 10.1109/TPAMI.2007.70787.
[32] A. Goshtasby and G.C. Stockman, "Point Pattern-Matching Using Convex-Hull Edges," IEEE Trans. Systems, Man, and Cybernetics, vol. 15, no. 5, pp. 631-637, Sept./Oct. 1985.
[33] K. Murphy, Machine Learning: A Probabilistic Perspective. MIT Press, Aug. 2012.
[34] D. Comaniciu and P. Meer, "Mean Shift: A Robust Approach toward Feature Space Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002, doi: 10.1109/34.1000236.
[35] P.J. Phillips, H. Moon, S.A. Rizvi, and P.J. Rauss, "The FERET Evaluation Methodology for Face-Recognition Algorithms," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1090-1104, Oct. 2000, doi: 10.1109/34.879790.
[36] P.J. Phillips, H. Wechsler, J. Huang, and P.J. Rauss, "The FERET Database and Evaluation Procedure for Face-Recognition Algorithms," Image Vision Computing, vol. 16, no. 5, pp. 295-306, 1998, doi: 10.1016/s0262-8856(97)00070-x.
[37] V. Jain and E. Learned-Miller, "FDDB: A Benchmark for Face Detection in Unconstrained Settings," Technical Report UM-CS-2010-009, Dept. of Computer Science, Univ. of Massachusetts, Amherst, http://vis-www.cs.umass.edufddb/, 2010.
[38] H. Schneiderman and T. Kanade, CMU Profile Face Images, http://vasc.ri.cmu.edu//idb/html/face/profile_images index.html, 2011.
[39] G.B. Huang, M. Ramesh, M. Berg, and E. Learned-Miller, "Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments," Technical Report 07-49, Univ. of Massachusetts, Amherst, http://vis-www.cs.umass.edulfw/, Oct. 2007.
[40] D.J.C. Mackay, Information Theory, Inference and Learning Algorithms. Cambridge Univ. Press, 2003.
[41] H.M. Wallach, "Evaluation Metrics for Hard Classifiers," technical report, Cavendish Lab., Univ. Cambridge, Cambridge, http://www.inference.phy .cam.ac.ukhmw26 /, Sept. 2006.
[42] M. Toews and T. Arbel, "A Statistical Parts-Based Model of Anatomical Variability," IEEE Trans. Medical Imaging, vol. 26, no. 5, pp. 757-757, 2007, doi: 10.1109/tmi.2006.895907.
[43] V. Jain and E. Learned-Miller, "Online Domain Adaptation of a Pre-Trained Cascade of Classifiers," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 577-584, 2011.
[44] J. Li, T. Wang, and Y. Zhang, "Face Detection Using SURF Cascade," Proc. IEEE Int'l Conf. Computer Vision Workshops, pp. 2183-2190, 2011.
[45] K. Mikolajczyk, C. Schmid, and A. Zisserman, "Human Detection Based on a Probabilistic Assembly of Robust Part Detectors," Proc. European Conf. Computer Vision, pp. 69-82, 2004.
[46] A. Vedaldi, "SIFT Implementation in C++ (SIFT++)," http://www.vlfeat.org/~vedaldi/codesiftpp.html , 2011.
83 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool