This Article 
 Bibliographic References 
 Add to: 
Automatic Lip-Contour Extraction and Mouth-Structure Segmentation in Images
May/June 2011 (vol. 13 no. 3)
pp. 22-30
Juan-Bernardo Gómez-Mendoza, National University of Colombia at Manizales, Manizales, Colombia
Flavio Prieto, National University of Colombia at Bogotá
Tanneguy Redarce, National Institute for Applied Sciences (INSA), Lyon, France

Lip-contour extraction has great potential for human-machine interface and communication systems, but most existing techniques are inappropriate for changing poses, malformations, or whole-mouth descriptions. A new mouth-structure segmentation methodology uses pixel color classification, segmentation refinement, and fitted region-of-interest clipping to improve the speed and accuracy of mouth-structure segmentation using standard database images.

1. N. Eveno, A. Caplier, and P.Y. Coulon, "Accurate and Quasi-Automatic Lip Tracking," IEEE Trans. Circuits and Systems for Video Technology, vol. 14, no. 5, 2004, pp. 706–715.
2. S. Alizadeh, R. Boostani, and V. Adapour, "Lip Feature Extraction and Reduction for HMM-Based Visual Speech Recognition Systems," Proc. Int'l Conf. Signal Processing, 2008, pp. 561–564.
3. A. Ceballos et al., "Robot Command Interface Using an Audio-Visual Speech Recognition System," Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, LNCS 5856, Springer Verlag, 2009, pp. 869–876.
4. J.A. Dargham, A. Chekima, and S. Omatu, "Lip Detection by the Use of Neural Networks," Artificial Life and Robotics, vol. 12, nos. 1-2, 2008, pp. 301–306.
5. J.S. Chang, E.Y. Kim, and S.H. Park, "Lip Contour Extraction Using Level Set Curve Evolution with Shape Constraint," Human-Computer Interaction/Intelligent Multimodal Interaction Environments, LNCS vol. 4552, Springer Verlag, 2007, pp. 583–588.
6. J.B. Gómez, F. Prieto, and T. Redarce, "Automatic Outer Lip Contour Extraction in Facial Images," Proc. Int'l Conf. Systems, Signal and Image Processing, 2010, pp. 336–339; paper.htm.
7. J.B. Gómez et al., "Real-Time Robot Manipulation Using Mouth Gestures in Facial Video Sequences," Proc. 2nd Int'l Conf. Advances in Brain, Vision, and Artificial Intelligence, LNCS 4729, Springer Verlag, 2007, pp. 224–233.
8. T. Wang and P. Shi, "Facial Components Detection with Boosting and Geometric Constraints," Proc. 18th Int'l Conf. Pattern Recognition, IEEE Press, 2006, pp. 446–449.
9. I. Matthews et al., "Extraction of Visual Features for Lipreading," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 2, 2002, pp. 198–213.
10. M. Saradadevi and P. Bajaj, "Driver Fatigue Detection Using Mouth and Yawning Analysis," Int'l J. Computer Science and Network Security, vol. 8, no. 6, 2008, pp. 183–188.
11. P.J. Phillips et al., "The Feret Evaluation Methodology for Face Recognition Algorithms," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, 2000, pp. 1090–1104.
12. P.J. Phillips et al., "The Feret Database and Evaluation Procedure for Face Recognition Algorithms," Image and Vision Computing, vol. 16, no. 5, 1998, pp. 295–306.

Index Terms:
Lip segmentation, lip-contour extraction, mouth segmentation, scientific computing
Juan-Bernardo Gómez-Mendoza, Flavio Prieto, Tanneguy Redarce, "Automatic Lip-Contour Extraction and Mouth-Structure Segmentation in Images," Computing in Science and Engineering, vol. 13, no. 3, pp. 22-30, May-June 2011, doi:10.1109/MCSE.2010.145
Usage of this product signifies your acceptance of the Terms of Use.