|
| This Article | ||
| ||
| Share | ||
| Bibliographic References | ||
| Add to: | ||
| | ||
| Search | ||
| ||
Second IEEE International Conference on Automatic Face and Gesture Recognition (FG '96)
Robust face feature analysis for automatic speechreading and character animation
Killington, Vermont
October 14-October 16
ISBN: 0-8186-7713-9
| ASCII Text | x | ||
| E. Petajan, H.P. Graf, "Robust face feature analysis for automatic speechreading and character animation," Automatic Face and Gesture Recognition, IEEE International Conference on, pp. 357, Second IEEE International Conference on Automatic Face and Gesture Recognition (FG '96), 1996. | |||
| BibTex | x | ||
| @article{ 10.1109/AFGR.1996.557291, author = {E. Petajan and H.P. Graf}, title = {Robust face feature analysis for automatic speechreading and character animation}, journal ={Automatic Face and Gesture Recognition, IEEE International Conference on}, volume = {0}, year = {1996}, isbn = {0-8186-7713-9}, pages = {357}, doi = {http://doi.ieeecomputersociety.org/10.1109/AFGR.1996.557291}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, } | |||
| RefWorks Procite/RefMan/Endnote | x | ||
| TY - CONF JO - Automatic Face and Gesture Recognition, IEEE International Conference on TI - Robust face feature analysis for automatic speechreading and character animation SN - 0-8186-7713-9 SP EP A1 - E. Petajan, A1 - H.P. Graf, PY - 1996 KW - speech recognition; robust face feature analysis; automatic speechreading; character animation; visual speech processing; machine vision system; inner lip contour; facial images; pose; lighting; facial hair; nostrils; synthetic face parameters; graphical talking head; visual speech features VL - 0 JA - Automatic Face and Gesture Recognition, IEEE International Conference on ER - | |||
The robust acquisition of facial features needed for visual speech processing is fraught with difficulties which greatly increase the complexity of the machine vision system. This system must extract the inner lip contour from facial images with variations in pose, lighting, and facial hair. This paper describes a face feature acquisition system with robust performance in the presence of extreme lighting variations and moderate variations in pose. Furthermore, system performance is not degraded by facial hair or glasses. To find the position of a face reliably we search the whole image for facial features. These features are then combined and tests are applied, to determine whether any such combination actually belongs to a face. In order to find where the lips are, other features of the face, such as the eyes, must be located as well. Without this information it is difficult to reliably find the mouth in a complex image. Just the mouth by itself is easily missed or other elements in the image can be mistaken for a mouth. If camera position can be constrained to allow the nostrils to be viewed, then nostril tracking is used to both reduce computation and provide additional robustness. Once the nostrils are tracked from frame to frame using a tracking window the mouth area can be isolated and normalized for scale and rotation. A mouth detail analysis procedure is then used to estimate the inner lip contour and teeth and tongue regions. The inner lip contour and head movements are then mapped to synthetic face parameters to generate a graphical talking head synchronized with the original human voice. This information can also be used as the basis for visual speech features in an automatic speechreading system. Similar features were used in our previous automatic speechreading systems.
Index Terms:
speech recognition; robust face feature analysis; automatic speechreading; character animation; visual speech processing; machine vision system; inner lip contour; facial images; pose; lighting; facial hair; nostrils; synthetic face parameters; graphical talking head; visual speech features
Citation:
E. Petajan, H.P. Graf, "Robust face feature analysis for automatic speechreading and character animation," fg, pp.357, Second IEEE International Conference on Automatic Face and Gesture Recognition (FG '96), 1996
Usage of this product signifies your acceptance of the Terms of Use.
