loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Fourth IEEE International Conference on Multimodal Interfaces (ICMI'02)
Hand Gesture Symmetric Behavior Detection and Analysis in Natural Conversation
Pittsburgh, Pennsylvania
October 14-October 16
ISBN: 0-7695-1834-6
Yingen Xiong, Wright State University
Francis Quek, Wright State University
David McNeill, University of Chicago
We present an experimental investigation into the phenomenon of gestural symmetry for two-handed gestures accompanying speech. We describe an approach to compute hand motion symmetries based on the correlation computations. Local symmetries are detected using a windowing operation. We demonstrate that the selection of a smaller window size results in better sensitivity to local symmetries at the expense of noise in the form of spurious symmetries and ?symmetry dropoffs?. Our algorithmapplies a ?hole filling? post process to address these detection problems. We examine the role of the detected motion symmetries of two-handed gestures in the structuring of speech. We compared discourse segments corresponding to extracted symmetries in two natural conversations against a discourse analysis by expert psycholinguistic coders. These comparisons illustrate the effectiveness of the symmetry feature for the under-standing of underlying discourse structure. We believe that this basic characteristic of two-handed gestures accompanying speech must be incorporated in any multimodal interaction system involving two-handed gestures and speech.
Citation:
Yingen Xiong, Francis Quek, David McNeill, "Hand Gesture Symmetric Behavior Detection and Analysis in Natural Conversation," icmi, pp.179, Fourth IEEE International Conference on Multimodal Interfaces (ICMI'02), 2002
Usage of this product signifies your acceptance of the Terms of Use.