loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2006 IEEE International Conference on Multimedia and Expo
An Intelligent Guiding Bulletin Board System with Real-Time Vision and Multi-Keyword Spotting Multimedia Human-Computer Interaction
Toronto, ON, Canada
July 09-July 12
ISBN: 1-4244-0366-7
Cheng-yu Chang, Department of Electrical Engineering, National Cheng Kung University, No.1, Ta-Hsueh Road, Tainan 701, Taiwan
Chung-hsien Yang, Department of Electrical Engineering, National Cheng Kung University, No.1, Ta-Hsueh Road, Tainan 701, Taiwan
You-sheng Yeh, Department of Electrical Engineering, National Cheng Kung University, No.1, Ta-Hsueh Road, Tainan 701, Taiwan
Pau-choo Chung, Department of Electrical Engineering, National Cheng Kung University, No.1, Ta-Hsueh Road, Tainan 701, Taiwan
Jhing-fa Wang, Department of Electrical Engineering, National Cheng Kung University, No.1, Ta-Hsueh Road, Tainan 701, Taiwan
Jar-ferr Yang, Department of Electrical Engineering, National Cheng Kung University, No.1, Ta-Hsueh Road, Tainan 701, Taiwan
This paper presents an intelligent guiding bulletin board system (iGBBS), which is based on vision-interactive and multiple keyword-spotting technology. The system is aimed to provide different kinds of multimedia human-computer inter-action (MMHCI) for users under different requirements. At first, a real-time front-view face detection using Harr-like features is used to decide when iGBBS should wake up and become interactive with the user. After system initialization, some feature points within the detected face area are going to be found. Then the orientation of user's head will be estimated via pyramidal Lucas-Kanade optical flow tracking. In addition, spotting the keyword from user's utterance with some related augmented reality responses would be provided as well. The performance of vision-interaction in iGBBS could be reached to 20 fps under Pentium IV 1G Hz PC. The error rate of multiple keyword-spotting interaction in iGBBS is about 36.2% and people can get the right response in 2.76 times search averagely. With the comparison to the traditional guiding system, bulletin board, or other non-vision-based input devices system, such like gloves or markers, our system offers a simple, useful and economical solution for the realtime interaction between the user and computer.
Citation:
Cheng-yu Chang, Chung-hsien Yang, You-sheng Yeh, Pau-choo Chung, Jhing-fa Wang, Jar-ferr Yang, "An Intelligent Guiding Bulletin Board System with Real-Time Vision and Multi-Keyword Spotting Multimedia Human-Computer Interaction," icme, pp.421-424, 2006 IEEE International Conference on Multimedia and Expo, 2006
Usage of this product signifies your acceptance of the Terms of Use.