5th ACIS International Conference on Software Engineering Research, Management & Applications (SERA 2007) A Pattern Recognition-Based Multi-Modal HCI Using 3 Sensory Channels Haeundae Grand Hotel, Busan, South Korea August 20-August 22 ISBN: 0-7695-2867-8
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/SERA.2007.23
This paper describes a PDA-based MMCR (Multi- Modal Command Recognizer for PDA control and handling) using double-touching with a finger by coupling embedded speech and KSSL recognizer, and suggests an improved synchronization method between multi-modalities for simultaneous multi-modality, for a pattern recognition-based neo multi-modal HCI. The MMCR fuses and recognizes 16 word-based command models that are represented by stylus, speech and KSSL (Korean Standard Sign Language), and then translates the recognition result into synthetic speech and visual illustration, for multi-modal PDA handling and interaction.
Citation:
Jung-Hyun Kim, Kue-Bum Lee, Kwang-Seok Hong, "A Pattern Recognition-Based Multi-Modal HCI Using 3 Sensory Channels," sera, pp.743-750, 5th ACIS International Conference on Software Engineering Research, Management & Applications (SERA 2007), 2007 Usage of this product signifies your acceptance of the Terms of Use. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||