2006 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Workshops
Towards a Multimodal Framework for Human Behavior Recognition
Hong Kong, China
December 18-December 22
ISBN: 0-7695-2749-3
This paper proposes a framework of an interface that is capable of detecting and classifying human intentions and personality types. The framework relies on a conventional set of multimodal components, namely an eye-tracking system, a mouse and a keyboard, where a large number of real time data analysis will take place, in order to detect behavioral patterns. The system gradually learns from the players and builds a collection of patterns of actions. The personalities of the players are detected through ontological comparisons of known personality types with the newly discovered patterns of actions. We further layout the ground of our initial assumption -- appearing in other publications, that the sub-conscious controls the eyes movements during the game, on those elements or words that are related to the fears and desire, i.e., the personality of the player.
Index Terms:
Intention analysis, Eye-tracking, serious games, Multimodality.
Citation:
Sidi O. Soueina, Jocelyne Kiss, Pascal Chaudeyrac, Patrice Bouvier, Ahmed H. Salem, Adel S. Elmaghraby, "Towards a Multimodal Framework for Human Behavior Recognition," wi-iatw, pp.27-31, 2006 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Workshops, 2006