Representative Segment-Based Emotion Analysis and Classification with Automatic Respiration Signal Segmentation
Issue No. 04 - Fourth Quarter (2012 vol. 3)
Chi-Jen Wang , National Cheng Kung University, Tainan
Pau-Choo (Julia) Chung , National Cheng Kung University , Tainan
Chi-Keng Wu , National Cheng Kung University, Tainan
Human respiration has been reported as having great relevance to the emotional state. However, the respiration signal obtained using traditional biosensors not only reflects changing emotions and emotion intensities, but also contains motion artifacts. The resulting information ambiguity limits the practical application of the respiration signal as a means of reliable affective state appraisal. Thus, the present study proposes a method for extracting representative Emotion Elicited Segments (EESs) from the respiration signal such that the affective state of the individual can be more reliably determined. The EES extraction process involves the combination of the following procedures, namely, 1) Mutual Information-Based Emotion Relevance Feature Ranking based on the Dynamic Time Warping Distance (MIDTW), and 2) Constraint-based Elicited Segment Density (CESD) analysis. Due to the innate regularity of the respiration signal, the respiration pattern under a particular emotional state would be relatively quasihomogeneous over time. Accordingly, a parameter-free Respiration quasi-Homogeneity Segmentation (RHS) algorithm is proposed for partitioning the respiration signal into quasi-homogenous segments from which the EESs can then be extracted. The experimental results obtained for five prototypical emotions (i.e., “love,” “sadness,” “joy,” “anger,” and “fear”) show that the proposed segmentation/extraction methodology enables the EESs to be reliably identified and yields an average classification rate of 88 percent.
Physiology, Feature extraction, Human factors, Motion segmentation, Algorithm design and analysis, Ethics, Partitioning algorithms, Emotion recognition, constraint-based clustering analysis, Segmentation algorithm, motion artifacts, emotion classification, dynamic time-warping, mutual information
Chi-Jen Wang, Pau-Choo (Julia) Chung, Chi-Keng Wu, "Representative Segment-Based Emotion Analysis and Classification with Automatic Respiration Signal Segmentation", IEEE Transactions on Affective Computing, vol. 3, no. , pp. 482-495, Fourth Quarter 2012, doi:10.1109/T-AFFC.2012.14