The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - Jan.-March (2013 vol.4)
pp: 106-115
Georgios Paltoglou , University of Wolverhampton, Wolverhampton
Mathias Theunis , Jacobs University Bremen, Bremen
Arvid Kappas , Jacobs University Bremen, Bremen
Mike Thelwall , University of Wolverhampton, Wolverhampton
ABSTRACT
Most sentiment analysis approaches deal with binary or ordinal prediction of affective states (e.g., positive versus negative) on review-related content from the perspective of the author. The present work focuses on predicting the emotional responses of online communication in nonreview social media on a real-valued scale on the two affective dimensions of valence and arousal. For this, a new dataset is introduced, together with a detailed description of the process that was followed to create it. Important phenomena such as correlations between different affective dimensions and intercoder agreement are thoroughly discussed and analyzed. Various methodologies for automatically predicting those states are also presented and evaluated. The results show that the prediction of intricate emotional states is possible, obtaining at best a correlation of 0.89 for valence and 0.42 for arousal with the human assigned assessments.
INDEX TERMS
Human factors, Psychology, Sentiment analysis, Predictive models, ANEW, Human factors, Psychology, Sentiment analysis, Predictive models, human annotation, Sentiment analysis, valence, arousal
CITATION
Georgios Paltoglou, Mathias Theunis, Arvid Kappas, Mike Thelwall, "Predicting Emotional Responses to Long Informal Text", IEEE Transactions on Affective Computing, vol.4, no. 1, pp. 106-115, Jan.-March 2013, doi:10.1109/T-AFFC.2012.26
REFERENCES
[1] B. Pang and L. Lee, "Opinion Mining and Sentiment Analysis," Foundations and Trends in Information Retrieval, vol. 2, nos. 1/2, pp. 1-135, 2008.
[2] A. Chmiel, J. Sienkiewicz, M. Thelwall, G. Paltoglou, K. Buckley, A. Kappas, and J.A. Holyst, "Collective Emotions Online and Their Influence on Community Life," PLoS ONE, vol. 6, no. 7, pp. 1-8, 2011.
[3] J. Berger and K.L. Milkman, "What Makes Online Content Viral?" J. Marketing Research, vol. 49, no. 2, pp. 192-205, 2012.
[4] R.A. Calvo and S. D'Mello, "Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications," IEEE Trans. Affective Computing, vol. 1, no. 1, pp. 18-37, Jan.-June 2010.
[5] L.F. Barrett and J.A. Russell, "The Structure of Current Affect: Controversies and Emerging Consensus," Current Directions in Psychological Science, vol. 8, no. 1, pp. 10-14, 1999.
[6] J.A. Russell, "Emotion, Core Affect, and Psychological Construction," Cognition and Emotion, vol. 23, no. 7, pp. 1259-1283, 2009.
[7] C. Whitelaw, N. Garg, and S. Argamon, "Using Appraisal Groups for Sentiment Analysis," Proc. 14th ACM Int'l Conf. Information and Knowledge Management, pp. 625-631, 2005.
[8] M. Hu and B. Liu, "Mining and Summarizing Customer Reviews," Proc. 10th ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining, pp. 168-177, 2004.
[9] B. Pang and L. Lee, "Seeing Stars: Exploiting Class Relationships for Sentiment Categorization with Respect to Rating Scales," Proc. 43rd Ann. Meeting Assoc. for Computational Linguistics, pp. 115-124, 2005.
[10] B. Pang and L. Lee, Opinion Mining and Sentiment Analysis. Now Publishers, Inc., 2008.
[11] M. Thelwall, K. Buckley, G. Paltoglou, D. Cai, and A. Kappas, "Sentiment Strength Detection in Short Informal Text," J. Am. Soc. Information Science and Technology, vol. 61, pp. 2544-2558, Dec. 2010.
[12] M. Francis, J. Pennebaker, and R. Booth, Linguistic Inquiry and Word Count: LIWC, second ed. Erlbaum Publishers, 2001.
[13] A. Neviarouskaya, H. Prendinger, and M. Ishizuka, "Textual Affect Sensing for Sociable and Expressive Online Communication," Proc. Second Int'l Conf. Affective Computing and Intelligent Interaction, pp. 218-229, 2007.
[14] C. Strapparava and A. Valitutti, "WordNet-Affect: An Affective Extension of Wordnet," Proc. Fourth Int'l Conf. Language Resources and Evaluation, vol. 4, pp. 1083-1086, 2004.
[15] C.E. Izard, Human Emotions, C.E. Izard, ed. Plenum Press, 1977.
[16] J.A. Russell, "Core Affect and the Psychological Construction of Emotion," Psychological Rev., vol. 110, no. 1, pp. 145-172, 2003.
[17] P. Kuppens, Z. Oravecz, and F. Tuerlinckx, "Feelings Change: Accounting for Individual Differences in the Temporal Dynamics of Affect," J. Personality and Social Psychology, vol. 99, no. 6, pp. 1042-1060, 2010.
[18] P. Lewis, H. Critchley, P. Rotshtein, and R. Dolan, "Neural Correlates of Processing Valence and Arousal in Affective Words," Cerebral Cortex, vol. 17, no. 3, pp. 742-748, 2007.
[19] J. Posner, J.A. Russell, and B.S. Peterson, "The Circumplex Model of Affect: An Integrative Approach to Affective Neuroscience, Cognitive Development, and Psychopathology," Development and Psychopathology, vol. 17, no. 3, pp. 715-734, 2005.
[20] G. Mishne, "Experiments with Mood Classification in Blog Posts," Proc. First Workshop Stylistic Analysis of Text For Information Access, 2005.
[21] A.D. Kramer, "An Unobtrusive Behavioral Model of 'Gross National Happiness'," Proc. 28th Int'l Conf. Human Factors in Computing Systems, pp. 287-290, 2010.
[22] M.M. Bradley and P.J. Lang, "Affective Norms for English Words (ANEW): Stimuli, Instruction Manual, and Affective Ratings," technical report, Center for Research in Psychophysiology, Univ. of Florida, Gainesville, 1999.
[23] A.C. Graesser, M. Singer, and T. Trabasso, "Constructing Inferences during Narrative Text Comprehension," Psychological Rev., vol. 101, no. 3, pp. 371-395, 1994.
[24] M. Vega, I. Leon, and J. Diaz, "The Representation of Changing Emotions in Reading Comprehension," Cognition and Emotion, vol. 10, no. 20, pp. 303-322, May 1996.
[25] M.M. Bradley, M. Codispoti, B.N. Cuthbert, and P.J. Lang, "Emotion and Motivation I: Defensive and Appetitive Reactions in Picture Processing," Emotion, vol. 1, no. 3, pp. 276-298, Sept. 2001.
[26] J. Redondo, I. Fraga, I. Padrn, and M. Comesaa, "The Spanish Adaptation of Anew (Affective Norms for English Words)," Behavior Research Methods, vol. 39, pp. 600-605, 2007.
[27] M.L.-H. Votilde, M. Conrad, L. Kuchinke, K. Urton, M.J. Hofmann, and A.M. Jacobs, "The Berlin Affective Word List Reloaded (Bawl-r)," Behavior Research Methods, vol. 41, no. 2, pp. 534-538, 2009.
[28] J. Blitzer, M. Dredze, and F. Pereira, "Biographies, Bollywood, Boom-Boxes and Blenders: Domain Adaptation for Sentiment Classification," Proc. 45th Ann. Meeting Assoc. for Computational Linguistics, pp. 440-447, http://www.aclweb.org/anthologyP07-1056, June 2007.
[29] J. Blitzer, R. McDonald, and F. Pereira, "Domain Adaptation with Structural Correspondence Learning," Proc. Conf. Empirical Methods in Natural Language Processing, pp. 120-128, http://dl.acm. orgcitation.cfm?id=1610075.1610094 , 2006.
[30] A. Esuli and F. Sebastiani, "Pageranking Wordnet Synsets: An Application to Opinion Mining," Proc. 45th Ann. Meeting Assoc. for Computational Linguistics. pp. 424-431, June 2007.
[31] A. Hassan and D. Radev, "Identifying Text Polarity Using Random Walks," Proc. 48th Ann. Meeting Assoc. for Computational Linguistics, pp. 395-403, 2010.
[32] H. Takamura, T. Inui, and M. Okumura, "Extracting Semantic Orientations of Words Using Spin Model," Proc. 43rd Ann. Meeting Assoc. for Computational Linguistics, pp. 133-140, 2005.
[33] S. Baccianella, A. Esuli, and F. Sebastiani, "Sentiwordnet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining," Proc. Seventh Conf. Int'l Language Resources and Evaluation, May 2010.
[34] P.J. Stone, D.C. Dunphy, M.S. Smith, and D.M. Ogilvie, The General Inquirer: A Computer Approach to Content Analysis. MIT Press, 1966.
[35] A. Neviarouskaya, H. Prendinger, and M. Ishizuka, "Textual Affect Sensing for Sociable and Expressive Online Communication," Proc. Second Int'l Conf. Affective Computing and Intelligent Interaction, pp. 218-229, 2007.
[36] J.T. Larsen, C.J. Norris, and J.T. Cacioppo, "Effects of Positive and Negative Affect on Electromyographic Activity over Zygomaticus Major and Corrugator Supercilii," Psychophysiology, vol. 40, no. 5, pp. 776-785, 2003.
[37] J.D. Herrington, W. Heller, A. Mohanty, A.S. Engels, M.T. Banich, A.G. Webb, and G.A. Miller, "Localization of Asymmetric Brain Function in Emotion and Depression," Psychophysiology, vol. 47, no. 3, pp. 442-454, 2010.
[38] S. Hamann and H. Mao, "Positive and Negative Emotional Verbal Stimuli Elicit Activity in the Left Amygdala," NeuroReport, vol. 13, no. 1, pp. 15-19, 2002.
[39] S. Gonzalez-Bailon, R.E. Banchs, and A. Kaltenbrunner, "Emotional Reactions and the Pulse of Public Opinion: Measuring the Impact of Political Events on the Sentiment of Online Discussions," J. Computing Research Repository, vol. abs/1009.4019, 2010.
[40] P. Dodds and C. Danforth, "Measuring the Happiness of Large-Scale Written Expression: Songs, Blogs, and Presidents," J. Happiness Studies, vol. 11, no. 4, pp. 441-456, Aug. 2010.
[41] A. Mislove, S. Lehmann, Y.-Y. Ahn, and J.-P. Onnela, "Pulse of the Nation: US Mood throughout the Day Inferred from Twitter," http://www.ccs.neu.edu/home/amislovetwittermood /, 2010.
[42] R. Mihalcea and H. Liu, "A Corpus-Based Approach to Finding Happiness," Proc. Spring Symposia Computational Approaches to Analyzing Weblogs, 2006.
[43] J.F. Bonnans, J.C. Gilbert, C. Lemaréchal, and C.A. Sagastizábal, Numerical Optimization: Theoretical and Practical Aspects (Universitext). Springer-Verlag, 2006.
[44] S. Gobron, J. Ahn, G. Paltoglou, M. Thelwall, and D. Thalmann, "From Sentence to Emotion: A Real-Time Three-Dimensional Graphics Metaphor of Emotions Extracted from Text," Visual Computer, vol. 26, pp. 505-519, June 2010.
[45] M. Mitrović, G. Paltoglou, and B. Tadić, "Quantitative Analysis of Bloggers' Collective Behavior Powered by Emotions," J. Statistical Mechanics: Theory and Experiment, vol. 2011, no. 2, pp. P02005, Feb. 2011.
[46] A. Chmiel, J. Sienkiewicz, M. Thelwall, G. Paltoglou, K. Buckley, A. Kappas, and J.a. Hoyst, "Collective Emotions Online and Their Influence on Community Life," PLoS ONE, vol. 6, no. 7, p. e22207, July 2011.
[47] G. Siegle, "The Balanced Affective Word List Creation Program," http://www.sci.sdsu.edu/CALwordlist/, 1999.
[48] B. Pang, L. Lee, and S. Vaithyanathan, "Thumbs Up?: Sentiment Classification Using Machine Learning Techniques," Proc. ACL Conf. Empirical Methods in Natural Language Processing, pp. 79-86, vol. 10, http://dx.doi.org/10.31151118693.1118704 , 2002.
[49] B.B. Klebanov, E. Beigman, and D. Diermeier, "Vocabulary Choice as An Indicator of Perspective," Proc. ACL Conf. Short Papers, pp. 253-257, http://dl.acm.orgcitation.cfm?id=1858842.1858889 , 2010.
[50] R. Morante, A. Liekens, and W. Daelemans, "Learning the Scope of Negation in Biomedical Texts," Proc. Conf. Empirical Methods in Natural Language Processing, pp. 715-724, http://dl.acm.orgcitation.cfm?id=1613715.1613805 , 2008.
[51] L. Jia, C. Yu, and W. Meng, "The Effect of Negation on Sentiment Analysis and Retrieval Effectiveness," Proc. 18th ACM Conf. Information and Knowledge Management, pp. 1827-1830, http://doi.acm.org/10.11451645953.1646241 , 2009.
[52] K. Gimpel, N. Schneider, B. O'Connor, D. Das, D. Mills, J. Eisenstein, M. Heilman, D. Yogatama, J. Flanigan, and N.A. Smith, "Part-of-Speech Tagging for Twitter: Annotation, Features, and Experiments," Proc. 49th Ann. Meeting Assoc. for Computational Linguistics, pp. 42-47, 2011.
[53] A. Kappas, D. Kuester, M. Theunis, and E. Tsankova, "Cyberemotions: Subjective and Physiological Responses to Reading Online Discussion Forums," Proc. Soc. Psychophysiological Research Abstracts for the 50th Ann. Meeting, p. S101, 2010.
31 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool