The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - Jan.-March (2013 vol.4)
pp: 116-123
Georgios Paltoglou , University of Wolverhampton, Wolverhampton
Michael Thelwall , University of Wolverhampton, Wolverhampton
ABSTRACT
Sentiment analysis is a growing field of research, driven by both commercial applications and academic interest. In this paper, we explore multiclass classification of diary-like blog posts for the sentiment dimensions of valence and arousal, where the aim of the task is to predict the level of valence and arousal of a post on a ordinal five-level scale, from very negative/low to very positive/high, respectively. We show how to map discrete affective states into ordinal scales in these two dimensions, based on the psychological model of Russell's circumplex model of affect and label a previously available corpus with multidimensional, real-valued annotations. Experimental results using regression and one-versus-all approaches of support vector machine classifiers show that although the latter approach provides better exact ordinal class prediction accuracy, regression techniques tend to make smaller scale errors.
INDEX TERMS
Mood, Sentiment analysis, Data mining, Algorithm design and analysis, Predictive models, sentiment analysis, Mood, Sentiment analysis, Data mining, Algorithm design and analysis, Predictive models, affect detection, Mining methods and algorithms
CITATION
Georgios Paltoglou, Michael Thelwall, "Seeing Stars of Valence and Arousal in Blog Posts", IEEE Transactions on Affective Computing, vol.4, no. 1, pp. 116-123, Jan.-March 2013, doi:10.1109/T-AFFC.2012.36
REFERENCES
[1] R. Quirk, S. Greenbaum, G. Leech, and J. Svartvik, A Comprehensive Grammar of the English Language. Longman, 1985.
[2] J. Wiebe, "Learning Subjective Adjectives from Corpora," Proc. Nat'l Conf. Artificial Intelligence (AAAI '00), pp. 735-740, 2000.
[3] J. Wiebe, T. Wilson, R. Bruce, M. Bell, and M. Martin, "Learning Subjective Language," Computational Linguistics, vol. 30, pp. 277-308, Sept. 2004.
[4] B. Pang and L. Lee, "A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts," Proc. 42nd Ann. Meeting Assoc. Computational Linguistics (ACL '04), pp. 271-278, 2004.
[5] L. Lee and B. Pang, "Seeing Stars: Exploiting Class Relationships for Sentiment Categorization with Respect to Rating Scales," Proc. Ann. Meeting Assoc. Computational Linguistics (ACL '05), pp. 115-124, 2005.
[6] T. Wilson, J. Wiebe, and P. Hoffmann, "Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis," Proc. Conf. Human Language Technology and Empirical Methods in Natural Language Processing (HLT/EMNLP '05), 2005.
[7] T. Wilson, P. Hoffmann, S. Somasundaran, J. Kessler, J. Wiebe, Y. Choi, C. Cardie, E. Riloff, and S. Patwardhan, "Opinionfinder: A System for Subjectivity Analysis," Proc. Conf. Human Language Technology and Empirical Methods in Natural Language Processing (HLT/EMNLP '05), pp. 34-35, 2005.
[8] A.B. Goldberg and X. Zhu, "Seeing Stars When There Aren't Many Stars: Graph-Based Semi-Supervised Learning for Sentiment Categorization," Proc. First Workshop Graph Based Methods for Natural Language Processing (TextGraphs '06), pp. 45-52, 2006.
[9] K. Shimada and T. Endo, "Seeing Several Stars: A Rating Inference Task for a Document Containing Several Evaluation Criteria," Proc. 12th Pacific-Asia Conf. Advances in Knowledge Discovery and Data Mining (PAKDD '08), pp. 1006-1014, 2008.
[10] M. Thelwall, K. Buckley, G. Paltoglou, C. Di, and A. Kappas, "Sentiment Strength Detection in Short Informal Text," J. Am. Soc. Information Science Technology, vol. 61, no. 12, pp. 2544-2558, 2010.
[11] A.J. Russell, "A Circumplex Model of Affect," J. Personality and Social Psychology, vol. 39, no. 6, pp. 1161-1178, 1980.
[12] L.F. Barrett and J.A. Russell, "The Structure of Current Affect: Controversies and Emerging Consensus," Current Directions in Psychological Science, vol. 8, no. 1, pp. 10-14, 1999.
[13] M. Bradley and P. Lang, "Affective Norms for English Words (Anew): Stimuli, Instruction Manual and Affective Ratings," technical report, 1999.
[14] B. Pang, L. Lee, and S. Vaithyanathan, "Thumbs Up? Sentiment Classification Using Machine Learning Techniques," Proc. Conf. Empirical Methods in Natural Language Processing (EMNLP '02), 2002.
[15] O. Zaidan, J. Eisner, and C. Piatko, "Using 'Annotator Rationales' to Improve Machine Learning for Text Categorization," Proc. Human Language Technologies: Conf. North Am. Chapter Assoc. for Computational Linguistics (NAACL HLT '07), pp. 260-267, 2007.
[16] G. Paltoglou and M. Thelwall, "A Study of Information Retrieval Weighting Schemes for Sentiment Analysis," Proc. Ann. Meeting Assoc. for Computational Linguistics (ACL '10), pp. 1386-1395, 2010.
[17] G. Mishne, "Experiments with Mood Classification in Blog Posts," Proc. First Workshop Stylistic Analysis Text Information Access, 2005.
[18] H. Takamura, T. Inui, and M. Okumura, "Extracting Semantic Orientations of Words Using Spin Model," Proc. Ann. Meeting Assoc. for Computational Linguistics (ACL '05), pp. 133-140, 2005.
[19] S. Baccianella, A. Esuli, and S. Fabrizio, "Sentiwordnet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining," Proc. Seventh Conf. Int'l Language Resources and Evaluation (LREC '10), 2010.
[20] A. Hassan and D.R. Radev, "Identifying Text Polarity Using Random Walks," Proc. Ann. Meeting Assoc. for Computational Linguistics (ACL '10), pp. 395-403, 2010.
[21] C. Strapparava and A. Valitutti, "WordNet-Affect: An Affective Extension of WordNet," Proc. Conf. Int'l Language Resources and Evaluation ((LREC '04), pp. 1083-1086, 2004.
[22] P.J. Stone, D.C. Dunphy, M.S. Smith, and D.M. Ogilvie, The General Inquirer: A Computer Approach to Content Analysis. MIT Press, 1966.
[23] G. Paltoglou and M. Thelwall, "Twitter, Myspace, Digg: Unsupervised Sentiment Analysis in Social Media," ACM Trans. Intelligent Systems and Technology, vol. 3, no. 4, pp. 1-20, 2012.
[24] A. Neviarouskaya, H. Prendinger, and M. Ishizuka, "Textual Affect Sensing for Sociable and Expressive Online Communication," Proc. Second Int'l Conf. Affective Computing and Intelligent Interaction (ACII '07), pp. 218-229, 2007.
[25] F.M. Pennebaker J. and B.R., Linguistic Inquiry and Word Count: LIWC, second ed. Erlbaum, 2001.
[26] C.E. Izard, Human Emotions, Carroll E. Izard, ed. Plenum Press, 1977.
[27] H. Liu, H. Lieberman, and T. Selker, "A Model of Textual Affect Sensing Using Real-World Knowledge," Proc. Int'l Conf. Intelligent User Interfaces (IUI '03), pp. 125-132, 2003.
[28] P. Ekman and H. Oster, "Facial Expressions of Emotion," Ann. Rev. Psychology, vol. 30, no. 1, pp. 527-554, 1979.
[29] P. Singh, "The Public Acquisition of Commonsense Knowledge," Proc. AAAI Spring Symp. Acquiring (and Using) Linguistic (and World) Knowledge for Information Access, 2001.
[30] C. Strapparava and R. Mihalcea, "Semeval-2007 Task 14: Affective Text," Proc. Fourth Int'l Workshop Semantic Evaluations (SemEval '07), pp. 70-74, 2007.
[31] J.A. Russell, "Emotion, Core Affect, and Psychological Construction," Cognition and Emotion, vol. 23, no. 7, pp. 1259-1283, 2009.
[32] R.A. Calvo and S. D'Mello, "Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications," IEEE Trans. Affecting Computing, vol. 1, no. 1, pp. 18-37, Jan.-June 2010.
[33] S. Gobron, J. Ahn, G. Paltoglou, M. Thelwall, and D. Thalmann, "From Sentence to Emotion: A Real-Time Three-Dimensional Graphics Metaphor of Emotions Extracted from Text," Visual Computer, vol. 26, pp. 505-519, June 2010.
[34] B. Pang and L. Lee, Opinion Mining and Sentiment Analysis. Now Publishers, 2008.
[35] A.J. Smola and B. Schölkopf, "A Tutorial on Support Vector Regression," Statistics and Computing, vol. 14, pp. 199-222, 2004.
[36] C.-C. Chang and C.-J. Lin, LIBSVM: A Library for Support Vector Machines, http://www.csie.ntu.edu.tw/cjlinlibsvm, 2001.
[37] K. Crammer and Y. Singer, "On the Algorithmic Implementation of Multiclass Kernel-Based Vector Machines," J. Machine Learning Research, vol. 2, pp. 265-292, Mar. 2002.
[38] R. Rifkin and A. Klautau, "In Defense of One-vs-All Classification," J. Machine Learning Research, vol. 5, pp. 101-141, Dec. 2004.
[39] R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, "LIBLINEAR: A Library for Large Linear Classification," J. Machine Learning Research, vol. 9, pp. 1871-1874, 2008.
[40] S.S. Keerthi, S. Sundararajan, K.-W. Chang, C.-J. Hsieh, and C.-J. Lin, "A Sequential Dual Method for Large Scale Multi-Class Linear SVMs," Proc. ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (KDD '08), pp. 408-416, 2008.
[41] G. Paltoglou, M. Thelwall, and K. Buckely, "Online Textual Communication Annotated with Grades of Emotion Strength," Proc. Third Int'l Workshop Emotion, pp. 25-31, May 2010.
[42] R.E. Thayer, The Biopsychology of Mood and Arousal. Oxford Univ. Press, 1989.
[43] K.R. Scherer, "What Are Emotions? And How Can They Be Measured?" Social Science Information, vol. 44, no. 4, pp. 695-729, 2005.
[44] J.A. Russell, "Pancultural Aspects of the Human Conceptual Organization of Emotions," J. Personality and Social Psychology, vol. 45, no. 6, pp. 1281-1288, 1983.
[45] L.F. Barrett and J.A. Russell, "Independence and Bipolarity in the Structure of Current Affect," J. Personality and Social Psychology, vol. 74, no. 4, pp. 967-984, 1998.
[46] J. Ahn, S. Gobron, Q. Silvestre, and D. Thalmann, "Asymmetrical Facial Expressions Based on an Advanced Interpretation of Two-Dimensional Russell's Emotional Model," Proc. ENGAGE Conf., pp. 1-12, 2010.
[47] M. Thelwall, K. Buckley, and G. Paltoglou, "Sentiment in Twitter Events," J. Am. Soc. Information Science Technology, vol. 62, no. 2, pp. 406-418, Feb. 2011.
[48] A. Garas, D. Garcia, M. Skowron, and F. Schweitzer, "Emotional Persistence in Online Chatting Communities," Scientific Reports, vol. 2, article 402, 2012.
[49] J.R. Quinlan, C4.5: Programs for Machine Learning, first ed. Morgan Kaufmann, Jan. 1993.
[50] I.H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations, first ed. Morgan Kaufmann, 1999.
21 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool