The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.04 - October-December (2011 vol.2)
pp: 175-191
Janyce Wiebe , University of Pittsburgh, Pittsburgh
Ellen Riloff , University of Utah, Salt Lake City
ABSTRACT
"Subjectivity analysis” systems automatically identify and extract information relating to attitudes, opinions, and sentiments from text. As more and more people make their opinions available on the Internet and as people increasingly consult the Internet to ascertain other people's opinions about products, political issues, and so on, the demand for effective subjectivity analysis systems continues to grow. Information extraction systems, which automatically identify and extract factual information relating to events of interest, remain critically important in this day and age of increasingly vast amounts of text available online. In this work, we discover that these research areas are mutually beneficial. Information extraction techniques may be used to learn informative clues of subjectivity. Then, by bootstrapping from a lexicon of subjectivity clues, we can build a subjective-objective sentence classifier that does not require annotated data as input. This classifier may then be used to improve information extraction performance, on data which have not been annotated for subjectivity, by improving precision.
INDEX TERMS
Natural language processing, text analysis.
CITATION
Janyce Wiebe, Ellen Riloff, "Finding Mutual Benefit between Subjectivity Analysis and Information Extraction", IEEE Transactions on Affective Computing, vol.2, no. 4, pp. 175-191, October-December 2011, doi:10.1109/T-AFFC.2011.19
REFERENCES
[1] P. Turney and M.L. Littman, “Measuring Praise and Criticism: Inference of Semantic Orientation from Association,” ACM Trans. Information Systems, vol. 21, no. 4, pp. 315-346, 2003.
[2] B. Pang, L. Lee, and S. Vaithyanathan, “Thumbs Up? Sentiment Classification Using Machine Learning Techniques,” Proc. Conf. Empirical Methods in Natural Language Processing, pp. 79-86, 2002.
[3] K. Dave, S. Lawrence, and D.M. Pennock, “Mining the Peanut Gallery: Opinion Extraction and Semantic Classification of Product Reviews,” Proc. 12th Int'l World Wide Web Conf., http:/www2003.org, 2003.
[4] T. Nasukawa and J. Yi, “Sentiment Analysis: Capturing Favorability Using Natural Language Processing,” Proc. Second Int'l Conf. Knowledge Capture, pp. 70-77, 2003.
[5] S. Morinaga, K. Yamanishi, K. Tateishi, and T. Fukushima, “Mining Product Reputations on the Web,” Proc. Eighth ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining, pp. 341-349, 2002.
[6] J. Yi, T. Nasukawa, R. Bunescu, and W. Niblack, “Sentiment Analyzer: Extracting Sentiments about a Given Topic Using Natural Language Processing Techniques,” Proc. Third IEEE Int'l Conf. Data Mining, pp. 427-434, 2003.
[7] E. Spertus, “Smokey: Automatic Recognition of Hostile Messages,” Proc. Eighth Ann. Conf. Innovative Applications of Artificial Intelligence, pp. 1058-1065, 1997.
[8] S.R. Das and M.Y. Chen, “Yahoo! for Amazon: Opinion Extraction from Small Talk on the Web,” Proc. Eighth Asia Pacific Finance Assoc. Ann. Conf., 2001.
[9] R. Tong, “An Operational System for Detecting and Tracking Opinions in On-Line Discussions,” Proc. SIGIR Workshop Operational Text Classification, pp. 1-6, 2001.
[10] H. Yu and V. Hatzivassiloglou, “Towards Answering Opinion Questions: Separating Facts from Opinions and Identifying the Polarity of Opinion Sentences,” Proc. Conf. Empirical Methods in Natural Language Processing, pp. 129-136, 2003.
[11] S. Patwardhan and E. Riloff, “A Unified Model of Phrasal and Sentential Evidence for Information Extraction,” Proc. Conf. Empirical Methods in Natural Language Processing, 2009.
[12] S. Patwardhan and E. Riloff, “Effective Information Extraction with Semantic Affinity Patterns and Relevant Regions,” Proc. Conf. Empirical Methods in Natural Language Processing, 2007.
[13] H. Chieu, H. Ng, and Y. Lee, “Closing the Gap: Learning-Based Information Extraction Rivaling Knowledge-Engineering Methods,” Proc. Ann. Meeting Assoc. for Computational Linguistics, 2003.
[14] E. Riloff, “Automatically Generating Extraction Patterns from Untagged Text,” Proc. 13th Nat'l Conf. Artificial Intelligence, pp. 1044-1049, 1996.
[15] S. Soderland, D. Fisher, J. Aseltine, and W. Lehnert, “CRYSTAL: Inducing a Conceptual Dictionary,” Proc. 14th Int'l Joint Conf. Artificial Intelligence, pp. 1314-1319, 1995.
[16] MUC-4 Proc., Proc. Fourth Message Understanding Conf., 1992.
[17] R. Grishman, S. Huttunen, and R. Yangarber, “Real-Time Event Extraction for Infectious Disease Outbreaks,” Proc. Human Language Technology Conf., 2002.
[18] MUC-7 Proc., Proc. Seventh Message Understanding Conf., 1998.
[19] R. Yangarber, R. Grishman, P. Tapanainen, and S. Huttunen, “Automatic Acquisition of Domain Knowledge for Information Extraction,” Proc. 18th Int'l Conf. Computational Linguistics, 2000.
[20] MUC-5 Proc., Proc. Fifth Message Understanding Conf., 1993.
[21] D. Freitag, “Toward General-Purpose Learning for Information Extraction,” Proc. 36th Ann. Meeting Assoc. for Computational Linguistics, 1998.
[22] D. Freitag and A. McCallum, “Information Extraction with HMM Structures Learned by Stochastic Optimization,” Proc. 17th Nat'l Conf. Artificial Intelligence, pp. 584-589, Aug. 2000.
[23] M.E. Califf and R.J. Mooney, “Relational Learning of Pattern-Match Rules for Information Extraction,” Proc. ACL Workshop Natural Language Learning, pp. 9-15, 1997.
[24] F. Ciravegna, “Adaptive Information Extraction from Text by Rule Induction and Generalisation,” Proc. 17th Int'l Joint Conf. Artificial Intelligence, 2001.
[25] V. Hatzivassiloglou and K. McKeown, “Predicting the Semantic Orientation of Adjectives,” Proc. 35th Ann. Meeting Assoc. for Computational Linguistics, pp. 174-181, 1997.
[26] J. Kamps and M. Marx, “Words with Attitude,” Proc. First Int'l WordNet Conf., pp. 332-341, 2002.
[27] T. General-Inquirer, http://www.wjh.harvard.edu/~inquirerspreadsheet_guide.htm , 2000.
[28] J. Wiebe and E. Riloff, “Creating Subjective and Objective Sentence Classifiers from Unannotated Texts,” Proc. Sixth Int'l Conf. Intelligent Text Processing and Computational Linguistics, pp. 486-497, 2005.
[29] K. Bloom, N. Garg, and S. Argamon, “Extracting Appraisal Expressions,” Proc. Human Language Technologies: Conf. North Am. Chapter of the Assoc. for Computational Linguistics, pp. 308-315, 2007.
[30] E. Riloff, J. Wiebe, and T. Wilson, “Learning Subjective Nouns Using Extraction Pattern Bootstrapping,” Proc. Seventh Conf. Natural Language Learning, pp. 25-32, 2003.
[31] E. Riloff and J. Wiebe, “Learning Extraction Patterns for Subjective Expressions,” Proc. Conf. Empirical Methods in Natural Language Processing, pp. 105-112, 2003.
[32] E. Riloff, J. Wiebe, and W. Phillips, “Exploiting Subjectivity Classification to Improve Information Extraction,” Proc. 20th Nat'l Conf. Artificial Intelligence, pp. 1106-1111, 2005.
[33] J. Wiebe, T. Wilson, and C. Cardie, “Annotating Expressions of Opinions and Emotions in Language,” Language Resources and Evaluation, vol. 39, nos. 2/3, pp. 165-210, 2005.
[34] M. Thelen and E. Riloff, “A Bootstrapping Method for Learning Semantic Lexicons Using Extraction Pattern Contexts,” Proc. Conf. Empirical Methods in Natural Language Processing, 2002.
[35] E. Riloff and R. Jones, “Learning Dictionaries for Information Extraction by Multi-Level Bootstrapping,” Proc. 16th Nat'l Conf. Artificial Intelligence, pp. 474-479, 1999.
[36] J. Wiebe, T. Wilson, and M. Bell, “Identifying Collocations for Recognizing Opinions,” Proc. ACL-01 Workshop Collocation: Computational Extraction, Analysis and Exploitation, pp. 24-31, 2001.
[37] J. Wiebe, T. Wilson, R. Bruce, M. Bell, and M. Martin, “Learning Subjective Language,” Computational Linguistics, vol. 30, no. 3, pp. 277-308, 2004.
[38] J. Wiebe and R. Mihalcea, “Word Sense and Subjectivity,” Proc. Int'l Conf. Computational Linguistics and 44th Ann. Meeting Assoc. for Computational Linguistics, 2006.
[39] T. Wilson, J. Wiebe, and P. Hoffmann, “Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis,” Proc. Human Language Technologies Conf./Conf. Empirical Methods in Natural Language Processing, pp. 347-354, 2005.
[40] H. Takamura, T. Inui, and M. Okumura, “Latent Variable Models for Semantic Orientations of Phrases,” Proc. 11th Meeting of the European Chapter of the Assoc. for Computational Linguistics, 2006.
[41] A. Andreevskaia and S. Bergler, “Sentiment Tag Extraction from Wordnet Glosses,” Proc. Fifth Int'l Conf. Language Resources and Evaluation, 2006.
[42] A. Esuli and F. Sebastiani, “Determining Term Subjectivity and Term Orientation for Opinion Mining,” Proc. 11th Meeting of the European Chapter Assoc. for Computational Linguistics, http://tcc.itc.it/projects/ontotext/Publications EACL-2006-Esuli-Sebast iani.pdf , 2006.
[43] B. Pang and L. Lee, “A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts,” Proc. 42nd Ann. Meeting Assoc. for Computational Linguistics, pp. 271-278, 2004.
[44] S.-M. Kim and E. Hovy, “Identifying and Analyzing Judgment Opinions,” Proc. Conf. Human Language Technology Conf. North Am. Assoc. for Computational Linguistics, pp. 200-207, http://www. aclweb.org/anthology/N/N06N06-1026 , 2006.
[45] P. Turney, “Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews,” Proc. 40th Ann. Meeting Assoc. for Computational Linguistics, pp. 417-424, 2002.
[46] M. Gamon and A. Aue, “Automatic Identification of Sentiment Vocabulary: Exploiting Low Association with Known Sentiment Terms,” Proc. ACL-05 Workshop Feature Eng. for Machine Learning in Natural Language Processing, 2005.
[47] H. Kanayama and T. Nasukawa, “Fully Automatic Lexicon Expansion for Domain-Oriented Sentiment Analysis,” Proc. Conf. Empirical Methods in Natural Language Processing, pp. 355-363, 2006.
[48] J. Wiebe and T. Wilson, “Learning to Disambiguate Potentially Subjective Expressions,” Proc. Sixth Conf. Natural Language Learning, pp. 112-118, 2002.
[49] H. Takamura, T. Inui, and M. Okumura, “Extracting Semantic Orientations of Phrases from Dictionary,” Proc. Human Language Technologies: Conf. North Am. Chapter Assoc. for Computational Linguistics, pp. 292-299, http://www.aclweb.org/anthology/N/N07N07-1037 , Apr. 2007.
[50] Y. Choi, C. Cardie, E. Riloff, and S. Patwardhan, “Identifying Sources of Opinions with Conditional Random Fields and Extraction Patterns,” Proc. Human Language Technologies Conf./Conf. Empirical Methods in Natural Language Processing, pp. 355-362, 2005.
[51] S.-M. Kim and E. Hovy, “Extracting Opinions, Opinion Holders and Topics Expressed in Online News Media Text,” Proc. ACL Workshop Sentiment and Subjectivity in Text, pp. 1-8, http://www.aclweb.org/anthology/W/W06W06-0301 , 2006.
[52] H. Takamura, T. Inui, and M. Okumura, “Extracting Semantic Orientations of Words Using Spin Model,” Proc. 43rd Ann. Meeting Assoc. for Computational Linguistics, http://acl.ldc.upenn.edu/P/P05P05-1017.pdf , 2005.
[53] T. Zagibalov and J. Carroll, “Automatic Seed Word Selection for Unsupervised Sentiment Classification of Chinese Text,” Proc. 22nd Int'l Conf. Computational Linguistics, pp. 1073-1080, http://www.aclweb.org/anthologyC08-1135, Aug. 2008.
[54] J. Blitzer, M. Dredze, and F. Pereira, “Biographies, Bollywood, Boom-Boxes and Blenders: Domain Adaptation for Sentiment Classification,” Proc. 45th Ann. Meeting Assoc. for Computational Linguistics, pp. 440-447, http://www.aclweb.org/anthology/P/P07P07-1056 , June 2007.
[55] A. Andreevskaia and S. Bergler, “When Specialists and Generalists Work Together: Overcoming Domain Dependence in Sentiment Tagging,” Proc. Ann. Meeting Assoc. for Computational Linguistics, pp. 290-298, http://www.aclweb.org/anthology/P/P08P08-1034 , 2008.
[56] W. Phillips and E. Riloff, “Exploiting Role-Identifying Nouns and Expressions for Information Extraction,” Proc. Int'l Conf. Recent Advances in Natural Language Processing, 2007.
[57] R. Bunescu and R. Mooney, “Collective Information Extraction with Relational Markov Networks,” Proc. 42nd Ann. Meeting Assoc. for Computational Linguistics, pp. 438-445, July 2004.
[58] J. Kim and D. Moldovan, “Acquisition of Semantic Patterns for Information Extraction from Corpora,” Proc. Ninth IEEE Conf. Artificial Intelligence for Applications, pp. 171-176, 1993.
[59] S. Huffman, “Learning Information Extraction Patterns from Examples,” Proc. Connectionist, Statistical and Symbolic Approaches to Learning for Natural Language Processing, S. Wermter, E. Riloff, and G. Scheler, eds., pp. 246-260, 1996.
[60] E. Riloff, “Automatically Constructing a Dictionary for Information Extraction Tasks,” Proc. 11th Nat'l Conf. Artificial Intelligence, pp. 811-816, 1993.
[61] M.E. Califf, “Relational Learning Techniques for Natural Language Information Extraction,” Technical Report AI98-276, Artificial Intelligence Laboratory, The Univ. of Texas at Austin, 1998.
[62] E. Agichtein and L. Gravano, “Snowball: Extracting Relations from Large Plain-Text Collections,” Proc. Fifth ACM Conf. Digital Libraries, pp. 85-94, June 2000.
[63] K. Sudo, S. Sekine, and R. Grishman, “An Improved Extraction Patterns Representation Model for Automatic IE Pattern Acquisition,” Proc. 41st Ann. Meeting Assoc. for Computational Linguistics, pp. 224-231, July 2003.
[64] A. Yakushiji, Y. Miyao, T. Ohta, Y. Tateisi, and J. Tsujii, “Construction of Predicate-Argument Structure Patterns for Biomedical Information Extraction,” Proc. Conf. Empirical Methods in Natural Language Processing, pp. 284-292, July 2006.
[65] A. Popescu, A. Yates, and O. Etzioni, “Class Extraction from the World Wide Web,” Proc. AAAI Workshop Adaptive Text Extraction and Mining, I. Muslea, ed., pp. 68-73, July 2004.
[66] B. Klebanov, K. Knight, and D. Marcu, “Text Simplification for Information Seeking Applications,” On the Move to Meaningful Internet Systems, pp. 735-747, Springer-Verlag, 2004.
[67] E. Riloff and W. Phillips, “An Introduction to the Sundance and AutoSlog Systems,” Technical Report UUCS-04-015, School of Computing, Univ. of Utah, 2004.
[68] B. Levin, English Verb Classes and Alternations: A Preliminary Investigation. Univ. of Chicago Press, 1993.
[69] T. Ballmer and W. Brennenstuhl, Speech Act Classification: A Study in the Lexical Analysis of English Speech Activity Verbs. Springer-Verlag, 1981.
[70] Framenet, http://www.icsi.berkeley.edu~framenet/, 2002.
[71] J. Wiebe, “Tracking Point of View in Narrative,” Computational Linguistics, vol. 20, no. 2, pp. 233-287, 1994.
[72] J. Wiebe, R. Bruce, and T. O'Hara, “Development and Use of a Gold Standard Data Set for Subjectivity Classifications,” Proc. 37th Ann. Meeting Assoc. for Computational Linguistics, pp. 246-253, 1999.
[73] T. Mitchell, Machine Learning. McGraw-Hill, 1997.
[74] J. Wiebe, R. Bruce, and T. O'Hara, “Development and Use of a Gold Standard Data Set for Subjectivity Classifications,” Proc. 37th Ann. Meeting Assoc. for Computational Linguistics, pp. 246-253, 1999.
[75] N. Hiroshima, S. Yamada, O. Furuse, and R. Kataoka, “Searching for Sentences Expressing Opinions by Using Declaratively Subjective Clues,” Proc. ACL Workshop Sentiment and Subjectivity in Text, pp. 39-46, http://www.aclweb.org/anthology/W/W06W06-0306 , 2006.
5 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool