This Article 
 Bibliographic References 
 Add to: 
S. Cetintas, Dept. of Comput. Sci., Purdue Univ., West Lafayette, IN, USA
Luo Si, Dept. of Comput. Sci., Purdue Univ., West Lafayette, IN, USA
H. Aagard, Rosen Center for Adv. Comput., Purdue Univ., West Lafayette, IN, USA
K. Bowen, Rosen Center for Adv. Comput., Purdue Univ., West Lafayette, IN, USA
M. Cordova-Sanchez, Dept. of Comput. Sci., Purdue Univ., West Lafayette, IN, USA
Microblogging is a popular technology in social networking applications that lets users publish online short text messages (e.g., less than 200 characters) in real time via the web, SMS, instant messaging clients, etc. Microblogging can be an effective tool in the classroom and has lately gained notable interest from the education community. This paper proposes a novel application of text categorization for two types of microblogging questions asked in a classroom, namely relevant (i.e., questions that the teacher wants to address in the class) and irrelevant questions. Empirical results and analysis show that using personalization together with question text leads to better categorization accuracy than using question text alone. It is also beneficial to utilize the correlation between questions and available lecture materials as well as the correlation between questions asked in a lecture. Furthermore, empirical results also show that the elimination of stopwords leads to better correlation estimation between questions and leads to better categorization accuracy. On the other hand, incorporating students' votes on the questions does not improve categorization accuracy, although a similar feature has been shown to be effective in community question answering environments for assessing question quality.

[1] R. Baeza-Yates and B. Ribeiro-Neto, Modern Information Retrieval, pp. 75-82. Addison Wesley, 1999.
[2] Z. Baidu, http:/, Dec. 2010.
[3] K. Borau, C. Ullrich, J. Feng, and R. Shen, "Microblogging for Language Learning: Using Twitter to Train Communicative and Cultural Competence," Proc. Eighth Int'l Conf. Web Based Learning, pp. 78-87, 2009.
[4] S. Cetintas, L. Si, Xin, S. Chakravarty, H. Aagard, and K. Bowen, "Learning to Identify Students' Relevant and Irrelevant Questions in a Micro-Blogging Supported Classroom," Proc. 10th Intelligent Tutoring Systems (ITS '10) Conf., pp. 281-284, 2010.
[5] S. Cetintas, L. Si, Y.P. Xin, D. Zhang, and J.Y. Park, "Automatic Text Categorization of Mathematical Word Problems," Proc. 22nd Int'l FLAIRS Conf., pp. 27-32, 2009.
[6] J. Chen, R. Nairn, L. Nelson, M. Bernstein, and E. Chi, "Short and Tweet: Experiments on Recommending Content from Information Streams," Proc. 28th ACM Int'l Conf. Human Factors in Computing Systems, pp. 1185-1194, 2010.
[7] C. Costa, G. Beham, W. Reinhardt, and M. Sillaots, "Micro-Blogging in Technology Enhanced Learning: A Use-Case Inspection of PPE Summer School 2008," Proc. Workshop Social Information Retrieval for Technology Enhanced Learning, http://www.know download/1650/8519/file2008_ ccosta_microblogging.pdf , Dec. 2008.
[8] H. Duan, Y. Cao, C.-Y. Lin, and Y. Yu, "Searching Questions by Identifying Questions Topic and Question Focus," Proc. 46th ACL Conf., pp. 156-164, 2008.
[9] G. Grosseck and C. Holotescu, "Can We Use Twitter for Educational Activities?" Proc. Fourth Int'l Scientific Conf., eLearning and Software for Education, 2008.
[10] P. Han, R. Shen, F. Yang, and Q. Yang, "The Application of Case Based Reasoning on Q&A System," Proc. Australian Joint Conf. Artificial Intelligence, pp. 704-713, 2002.
[11] A. Java, X. Song, T. Finin, and B. Tseng, "Why We Twitter: Understanding Micro-Blogging Usage and Communities," Proc. Ninth WEBKDD Conf., pp. 56-65, 2007.
[12] J. Jeon, B. Croft, and J. Lee, "Finding Semantically Similar Questions Based on Their Answers," Proc. 28th ACM SIGIR Conf., pp. 617-618, 2005.
[13] J. Jeon, B. Croft, J. Lee, and S. Park, "A Framework to Predict the Quality of Answers with Non-Textual Features," Proc. 29th ACM SIGIR Conf. Research and Development in Information Retrieval, pp. 228-235, 2006.
[14] V. Jikoun and M. de Rijke, "Retrieving Answers from Frequently Asked Questions Pages on the Web," Proc. 14th ACM Int'l Conf. Information and Knowledge Management (CIKM '05), pp. 76-83, 2005.
[15] T. Joachims, "Text Categorization with Support Vector Machines: Learning with Many Relevant Features," Proc. 10th European Conf. Machine Learning (ECML '98), pp. 137-142, 1998.
[16] J. Keefer, "How to Use Twitter in Higher Education," 03/31how-to-use-twitter-in-highereducation , Mar. 2008.
[17] Lemur IR Toolkit, http:/, Dec. 2010.
[18] B. Li, Y. Liu, A. Ram, E. Garcia, and E. Agichtein, "Exploring Question Subjectivity Prediction in Community QA," Proc. 31st ACM SIGIR Conf. Research and Development in Information Retrieval, pp. 735-736, 2008.
[19] M. Michelson and S. Macskassy, "Discovering Users' Topics of Interest on Twitter: A First Look," Proc. Fourth Workshop Analytics for Noisy Unstructured Data in Conjunction with the 19th ACM CIKM Conf., 2010.
[20] M.F. Porter, "An Algorithm for Suffix Stripping," Program: Electronic Library and Information Systems, vol. 14, no. 3, pp. 130-137, 1980.
[21] S. Robertson, S.S. Walker Beaulieu, A. Gull, and M. Lau, "Okapi at TREC," Proc. First Text REtrieval Conf. (TREC '92), pp. 21-30, 1992.
[22] C.J.V. Rijsbergen, Information Retrieval, second ed. Univ. of Glasgow, 1979.
[23] F. Sebastiani, "Machine Learning in Automated Text Categorization," ACM Computing Surveys, vol. 34, no. 1, pp. 1-47, 2002.
[24] L. Soh, N. Khandaker, and H. Jiang, "I-MINDS: A Multiagent System for Intelligent Computer-Supported Collaborative Learning and Classroom Management," Int'l J. Artificial Intelligence in Education, vol. 18, no. 2, pp. 119-151, 2008.
[25] Y. Song, C. Cao, and H. Rim, "Question Utility: A Novel Static Ranking of Question Search," Proc. 23rd Nat'l Conf. Artificial Intelligence (AAAI '08), pp. 1231-1236, 2008.
[26] K. Sun, Y. Cao, X. Song, Y. Song, X. Wang, and C. Lion, "Learning to Recommend Questions Based on User Ratings," Proc. 18th ACM Conf. Information and Knowledge Management (CIKM '09), pp. 751-758, 2009.
[27] K.D. Sweetser, "Teaching Tweets," http:/www.kayesweetser. com, Dec. 2008.
[28] T.Y. Tang and G. Mccalla, "Smart Recommendation for an Evolving E-Learning System," Int'l J. E-Learning, vol. 4, no. 1, pp. 105-130, 2005.
[29] Twitter, http:/, Dec. 2010.
[30] C. Ullrich, K. Borau, H. Luo, X. Tan, L. Shen, and R. Shen, "Why Web 2.0 Is Good for Learning and for Research: Principles and Prototypes," Proc. 17th ACM Int'l Conf. World Wide Web (WWW '08), pp. 705-714, 2008.
[31] WikiAnswers, http:/, Dec. 2010.
[32] Yahoo! Answers, http:/, Dec. 2010.
[33] Y. Yang and X. Liu, "A Re-Examination of Text Categorization Methods," Proc. 22nd ACM SIGIR Conf. Research and Development in Information Retrieval, pp. 42-49, 1999.

Index Terms:
social networking (online),computer aided instruction,Internet,question quality assessment,microblogging-supported classroom,social networking applications,Web,SMS,online short text messages,instant messaging clients,education community,text categorization,microblogging questions,personalization,question text,correlation estimation,categorization accuracy,community question answering environments,Electronic publishing,Support vector machines,Social network services,Blogs,Text categorization,computer uses in education.,Education
S. Cetintas, Luo Si, H. Aagard, K. Bowen, M. Cordova-Sanchez, "Microblogging in a Classroom: Classifying Students' Relevant and Irrelevant Questions in a Microblogging-Supported Classroom," IEEE Transactions on Learning Technologies, vol. 4, no. 4, pp. 292-300, Oct.-Dec. 2011, doi:10.1109/TLT.2011.14
Usage of this product signifies your acceptance of the Terms of Use.