2017 IEEE/ACS 14th International Conference on Computer Systems and Applications (AICCSA) (2017)
Oct. 30, 2017 to Nov. 3, 2017
The focus of this study is to evaluate the impact of linguistic preprocessing and similarity functions for clustering Arabic Twitter tweets. The experiments apply an optimized version of the standard K-Means algorithm to assign tweets into positive and negative categories. The results show that root-based stemming has a significant advantage over light stemming in all settings. The Averaged Kullback-Leibler Divergence similarity function clearly outperforms the Cosine, Pearson Correlation, Jaccard Coefficient and Euclidean functions. The combination of the Averaged Kullback-Leibler Divergence and root-based stemming achieved the highest purity of 0.764 while the second-best purity was 0.719. These results are of importance as it is contrary to normal-sized documents where, in many information retrieval applications, light stemming performs better than root-based stemming and the Cosine function is commonly used.
information retrieval, pattern clustering, sentiment analysis, social networking (online)
D. Abuaiadah, D. Rajendran and M. Jarrar, "Clustering Arabic Tweets for Sentiment Analysis," 2017 IEEE/ACS 14th International Conference on Computer Systems and Applications (AICCSA), Hammamet, Tunisia, 2018, pp. 449-456.