The Community for Technology Leaders
2014 Sixth International Symposium on Parallel Architectures, Algorithms and Programming (PAAP) (2014)
Beijing, China
July 13, 2014 to July 15, 2014
ISSN: 2168-3034
ISBN: 978-1-4799-3844-5
pp: 69-74
ABSTRACT
Latent Dirichlet Allocation (LDA), has beenrecently used to automatically generate text corpora topics, and applied to sentences extraction based multi-documentsummarization algorithms. However, not all the estimatedtopics are of equal importance or correspond to genuinethemes of the domain. Some of the topics can be a collection ofirrelevant or background words, or represent insignificantthemes. This paper proposed a topic-sensitive algorithm formulti-document summarization. Our approach is distinguishedfrom existing approaches in that we use LDA model to identifyand distinguish significance topic which is used in sentenceweight calculation. Moreover, beside topic characteristics, thisapproach also considered some statistics characteristics, suchas term frequency, sentence position, sentence length, etc. Thisapproach not only highlights the advantages of statisticscharacteristics, but also cooperated with LDA topic model. Theexperiments showed that the proposed algorithm achievedbetter performance compared the other state-of-the-artalgorithms on DUC2002 corpus.
INDEX TERMS
Computational modeling, Resource management, Probabilistic logic, Probability distribution, Frequency measurement, Length measurement, Bayes methods
CITATION
Na Liu, Xiao-Jun Tang, Ying Lu, Ming-Xia Li, Hai-Wen Wang, Peng Xiao, "Topic-Sensitive Multi-document Summarization Algorithm", 2014 Sixth International Symposium on Parallel Architectures, Algorithms and Programming (PAAP), vol. 00, no. , pp. 69-74, 2014, doi:10.1109/PAAP.2014.22
179 ms
(Ver 3.3 (11022016))