This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2011 International Conference on Document Analysis and Recognition
Facilitating Understanding of Large Document Collections
Beijing, China
September 18-September 21
ISBN: 978-0-7695-4520-2
Large document collections containing multiple topics can be overwhelming to understand, requiring librarians and archivists significant time and efforts to develop access points. Efficient computational methods can aid this process by uncovering groups of documents that can be described for access. We investigate the use of density based clustering with document segmentation to identify points of access as dense clusters of information. The method returns stories and classes of cohesive clusters that can be described as precise points of access. We found that our method performs more efficiently than K-means clustering and topic model using Latent Dirichlet Allocation (LDA). We use Hadoop to process a large document collection.
Index Terms:
density based clustering, information retrieval, distributed processing, Hadoop/MapReduce, digital archives
Citation:
Jae Hyeon Bae, Weijia Xu, Maria Esteva, "Facilitating Understanding of Large Document Collections," icdar, pp.1334-1338, 2011 International Conference on Document Analysis and Recognition, 2011
Usage of this product signifies your acceptance of the Terms of Use.