This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2003 IEEE/WIC International Conference on Web Intelligence (WI'03)
A Data-Mining Approach for Optimizing Performance of an Incremental Crawler
Halifax, Canada
October 13-October 17
ISBN: 0-7695-1932-6
Hadrien Bullot, Swiss Federal Institute of Technology
S. K. Gupta, Indian Institute of Technology at Delhi
M. K. Mohania, IBM India Research Lab
Crawlers visit the Web to maintain a local repository of web pages up to date. In this paper we introduce another perspective to build an effective incremental crawler. Based on previous work in this field, we study how we can improve the performance of a crawler using data-mining. The information collected from the users can help the crawler to know which are the popular pages and to revisit them as soon as possible.
Citation:
Hadrien Bullot, S. K. Gupta, M. K. Mohania, "A Data-Mining Approach for Optimizing Performance of an Incremental Crawler," wi, pp.610, 2003 IEEE/WIC International Conference on Web Intelligence (WI'03), 2003
Usage of this product signifies your acceptance of the Terms of Use.