This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Sixth International Conference on Networking (ICN'07)
WebMiner--Anatomy of Super Peer Based Incremental Topic-Specific Web Crawler
Sainte-Luce, Martinique, France
April 22-April 28
ISBN: 0-7695-2805-8
Om Vikas, Indian Institute of Information Technology and Management, India
Nitin J. Chiluka, Indian Institute of Information Technology and Management, India
Purushottam K. Ray, Indian Institute of Information Technology and Management, India
Girraj Meena, Indian Institute of Information Technology and Management, India
Akhil K. Meshram, Indian Institute of Information Technology and Management, India
Amit Gupta, Indian Institute of Information Technology and Management, India
Abhishek Sisodia, Indian Institute of Information Technology and Management, India
This paper introduces "WebMiner", a super-peer based P2P system for building an incremental topic-specific web crawler. This develops a topic-based repository of web pages that would later be used in the construction of ontologies. Current crawlers suffer from centralized architecture, having single point of failure and heavy load. Super-peer systems strike a balance between the inherent efficiency of centralized search and the autonomity, load balancing and robustness to attacks, provided by distributed search, with heterogeneity of capabilities across peers. In this paper, we discuss the architecture of WebMiner in detail including the construction of the super-peer overlay network and the working of the system, which includes feature of crawling the hidden web.
Citation:
Om Vikas, Nitin J. Chiluka, Purushottam K. Ray, Girraj Meena, Akhil K. Meshram, Amit Gupta, Abhishek Sisodia, "WebMiner--Anatomy of Super Peer Based Incremental Topic-Specific Web Crawler," icn, pp.32, Sixth International Conference on Networking (ICN'07), 2007
Usage of this product signifies your acceptance of the Terms of Use.