Sixth International Conference on Networking (ICN'07) WebMiner--Anatomy of Super Peer Based Incremental Topic-Specific Web Crawler Sainte-Luce, Martinique, France April 22-April 28 ISBN: 0-7695-2805-8
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/ICN.2007.104
This paper introduces "WebMiner", a super-peer based P2P system for building an incremental topic-specific web crawler. This develops a topic-based repository of web pages that would later be used in the construction of ontologies. Current crawlers suffer from centralized architecture, having single point of failure and heavy load. Super-peer systems strike a balance between the inherent efficiency of centralized search and the autonomity, load balancing and robustness to attacks, provided by distributed search, with heterogeneity of capabilities across peers. In this paper, we discuss the architecture of WebMiner in detail including the construction of the super-peer overlay network and the working of the system, which includes feature of crawling the hidden web.
Citation:
Om Vikas, Nitin J. Chiluka, Purushottam K. Ray, Girraj Meena, Akhil K. Meshram, Amit Gupta, Abhishek Sisodia, "WebMiner--Anatomy of Super Peer Based Incremental Topic-Specific Web Crawler," icn, pp.32, Sixth International Conference on Networking (ICN'07), 2007 Usage of this product signifies your acceptance of the Terms of Use. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||