2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI'06) LSCrawler: A Framework for an Enhanced Focused Web Crawler Based on Link Semantics Hong Kong, China December 18-December 22 ISBN: 0-7695-2747-7
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/WI.2006.112
The traditional process of focused web crawler is to harvest a collection of web documents that are focused on the topical subspaces. The intricacy of focused crawlers is identifying the next most important and relevant link to follow. Focused Crawlers mostly rely on probabilistic models for predicting the relevancy of the documents. The Web documents are well characterized by the hypertext and the hypertext can be used to determine the relevance of the document to the search domain. The semantics of the link characterizes the semantics of the document referred. In this article, a novel, and distinctive focused crawler named LSCrawler has been proposed. This LSCrawler system retrieves documents by speculating the relevancy of the document based on the keywords in the link and the surrounding text of the link. The relevancy of the documents is reckoned measuring the semantic similarity between the keywords in the link and the taxonomy hierarchy of the specific domain. The system exhibits better recall as it exploits the semantic of the keywords in the link.
Citation:
M. Yuvarani, N.Ch.S.N. Iyengar, A. Kannan, "LSCrawler: A Framework for an Enhanced Focused Web Crawler Based on Link Semantics," wi, pp.794-800, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI'06), 2006 Usage of this product signifies your acceptance of the Terms of Use. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||