Fifth International Conference on Hybrid Intelligent Systems (HIS'05)
An Efficient Adaptive Focused Crawler Based on Ontology Learning
Rio de Janeiro, Brazil
December 06-December 09
ISBN: 0-7695-2457-5
The enormous growth of the world wide web in recent years has made it important to perform resource discovery efficiently. Consequently, several new ideas have been proposed; among them a key technique is focused crawling which is able to crawl particular topical portions of the world wide web quickly without having to explore all web pages. In this paper, we present an intelligent focused crawler algorithm in which we embeds ontology to evaluate the page?s relevance to the topic. Compared with other algorithms using domain knowledge, our algorithm can evolve the ontology automatically during crawl process. Considering the instinct characteristics of the ontology, propagation has also been imported to accelerate the evolution of the ontology. We applied our approaches in several tasks and provided an empirical evaluation which has shown promising results.
Citation:
Chang Su, Yang Gao, Jianmei Yang, Bin Luo, "An Efficient Adaptive Focused Crawler Based on Ontology Learning," his, pp.73-78, Fifth International Conference on Hybrid Intelligent Systems (HIS'05), 2005