Web Intelligence and Intelligent Agent Technology, IEEE/WIC/ACM International Conference on (2011)
Aug. 22, 2011 to Aug. 27, 2011
The use of the World Wide Web as a free source for large linguistic resources is a well-established idea. Such resources are keystones to domains such as lexicon-based categorization, information retrieval, machine translation and information extraction. In this paper, we present an industrial focused web crawler for the automatic compilation of specialized corpora from the web. This application, created within the framework of the TTC project, is used daily by several linguists to bootstrap large thematic corpora which are then used to automatically generate bilingual terminologies.
focused crawling, web-as-corpus, resources bootstrapping
Clément de Groc, "Babouk: Focused Web Crawling for Corpus Compilation and Automatic Terminology Extraction", Web Intelligence and Intelligent Agent Technology, IEEE/WIC/ACM International Conference on, vol. 01, no. , pp. 497-498, 2011, doi:10.1109/WI-IAT.2011.253