Sixth IEEE International Conference on Data Mining - Workshops (ICDMW'06) (2006)
Hong Kong, China
Dec. 18, 2006 to Dec. 22, 2006
Philip Zigoris , University of California, Santa Cruz
Damian Eads , University of California, Santa Cruz
Yi Zhang , University of California, Santa Cruz
We propose an algorithm for extracting fields from HTML search results. The output of the algorithm is a database table? a data structure that better lends itself to high-level data mining and information exploitation. Our algorithm effectively combines tree and string alignment algorithms, as well as domain-specific feature extraction to match semantically related data across search results. The applications of our approach are vast and include hidden web crawling, semantic tagging, and federated search. We build on earlier research on the use of tree alignment for information extraction. In contrast to previous approaches that rely on hand tuned parameters, our algorithm makes use of a variant of Support VectorMachines (SVMs) to learn a parameterized, site-independent tree alignment model. This model can then be used to deduce common structural and textual elements of a set of HTML parse trees. We report some preliminary results of our system?s performance on data from websites with a variety of different layouts.
P. Zigoris, Y. Zhang and D. Eads, "Unsupervised Learning of Tree Alignment Models for Information Extraction," Sixth IEEE International Conference on Data Mining - Workshops (ICDMW'06)(ICDMW), Hong Kong, China, 2006, pp. 45-49.