2013 IEEE 13th International Conference on Data Mining Workshops (2009)
Miami, Florida, USA
Dec. 6, 2009 to Dec. 6, 2009
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/ICDMW.2009.81
This paper describes a general methodology for extracting attribute-value pairs from web pages. It consists of two phases: candidate generation, in which syntactically likely attribute-value pairs are annotated; and candidate filtering, in which semantically improbable annotations are removed. We describe three types of candidate generators and two types of candidate filters, all of which are designed to be massively parallelizable. Our methods can handle 1 billion web pages in less than 6 hours with 1,000 machines. The best generator and filter combination achieves 70% F-measure compared to a hand-annotated corpus.
Dominic Widdows, Kamal Nigam, Tom Lokovic, Yuk Wah Wong, "Scalable Attribute-Value Extraction from Semi-structured Text", 2013 IEEE 13th International Conference on Data Mining Workshops, vol. 00, no. , pp. 302-307, 2009, doi:10.1109/ICDMW.2009.81