The Community for Technology Leaders
RSS Icon
Issue No.02 - February (2010 vol.22)
pp: 249-263
Mohammed Kayed , Beni-Suef Universiy, Giza
Chia-Hui Chang , National Central University, Chung-Li
Web data extraction has been an important part for many Web data analysis applications. In this paper, we formulate the data extraction problem as the decoding process of page generation based on structured data and tree templates. We propose an unsupervised, page-level data extraction approach to deduce the schema and templates for each individual Deep Website, which contains either singleton or multiple data records in one Webpage. FiVaTech applies tree matching, tree alignment, and mining techniques to achieve the challenging task. In experiments, FiVaTech has much higher precision than EXALG and is comparable with other record-level extraction systems like ViPER and MSE. The experiments show an encouraging result for the test pages used in many state-of-the-art Web data extraction works.
Semistructured data, Web data extraction, multiple trees merging, wrapper induction.
Mohammed Kayed, Chia-Hui Chang, "FiVaTech: Page-Level Web Data Extraction from Template Pages", IEEE Transactions on Knowledge & Data Engineering, vol.22, no. 2, pp. 249-263, February 2010, doi:10.1109/TKDE.2009.82
[1] A. Arasu and H. Garcia-Molina, “Extracting Structured Data from Web Pages,” Proc. ACM SIGMOD, pp. 337-348, 2003.
[2] C.-H. Chang and S.-C. Lui, “IEPAD: Information Extraction Based on Pattern Discovery,” Proc. Int'l Conf. World Wide Web (WWW-10), pp. 223-231, 2001.
[3] C.-H. Chang, M. Kayed, M.R. Girgis, and K.A. Shaalan, “Survey of Web Information Extraction Systems,” IEEE Trans. Knowledge and Data Eng., vol. 18, no. 10, pp. 1411-1428, Oct. 2006.
[4] V. Crescenzi, G. Mecca, and P. Merialdo, “Knowledge and Data Engineerings,” Proc. Int'l Conf. Very Large Databases (VLDB), pp.109-118, 2001.
[5] C.-N. Hsu and M. Dung, “Generating Finite-State Transducers for Semi-Structured Data Extraction from the Web,” J. Information Systems, vol. 23, no. 8, pp. 521-538, 1998.
[6] N. Kushmerick, D. Weld, and R. Doorenbos, “Wrapper Induction for Information Extraction,” Proc. 15th Int'l Joint Conf. Artificial Intelligence (IJCAI), pp. 729-735, 1997.
[7] A.H.F. Laender, B.A. Ribeiro-Neto, A.S. Silva, and J.S. Teixeira, “A Brief Survey of Web Data Extraction Tools,” SIGMOD Record, vol. 31, no. 2, pp. 84-93, 2002.
[8] B. Lib, R. Grossman, and Y. Zhai, “Mining Data Records in Web pages,” Proc. Int'l Conf. Knowledge Discovery and Data Mining (KDD), pp. 601-606, 2003.
[9] I. Muslea, S. Minton, and C. Knoblock, “A Hierarchical Approach to Wrapper Induction,” Proc. Third Int'l Conf. Autonomous Agents (AA '99), 1999.
[10] K. Simon and G. Lausen, “ViPER: Augmenting Automatic Information Extraction with Visual Perceptions,” Proc. Int'l Conf. Information and Knowledge Management (CIKM), 2005.
[11] J. Wang and F.H. Lochovsky, “Data Extraction and Label Assignment for Web Databases,” Proc. Int'l Conf. World Wide Web (WWW-12), pp. 187-196, 2003.
[12] Y. Yamada, N. Craswell, T. Nakatoh, and S. Hirokawa, “Testbed for Information Extraction from Deep Web,” Proc. Int'l Conf. World Wide Web (WWW-13), pp. 346-347, 2004.
[13] W. Yang, “Identifying Syntactic Differences between Two Programs,” Software—Practice and Experience, vol. 21, no. 7, pp. 739-755, 1991.
[14] Y. Zhai and B. Liu, “Web Data Extraction Based on Partial Tree Alignment,” Proc. Int'l Conf. World Wide Web (WWW-14), pp. 76-85, 2005.
[15] H. Zhao, W. Meng, Z. Wu, V. Raghavan, and C. Yu, “Fully Automatic Wrapper Generation for Search Engines,” Proc. Int'l Conf. World Wide Web (WWW), 2005.
[16] H. Zhao, W. Meng, Z. Wu, V. Raghavan, and C. Yu, “Automatic Extraction of Dynamic Record Sections from Search Engine Result Pages,” Proc. Int'l Conf. Very Large Databases (VLDB), pp. 989-1000, 2006.
968 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool