This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
FiVaTech: Page-Level Web Data Extraction from Template Pages
February 2010 (vol. 22 no. 2)
pp. 249-263
Mohammed Kayed, Beni-Suef Universiy, Giza
Chia-Hui Chang, National Central University, Chung-Li
Web data extraction has been an important part for many Web data analysis applications. In this paper, we formulate the data extraction problem as the decoding process of page generation based on structured data and tree templates. We propose an unsupervised, page-level data extraction approach to deduce the schema and templates for each individual Deep Website, which contains either singleton or multiple data records in one Webpage. FiVaTech applies tree matching, tree alignment, and mining techniques to achieve the challenging task. In experiments, FiVaTech has much higher precision than EXALG and is comparable with other record-level extraction systems like ViPER and MSE. The experiments show an encouraging result for the test pages used in many state-of-the-art Web data extraction works.

[1] A. Arasu and H. Garcia-Molina, “Extracting Structured Data from Web Pages,” Proc. ACM SIGMOD, pp. 337-348, 2003.
[2] C.-H. Chang and S.-C. Lui, “IEPAD: Information Extraction Based on Pattern Discovery,” Proc. Int'l Conf. World Wide Web (WWW-10), pp. 223-231, 2001.
[3] C.-H. Chang, M. Kayed, M.R. Girgis, and K.A. Shaalan, “Survey of Web Information Extraction Systems,” IEEE Trans. Knowledge and Data Eng., vol. 18, no. 10, pp. 1411-1428, Oct. 2006.
[4] V. Crescenzi, G. Mecca, and P. Merialdo, “Knowledge and Data Engineerings,” Proc. Int'l Conf. Very Large Databases (VLDB), pp.109-118, 2001.
[5] C.-N. Hsu and M. Dung, “Generating Finite-State Transducers for Semi-Structured Data Extraction from the Web,” J. Information Systems, vol. 23, no. 8, pp. 521-538, 1998.
[6] N. Kushmerick, D. Weld, and R. Doorenbos, “Wrapper Induction for Information Extraction,” Proc. 15th Int'l Joint Conf. Artificial Intelligence (IJCAI), pp. 729-735, 1997.
[7] A.H.F. Laender, B.A. Ribeiro-Neto, A.S. Silva, and J.S. Teixeira, “A Brief Survey of Web Data Extraction Tools,” SIGMOD Record, vol. 31, no. 2, pp. 84-93, 2002.
[8] B. Lib, R. Grossman, and Y. Zhai, “Mining Data Records in Web pages,” Proc. Int'l Conf. Knowledge Discovery and Data Mining (KDD), pp. 601-606, 2003.
[9] I. Muslea, S. Minton, and C. Knoblock, “A Hierarchical Approach to Wrapper Induction,” Proc. Third Int'l Conf. Autonomous Agents (AA '99), 1999.
[10] K. Simon and G. Lausen, “ViPER: Augmenting Automatic Information Extraction with Visual Perceptions,” Proc. Int'l Conf. Information and Knowledge Management (CIKM), 2005.
[11] J. Wang and F.H. Lochovsky, “Data Extraction and Label Assignment for Web Databases,” Proc. Int'l Conf. World Wide Web (WWW-12), pp. 187-196, 2003.
[12] Y. Yamada, N. Craswell, T. Nakatoh, and S. Hirokawa, “Testbed for Information Extraction from Deep Web,” Proc. Int'l Conf. World Wide Web (WWW-13), pp. 346-347, 2004.
[13] W. Yang, “Identifying Syntactic Differences between Two Programs,” Software—Practice and Experience, vol. 21, no. 7, pp. 739-755, 1991.
[14] Y. Zhai and B. Liu, “Web Data Extraction Based on Partial Tree Alignment,” Proc. Int'l Conf. World Wide Web (WWW-14), pp. 76-85, 2005.
[15] H. Zhao, W. Meng, Z. Wu, V. Raghavan, and C. Yu, “Fully Automatic Wrapper Generation for Search Engines,” Proc. Int'l Conf. World Wide Web (WWW), 2005.
[16] H. Zhao, W. Meng, Z. Wu, V. Raghavan, and C. Yu, “Automatic Extraction of Dynamic Record Sections from Search Engine Result Pages,” Proc. Int'l Conf. Very Large Databases (VLDB), pp. 989-1000, 2006.

Index Terms:
Semistructured data, Web data extraction, multiple trees merging, wrapper induction.
Citation:
Mohammed Kayed, Chia-Hui Chang, "FiVaTech: Page-Level Web Data Extraction from Template Pages," IEEE Transactions on Knowledge and Data Engineering, vol. 22, no. 2, pp. 249-263, Feb. 2010, doi:10.1109/TKDE.2009.82
Usage of this product signifies your acceptance of the Terms of Use.