A Framework for Semisupervised Feature Generation and Its Applications in Biomedical Literature Mining
Issue No. 02 - March/April (2011 vol. 8)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TCBB.2010.99
Zhihao Yang , Dalian University of Technology, Dalian
Hongfei Lin , Dalian University of Technology, Dalian
Xiaohua Hu , Drexel University, Philadelphia
Yanpeng Li , Dalian University of Technology, Dalian and Drexel University, Philadelphia
Feature representation is essential to machine learning and text mining. In this paper, we present a feature coupling generalization (FCG) framework for generating new features from unlabeled data. It selects two special types of features, i.e., example-distinguishing features (EDFs) and class-distinguishing features (CDFs) from original feature set, and then generalizes EDFs into higher-level features based on their coupling degrees with CDFs in unlabeled data. The advantage is: EDFs with extreme sparsity in labeled data can be enriched by their co-occurrences with CDFs in unlabeled data so that the performance of these low-frequency features can be greatly boosted and new information from unlabeled can be incorporated. We apply this approach to three tasks in biomedical literature mining: gene named entity recognition (NER), protein-protein interaction extraction (PPIE), and text classification (TC) for gene ontology (GO) annotation. New features are generated from over 20 GB unlabeled PubMed abstracts. The experimental results on BioCreative 2, AIMED corpus, and TREC 2005 Genomics Track show that 1) FCG can utilize well the sparse features ignored by supervised learning. 2) It improves the performance of supervised baselines by 7.8 percent, 5.0 percent, and 5.8 percent, respectively, in the tree tasks. 3) Our methods achieve 89.1, 64.5 F-score, and 60.1 normalized utility on the three benchmark data sets.
Feature coupling generalization, biomedical literature mining, semisupervised learning, named entity recognition, protein-protein interaction extraction, text classification.
Zhihao Yang, Hongfei Lin, Xiaohua Hu, Yanpeng Li, "A Framework for Semisupervised Feature Generation and Its Applications in Biomedical Literature Mining", IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 8, no. , pp. 294-307, March/April 2011, doi:10.1109/TCBB.2010.99