This Article 
 Bibliographic References 
 Add to: 
Discovery of Context-Specific Ranking Functions for Effective Information Retrieval Using Genetic Programming
April 2004 (vol. 16 no. 4)
pp. 523-527

Abstract—The Internet and corporate Intranets have brought a lot of information. People usually resort to search engines to find required information. However, these systems tend to use only one fixed ranking strategy regardless of the contexts. This poses serious performance problems when characteristics of different users, queries, and text collections are taken into account. In this paper, we argue that the ranking strategy should be context specific and we propose a new systematic method that can automatically generate ranking strategies for different contexts based on Genetic Programming (GP). The new method was tested on TREC data and the results are very promising.

[1] M. Gordon, Probabilistic and Genetic Algorithms for Document Retrieval Comm. ACM, vol. 31, no. 2, pp. 152-169, 1988.
[2] M. Gordon and P. Pathak, Finding Information on the WWW: The Retrieval Effectiveness of Search Engines Information Processing and Management, vol. 35, no. 2, pp. 141-180, 1999.
[3] D.K. Harman, Relevance Feedback Revisited Proc. 11th ACM SIGIR Conf., pp. 321-331, 1992.
[4] D.K. Harman, Overview of the Fourth Text Retrieval Conference (TREC-4) Proc. Fourth Text Retrieval Conf., D.K. Harman, ed., pp. 1-24, NIST Special Publication 500-236, 1996.
[5] J.R. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, Mass.: MIT Press, 1992.
[6] F.W. Lancaster and A.J. Warner, Information Retrieval Today. Information Resources Press, 1993.
[7] W. Langdon and R. Poli, Foundations of Genetic Programming. Springer Velag, 2002.
[8] T.M. Mitchell, Machine Learning. McGraw Hill, 1997.
[9] H. Ng, W. Goh, and K.L. Low, Feature Selection, Perceptron Learning, and a Usability Case Study for Text Categorization Proc. 20th Ann. Int'l ACM SIGIR Conf. Research and Development in Information Retrieval, 1997.
[10] S.E. Robertson, S. Walker, S. Jones, M.M. Hancock-Beaulieu, and M. Gatford, Okapi at TREC-4 Proc. Fourth Text Retrieval Conf., D.K. Harman, ed., pp. 73-97, NIST Special Publication 500-236, 1996.
[11] G. Salton, Automatic Text Processing. Addison-Wesley Publishing Co., 1989.
[12] H. Schutze, D. Hull, and J. Pedersen, A Comparison of Classifiers and Document Representations for the Routing Problem Proc. 16th ACM SIGIR '95, pp. 229-237, 1995.
[13] A. Singhal, G. Salton, M. Mitra, and C. Buckley, Document Length Normalization Information Processing and Management, vol. 32, no. 5, pp. 619-633, 1996.
[14] K. Sparck Jones, Automatic Indexing J. Documentation, vol. 30, pp. 393-432, 1974.
[15] E.M. Voorhees, Variations in Relevance Judgments and the Measurement of Retrieval Effectiveness Information Processing and Management, vol. 36, no. 5, pp. 697-716, 2000.

Index Terms:
Intelligent information retrieval, personalization, search engine, term weighting, ranking function, text mining, genetic programming, contextual information retrieval, information routing, information retrieval.
Weiguo Fan, Michael D. Gordon, Praveen Pathak, "Discovery of Context-Specific Ranking Functions for Effective Information Retrieval Using Genetic Programming," IEEE Transactions on Knowledge and Data Engineering, vol. 16, no. 4, pp. 523-527, April 2004, doi:10.1109/TKDE.2004.1269663
Usage of this product signifies your acceptance of the Terms of Use.