This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Third International Conference on Information Technology: New Generations (ITNG'06)
A Comparative Study of Performance Measures for Information Retrieval Systems
Las Vegas, Nevada
April 10-April 12
ISBN: 0-7695-2497-4
Xiannong Meng, Bucknell University
Traditional performance measures of information retrieval systems include precision and recall and their variants. While these measures work well in closed-laboratory environments, they are not suitable for practical IR systems such as Web search systems. Many single-value measures were proposed to improve over the precision-recall measure, such as expected search length (ESL), average search length (ASL) and RankPower. We compare in this paper the measures of ESL, ASL, and RankPower applied to a set of real Web retrieval data. The results demonstrate that RankPower indeed is a feasible, effective, and easyto- use single-value measure for performance of practical IR systems such as Web search engines.
Index Terms:
information retrieval, performance measurement, Web search, user studies, user preference
Citation:
Xiannong Meng, "A Comparative Study of Performance Measures for Information Retrieval Systems," itng, pp.578-579, Third International Conference on Information Technology: New Generations (ITNG'06), 2006
Usage of this product signifies your acceptance of the Terms of Use.