Examining the Limits of Crowdsourcing for Relevance Assessment
IEEE Internet Computing
By Paul Clough,Mark Sanderson,Jiayu Tang,Tim Gollins,Amy Warner
Issue Date:July 2013
Evaluation is instrumental to developing and managing effective information retrieval systems. For this process, enlisting crowdsourcing has proven viable. However, less understood are crowdsourcing's limits for evaluation, particularly for domain-specific...