Search For:

Displaying 1-12 out of 12 total
Examining the Limits of Crowdsourcing for Relevance Assessment
Found in: IEEE Internet Computing
By Paul Clough,Mark Sanderson,Jiayu Tang,Tim Gollins,Amy Warner
Issue Date:July 2013
pp. 32-38
Evaluation is instrumental to developing and managing effective information retrieval systems. For this process, enlisting crowdsourcing has proven viable. However, less understood are crowdsourcing's limits for evaluation, particularly for domain-specific...
 
Exploration, navigation and retrieval of information in cultural heritage: ENRICH 2013
Found in: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval (SIGIR '13)
By Maristella Agosti, Owen Conlan, Paul Clough, Séamus Lawless
Issue Date:July 2013
pp. 1136-1136
The Exploration, Navigation and Retrieval of Information in Cultural Heritage Workshop (ENRICH 2013) offers a forum to 1) discuss the challenges and opportunities in Information Retrieval research in the area of Cultural Heritage; 2) encourage collaboratio...
     
Computing similarity between items in a digital library of cultural heritage
Found in: Journal on Computing and Cultural Heritage (JOCCH)
By Mark Stevenson, Nikolaos Aletras, Paul Clough
Issue Date:October 2012
pp. 1-19
Large amounts of cultural heritage content have now been digitized and are available in digital libraries. However, these are often unstructured and difficult to navigate. Automatic techniques for identifying similar items in these collections could be use...
     
Do user preferences and evaluation measures line up?
Found in: Proceeding of the 33rd international ACM SIGIR conference on Research and development in information retrieval (SIGIR '10)
By Evangelos Kanoulas, Mark Sanderson, Monica Lestari Paramita, Paul Clough
Issue Date:July 2010
pp. 555-562
This paper presents results comparing user preference for search engine rankings with measures of effectiveness computed from a test collection. It establishes that preferences and evaluation measures correlate: systems measured as better on a test collect...
     
Images and perceptions of neighbourhood extents
Found in: Proceedings of the 6th Workshop on Geographic Information Retrieval (GIR '10)
By Paul Clough, Robert Pasley
Issue Date:February 2010
pp. 1-2
In this paper, we describe an experiment in which we use an online questionnaire to elicit people's perception of the extents of smaller vague regions, such as neighbourhoods. Our approach uses images of street scenes rather than landmarks or placenames.
     
Multiple approaches to analysing query diversity
Found in: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval (SIGIR '09)
By Mark Sanderson, Monica Paramita, Murad Abouammoh, Paul Clough, Sergio Navarro
Issue Date:July 2009
pp. 435-435
In this paper we examine user queries with respect to diversity: providing a mix of results across different interpretations. Using two query log analysis techniques (click entropy and reformulated queries), 14.9 million queries from the Microsoft Live Sea...
     
Mapping geographic coverage of the web
Found in: Proceedings of the 16th ACM SIGSPATIAL international conference on Advances in geographic information systems (GIS '08)
By Florian A. Twaroch, Paul Clough, Robert Pasley, Ross S. Purves
Issue Date:November 2008
pp. 1-8
In this paper, we describe a methodology to estimate the geographic coverage of the web without the need for secondary knowledge or complex geo-tagging. This is achieved by randomly selecting toponyms from the Ordnance Survey 50K gazetteer to create search...
     
Relevance judgments between TREC and Non-TREC assessors
Found in: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR '08)
By Azzah Al-Maskari, Mark Sanderson, Paul Clough
Issue Date:July 2008
pp. 2-2
This paper investigates the agreement of relevance assessments between official TREC judgments and those generated from an interactive IR experiment. Results show that 63% of documents judged relevant by our users matched official TREC judgments. Several f...
     
The good and the bad system: does the test collection predict users' effectiveness?
Found in: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR '08)
By Azzah Al-Maskari, Eija Airio, Mark Sanderson, Paul Clough
Issue Date:July 2008
pp. 2-2
Test collections are extensively used in the evaluation of information retrieval systems. Crucial to their use is the degree to which results from them predict user effectiveness. At first, past studies did not substantiate a relationship between system an...
     
The relationship between IR effectiveness measures and user satisfaction
Found in: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR '07)
By Azzah Al-Maskari, Mark Sanderson, Paul Clough
Issue Date:July 2007
pp. 773-774
This paper presents an experimental study of users assessing the quality of Google web search results. In particular we look at how users' satisfaction correlates with the effectiveness of Google as quantified by IR measures such as precision and the suite...
     
Evaluation axes for medical image retrieval systems: the imageCLEF experience
Found in: Proceedings of the 13th annual ACM international conference on Multimedia (MULTIMEDIA '05)
By Antoine Geissbuhler, Henning Muller, Paul Clough, Thomas Deselaers, Thomas Lehmann, William Hersh
Issue Date:November 2005
pp. 1014-1022
Content--based image retrieval in the medical domain is an extremely hot topic in medical imaging as it promises to help better managing the large amount of medical images being produced. Applications are mainly expected in the field of medical teaching fi...
     
Measuring pseudo relevance feedback & CLIR
Found in: Proceedings of the 27th annual international conference on Research and development in information retrieval (SIGIR '04)
By Mark Sanderson, Paul Clough
Issue Date:July 2004
pp. 484-485
In this poster, we report on the effects of pseudo relevance feedback (PRF) for a cross language image retrieval task using a test collection. Typically PRF has been shown to improve retrieval performance in previous CLIR experiments based on average preci...
     
 1