Issue No.05 - Sept.-Oct. (2012 vol.16)
Stefan Thaler , University of Innsbruck
Elena Simperl , Karlsruhe Institute of Technology
Stephan Wölger , University of Innsbruck
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/MIC.2012.67
Human computation can address complex computational problems by tapping into large resource pools for relatively little cost. Two prominent human-computation techniques — games with a purpose (GWAP) and microtask crowdsourcing — can help resolve semantic-technology-related tasks, including knowledge representation, ontology alignment, and semantic annotation. To evaluate which approach is better with respect to costs and benefits, the authors employ categorization challenges in Wikipedia to ultimately create a large, general-purpose ontology. They first use the OntoPronto GWAP, then replicate its problem-solving setting in Amazon Mechanical Turk, using a similar task-design structure, evaluation mechanisms, and input data.
Games, Ontologies, Internet, Encyclopedias, Electronic publishing, Protons, Mechanical Turk, GWAP, incentives, motivators, crowdsourcing, conceptual modeling, ontology
Stefan Thaler, Elena Simperl, Stephan Wölger, "An Experiment in Comparing Human-Computation Techniques", IEEE Internet Computing, vol.16, no. 5, pp. 52-58, Sept.-Oct. 2012, doi:10.1109/MIC.2012.67