Issue No. 05 - Sept.-Oct. (2012 vol. 16)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/MIC.2012.67
Elena Simperl , Karlsruhe Institute of Technology
Stefan Thaler , University of Innsbruck
Stephan Wölger , University of Innsbruck
Human computation can address complex computational problems by tapping into large resource pools for relatively little cost. Two prominent human-computation techniques — games with a purpose (GWAP) and microtask crowdsourcing — can help resolve semantic-technology-related tasks, including knowledge representation, ontology alignment, and semantic annotation. To evaluate which approach is better with respect to costs and benefits, the authors employ categorization challenges in Wikipedia to ultimately create a large, general-purpose ontology. They first use the OntoPronto GWAP, then replicate its problem-solving setting in Amazon Mechanical Turk, using a similar task-design structure, evaluation mechanisms, and input data.
Games, Ontologies, Internet, Encyclopedias, Electronic publishing, Protons, Mechanical Turk, GWAP, incentives, motivators, crowdsourcing, conceptual modeling, ontology
Elena Simperl, Stefan Thaler, Stephan Wölger, "An Experiment in Comparing Human-Computation Techniques", IEEE Internet Computing, vol. 16, no. , pp. 52-58, Sept.-Oct. 2012, doi:10.1109/MIC.2012.67