Issue No. 05 - Sept.-Oct. (2012 vol. 16)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/MIC.2012.67
Stefan Thaler , University of Innsbruck
Elena Simperl , Karlsruhe Institute of Technology
Stephan Wölger , University of Innsbruck
Human computation can address complex computational problems by tapping into large resource pools for relatively little cost. Two prominent human-computation techniques — games with a purpose (GWAP) and microtask crowdsourcing — can help resolve semantic-technology-related tasks, including knowledge representation, ontology alignment, and semantic annotation. To evaluate which approach is better with respect to costs and benefits, the authors employ categorization challenges in Wikipedia to ultimately create a large, general-purpose ontology. They first use the OntoPronto GWAP, then replicate its problem-solving setting in Amazon Mechanical Turk, using a similar task-design structure, evaluation mechanisms, and input data.
Games, Ontologies, Internet, Encyclopedias, Electronic publishing, Protons, Mechanical Turk, GWAP, incentives, motivators, crowdsourcing, conceptual modeling, ontology
E. Simperl, S. Thaler and S. Wölger, "An Experiment in Comparing Human-Computation Techniques," in IEEE Internet Computing, vol. 16, no. , pp. 52-58, 2012.