Quality Control in Crowdsourcing Systems: Issues and Directions
Abstract
As a new distributed computing model, crowdsourcing lets people leverage the crowd's intelligence and wisdom toward solving problems. This article proposes a framework for characterizing various dimensions of quality control in crowdsourcing systems, a critical issue. The authors briefly review existing quality-control approaches, identify open issues, and look to future research directions. In the Web extra, the authors discuss both design-time and runtime approaches in more detail.
Keywords
crowdsourcing, workflows, quality control
Date of this Version
2013
DOI
10.1109/MIC.2013.20
Comments
Internet Computing
March-April 2013 (vol. 17 no. 2)
pp. 76-81