| 来源类型 | Article
|
| 规范类型 | 其他
|
| DOI | 10.1080/17538947.2015.1039609
|
| Assessing quality of volunteer crowdsourcing contributions: lessons from the Cropland Capture game. |
| Salk CF; Sturn T; See L; Fritz S
|
| 发表日期 | 2016
|
| 出处 | International Journal of Digital Earth 9 (4): 310-426
|
| 出版年 | 2016
|
| 语种 | 英语
|
| 摘要 | Volunteered geographic information (VGI) is the assembly of spatial information based on public input. While VGI has proliferated in recent years, assessing the quality of volunteer-contributed data has proven challenging, leading some to question the efficiency of such programs. In this paper, we compare several quality metrics for individual volunteers' contributions. the date were the product of the 'Cropland Capture' game, in which several thousand volunteers assessed 165,000 images for the presence of cropland over the course of 6 months. We compared agreement between volunteer ratings and an image's majority classification with volunteer self-agreement on repeated images and expert evaluations. We also examined the impact of experience and learning on performance. Volunteer self-agreement was nearly always higher than agreement with majority classifications, and much greater than agreement with expert validations although these metrics were all positively correlated. Volunteer quality showed a broad trend toward improvement with experience, but the highest accuracies were achieved by a handful of moderately active contributors, not the most active volunteers. Our results emphasize the importance of a universal set of expert-validated tasks as a gold standard for evaluating VGI quality. |
| 主题 | Ecosystems Services and Management (ESM)
; Postdoctoral Scholars (PDS)
|
| 关键词 | crowdsourcing
volunteered geographic information
cropland
data quality
image classification
Geo-Wiki
|
| URL | http://pure.iiasa.ac.at/id/eprint/11287/
|
| 来源智库 | International Institute for Applied Systems Analysis (Austria)
|
| 引用统计 |
|
| 资源类型 | 智库出版物
|
| 条目标识符 | http://119.78.100.153/handle/2XGU8XDN/130495
|
推荐引用方式
GB/T 7714 |
Salk CF,Sturn T,See L,et al. Assessing quality of volunteer crowdsourcing contributions: lessons from the Cropland Capture game.. 2016.
|
|
文件名：
|
Assessing%20quality%20of%20volunteer%20crowdsourcing%20contributions.pdf
|
|
格式：
|
Adobe PDF
|
此文件暂不支持浏览
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。
