An investigation of techniques that aim to improve the quality of labels provided by the crowd

Jonathon Hare; Anna Weston; Elena Simperl; Sina Samangooei; David Dupplaw; Paul Lewis; Maribel Acosta

An investigation of techniques that aim to improve the quality of labels provided by the crowd

Jonathon Hare, Anna Weston, Elena Simperl, Sina Samangooei, David Dupplaw, Paul Lewis, Maribel Acosta

Research output: Contribution to journal › Conference article › peer-review

Abstract

The 2013 MediaEval Crowdsourcing task looked at the problem of working with noisy crowdsourced annotations of image data. The aim of the task was to investigate possible techniques for estimating the true labels of an image by using the set of noisy crowdsourced labels, and possibly any content and metadata from the image itself. For the runs in this paper, we've applied a shotgun approach and tried a number of existing techniques, which include generative probabilistic models and further crowdsourcing.

Original language	English
Journal	CEUR Workshop Proceedings
Volume	1043
State	Published - 2013
Externally published	Yes
Event	2013 Multimedia Benchmark Workshop, MediaEval 2013 - Barcelona, Spain Duration: 18 Oct 2013 → 19 Oct 2013

Cite this

@article{1698a77560c14ecd88391429cf13bf5d,

title = "An investigation of techniques that aim to improve the quality of labels provided by the crowd",

abstract = "The 2013 MediaEval Crowdsourcing task looked at the problem of working with noisy crowdsourced annotations of image data. The aim of the task was to investigate possible techniques for estimating the true labels of an image by using the set of noisy crowdsourced labels, and possibly any content and metadata from the image itself. For the runs in this paper, we've applied a shotgun approach and tried a number of existing techniques, which include generative probabilistic models and further crowdsourcing.",

author = "Jonathon Hare and Anna Weston and Elena Simperl and Sina Samangooei and David Dupplaw and Paul Lewis and Maribel Acosta",

year = "2013",

language = "English",

volume = "1043",

journal = "CEUR Workshop Proceedings",

issn = "1613-0073",

publisher = "CEUR-WS",

note = "2013 Multimedia Benchmark Workshop, MediaEval 2013 ; Conference date: 18-10-2013 Through 19-10-2013",

}

TY - JOUR

T1 - An investigation of techniques that aim to improve the quality of labels provided by the crowd

AU - Hare, Jonathon

AU - Weston, Anna

AU - Simperl, Elena

AU - Samangooei, Sina

AU - Dupplaw, David

AU - Lewis, Paul

AU - Acosta, Maribel

PY - 2013

Y1 - 2013

N2 - The 2013 MediaEval Crowdsourcing task looked at the problem of working with noisy crowdsourced annotations of image data. The aim of the task was to investigate possible techniques for estimating the true labels of an image by using the set of noisy crowdsourced labels, and possibly any content and metadata from the image itself. For the runs in this paper, we've applied a shotgun approach and tried a number of existing techniques, which include generative probabilistic models and further crowdsourcing.

AB - The 2013 MediaEval Crowdsourcing task looked at the problem of working with noisy crowdsourced annotations of image data. The aim of the task was to investigate possible techniques for estimating the true labels of an image by using the set of noisy crowdsourced labels, and possibly any content and metadata from the image itself. For the runs in this paper, we've applied a shotgun approach and tried a number of existing techniques, which include generative probabilistic models and further crowdsourcing.

UR - http://www.scopus.com/inward/record.url?scp=84924769580&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:84924769580

SN - 1613-0073

VL - 1043

JO - CEUR Workshop Proceedings

JF - CEUR Workshop Proceedings

T2 - 2013 Multimedia Benchmark Workshop, MediaEval 2013

Y2 - 18 October 2013 through 19 October 2013

ER -

An investigation of techniques that aim to improve the quality of labels provided by the crowd

Abstract

Other files and links

Fingerprint

Cite this