Uncertainty in crowd data sourcing under structural constraints

Antoine Amarilli; Yael Amsterdamer; Tova Milo

doi:10.1007/978-3-662-43984-5_27

Uncertainty in crowd data sourcing under structural constraints

Antoine Amarilli, Yael Amsterdamer, Tova Milo

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Scopus citations

Abstract

Applications extracting data from crowdsourcing platforms must deal with the uncertainty of crowd answers in two different ways: first, by deriving estimates of the correct value from the answers; second, by choosing crowd questions whose answers are expected to minimize this uncertainty relative to the overall data collection goal. Such problems are already challenging when we assume that questions are unrelated and answers are independent, but they are even more complicated when we assume that the unknown values follow hard structural constraints (such as monotonicity). In this vision paper, we examine how to formally address this issue with an approach inspired by [2]. We describe a generalized setting where we model constraints as linear inequalities, and use them to guide the choice of crowd questions and the processing of answers. We present the main challenges arising in this setting, and propose directions to solve them.

Original language	English
Title of host publication	Database Systems for Advanced Applications - 19th International Conference, DASFAA 2014, International Workshops
Subtitle of host publication	BDMA, DaMEN, SIM3, UnCrowd, Revised Selected Papers
Publisher	Springer Verlag
Pages	351-359
Number of pages	9
ISBN (Print)	9783662439838
DOIs	https://doi.org/10.1007/978-3-662-43984-5_27
State	Published - 2014
Externally published	Yes
Event	19th International Conference on Database Systems for Advanced Applications, DASFAA 2014 - Bali, Indonesia Duration: 21 Apr 2014 → 24 Apr 2014

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	8505 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	19th International Conference on Database Systems for Advanced Applications, DASFAA 2014
Country/Territory	Indonesia
City	Bali
Period	21/04/14 → 24/04/14

Bibliographical note

Funding Information:
This work has been partially funded by the European Research Council under the FP7, ERC grant MoDaS, agreement 291071, and by the Israel Ministry of Science.

Access to Document

10.1007/978-3-662-43984-5_27

Cite this

Amarilli, A., Amsterdamer, Y., & Milo, T. (2014). Uncertainty in crowd data sourcing under structural constraints. In Database Systems for Advanced Applications - 19th International Conference, DASFAA 2014, International Workshops: BDMA, DaMEN, SIM3, UnCrowd, Revised Selected Papers (pp. 351-359). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8505 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-662-43984-5_27

Amarilli, Antoine ; Amsterdamer, Yael ; Milo, Tova. / Uncertainty in crowd data sourcing under structural constraints. Database Systems for Advanced Applications - 19th International Conference, DASFAA 2014, International Workshops: BDMA, DaMEN, SIM3, UnCrowd, Revised Selected Papers. Springer Verlag, 2014. pp. 351-359 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{fa97b7eaf5334e0e97d109fbd2a839ad,

title = "Uncertainty in crowd data sourcing under structural constraints",

abstract = "Applications extracting data from crowdsourcing platforms must deal with the uncertainty of crowd answers in two different ways: first, by deriving estimates of the correct value from the answers; second, by choosing crowd questions whose answers are expected to minimize this uncertainty relative to the overall data collection goal. Such problems are already challenging when we assume that questions are unrelated and answers are independent, but they are even more complicated when we assume that the unknown values follow hard structural constraints (such as monotonicity). In this vision paper, we examine how to formally address this issue with an approach inspired by [2]. We describe a generalized setting where we model constraints as linear inequalities, and use them to guide the choice of crowd questions and the processing of answers. We present the main challenges arising in this setting, and propose directions to solve them.",

author = "Antoine Amarilli and Yael Amsterdamer and Tova Milo",

note = "Funding Information: This work has been partially funded by the European Research Council under the FP7, ERC grant MoDaS, agreement 291071, and by the Israel Ministry of Science. ; 19th International Conference on Database Systems for Advanced Applications, DASFAA 2014 ; Conference date: 21-04-2014 Through 24-04-2014",

year = "2014",

doi = "10.1007/978-3-662-43984-5_27",

language = "אנגלית",

isbn = "9783662439838",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "351--359",

booktitle = "Database Systems for Advanced Applications - 19th International Conference, DASFAA 2014, International Workshops",

address = "גרמניה",

}

Amarilli, A, Amsterdamer, Y & Milo, T 2014, Uncertainty in crowd data sourcing under structural constraints. in Database Systems for Advanced Applications - 19th International Conference, DASFAA 2014, International Workshops: BDMA, DaMEN, SIM3, UnCrowd, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8505 LNCS, Springer Verlag, pp. 351-359, 19th International Conference on Database Systems for Advanced Applications, DASFAA 2014, Bali, Indonesia, 21/04/14. https://doi.org/10.1007/978-3-662-43984-5_27

Uncertainty in crowd data sourcing under structural constraints. / Amarilli, Antoine; Amsterdamer, Yael; Milo, Tova.
Database Systems for Advanced Applications - 19th International Conference, DASFAA 2014, International Workshops: BDMA, DaMEN, SIM3, UnCrowd, Revised Selected Papers. Springer Verlag, 2014. p. 351-359 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8505 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Uncertainty in crowd data sourcing under structural constraints

AU - Amarilli, Antoine

AU - Amsterdamer, Yael

AU - Milo, Tova

N1 - Funding Information: This work has been partially funded by the European Research Council under the FP7, ERC grant MoDaS, agreement 291071, and by the Israel Ministry of Science.

PY - 2014

Y1 - 2014

N2 - Applications extracting data from crowdsourcing platforms must deal with the uncertainty of crowd answers in two different ways: first, by deriving estimates of the correct value from the answers; second, by choosing crowd questions whose answers are expected to minimize this uncertainty relative to the overall data collection goal. Such problems are already challenging when we assume that questions are unrelated and answers are independent, but they are even more complicated when we assume that the unknown values follow hard structural constraints (such as monotonicity). In this vision paper, we examine how to formally address this issue with an approach inspired by [2]. We describe a generalized setting where we model constraints as linear inequalities, and use them to guide the choice of crowd questions and the processing of answers. We present the main challenges arising in this setting, and propose directions to solve them.

AB - Applications extracting data from crowdsourcing platforms must deal with the uncertainty of crowd answers in two different ways: first, by deriving estimates of the correct value from the answers; second, by choosing crowd questions whose answers are expected to minimize this uncertainty relative to the overall data collection goal. Such problems are already challenging when we assume that questions are unrelated and answers are independent, but they are even more complicated when we assume that the unknown values follow hard structural constraints (such as monotonicity). In this vision paper, we examine how to formally address this issue with an approach inspired by [2]. We describe a generalized setting where we model constraints as linear inequalities, and use them to guide the choice of crowd questions and the processing of answers. We present the main challenges arising in this setting, and propose directions to solve them.

UR - http://www.scopus.com/inward/record.url?scp=84958550980&partnerID=8YFLogxK

U2 - 10.1007/978-3-662-43984-5_27

DO - 10.1007/978-3-662-43984-5_27

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:84958550980

SN - 9783662439838

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 351

EP - 359

BT - Database Systems for Advanced Applications - 19th International Conference, DASFAA 2014, International Workshops

PB - Springer Verlag

T2 - 19th International Conference on Database Systems for Advanced Applications, DASFAA 2014

Y2 - 21 April 2014 through 24 April 2014

ER -

Amarilli A, Amsterdamer Y, Milo T. Uncertainty in crowd data sourcing under structural constraints. In Database Systems for Advanced Applications - 19th International Conference, DASFAA 2014, International Workshops: BDMA, DaMEN, SIM3, UnCrowd, Revised Selected Papers. Springer Verlag. 2014. p. 351-359. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-662-43984-5_27

Uncertainty in crowd data sourcing under structural constraints

Abstract

Publication series

Conference

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this