Abstract
Adequate crowd selection is an important factor in the success of crowdsourcing platforms, increasing the quality and relevance of crowd answers and their performance in different tasks. The optimal crowd selection can greatly vary depending on properties of the crowd and of the task. To this end, we present December, a declarative platform with novel capabilities for exible crowd selection. December supports the personalized selection of crowd members via a dedicated query language Member-QL. This language enables specifying and combining common crowd selection criteria such as properties of a crowd member's profile and history, similarity between profiles in specific aspects and relevance of the member to a given task. This holistic, customizable approach differs from previous work that has mostly focused on dedicated algorithms for crowd selection in specific settings. To allow efficient query execution, we implement novel algorithms in December based on our generic, semanticallyaware definitions of crowd member similarity and expertise. We demonstrate the effectiveness of December and Member- QL by using the VLDB community as crowd members and allowing conference participants to choose from among these members for different purposes and in different contexts.
Original language | English |
---|---|
Pages (from-to) | 1485-1488 |
Number of pages | 4 |
Journal | Proceedings of the VLDB Endowment |
Volume | 9 |
Issue number | 13 |
DOIs | |
State | Published - 2015 |
Event | 42nd International Conference on Very Large Data Bases, VLDB 2016 - New Delhi, India Duration: 5 Sep 2016 → 9 Sep 2016 |
Bibliographical note
Publisher Copyright:© 2016 VLDB.
Funding
We thank Susan Davidson for fruitful discussions about the query language. This work has been partially funded by the European Research Council under the FP7, ERC grant MoDaS, agreement 29107.
Funders | Funder number |
---|---|
European Commission | 29107 |
Seventh Framework Programme |