LieCatcher: Game Framework for Collecting Human Judgments of Deceptive Speech

Sarah Ita Levitan; Xinyue Tan; Julia Hirschberg

doi:10.1145/3382507.3421166

LieCatcher: Game Framework for Collecting Human Judgments of Deceptive Speech

Sarah Ita Levitan
, Xinyue Tan
, Julia Hirschberg

Columbia University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

Humans are notoriously poor at detecting deception - most are worse than chance. To address this issue we have developed LieCatcher, a single-player web-based Game With A Purpose (GWAP) that allows players to assess their lie detection skills while providing human judgments of deceptive speech. Players listen to audio recordings drawn from a corpus of deceptive and non-deceptive interview dialogues, and guess if the speaker is lying or telling the truth. They are awarded points for correct guesses and at the end of the game they receive a score summarizing their performance at lie detection. We present the game design and implementation, and describe a crowdsourcing experiment conducted to study perceived deception.

Original language	English
Title of host publication	ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction
Publisher	Association for Computing Machinery, Inc
Pages	762-763
Number of pages	2
ISBN (Electronic)	9781450375818
DOIs	https://doi.org/10.1145/3382507.3421166
State	Published - 21 Oct 2020
Externally published	Yes
Event	22nd ACM International Conference on Multimodal Interaction, ICMI 2020 - Virtual, Online, Netherlands Duration: 25 Oct 2020 → 29 Oct 2020

Publication series

Name	ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction

Conference

Conference	22nd ACM International Conference on Multimodal Interaction, ICMI 2020
Country/Territory	Netherlands
City	Virtual, Online
Period	25/10/20 → 29/10/20

Bibliographical note

Publisher Copyright:
© 2020 Owner/Author.

Keywords

deception
games with a purpose
speech annotation
trust

Access to Document

10.1145/3382507.3421166

Cite this

Levitan, S. I., Tan, X., & Hirschberg, J. (2020). LieCatcher: Game Framework for Collecting Human Judgments of Deceptive Speech. In ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction (pp. 762-763). (ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction). Association for Computing Machinery, Inc. https://doi.org/10.1145/3382507.3421166

Levitan, Sarah Ita ; Tan, Xinyue ; Hirschberg, Julia. / LieCatcher : Game Framework for Collecting Human Judgments of Deceptive Speech. ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction. Association for Computing Machinery, Inc, 2020. pp. 762-763 (ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction).

@inproceedings{6aff2d84d1e943da9c39e37cd93de6d8,

title = "LieCatcher: Game Framework for Collecting Human Judgments of Deceptive Speech",

abstract = "Humans are notoriously poor at detecting deception - most are worse than chance. To address this issue we have developed LieCatcher, a single-player web-based Game With A Purpose (GWAP) that allows players to assess their lie detection skills while providing human judgments of deceptive speech. Players listen to audio recordings drawn from a corpus of deceptive and non-deceptive interview dialogues, and guess if the speaker is lying or telling the truth. They are awarded points for correct guesses and at the end of the game they receive a score summarizing their performance at lie detection. We present the game design and implementation, and describe a crowdsourcing experiment conducted to study perceived deception.",

keywords = "deception, games with a purpose, speech annotation, trust",

author = "Levitan, \{Sarah Ita\} and Xinyue Tan and Julia Hirschberg",

note = "Publisher Copyright: {\textcopyright} 2020 Owner/Author.; 22nd ACM International Conference on Multimodal Interaction, ICMI 2020 ; Conference date: 25-10-2020 Through 29-10-2020",

year = "2020",

month = oct,

day = "21",

doi = "10.1145/3382507.3421166",

language = "אנגלית",

series = "ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction",

publisher = "Association for Computing Machinery, Inc",

pages = "762--763",

booktitle = "ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction",

}

Levitan, SI, Tan, X & Hirschberg, J 2020, LieCatcher: Game Framework for Collecting Human Judgments of Deceptive Speech. in ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction. ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction, Association for Computing Machinery, Inc, pp. 762-763, 22nd ACM International Conference on Multimodal Interaction, ICMI 2020, Virtual, Online, Netherlands, 25/10/20. https://doi.org/10.1145/3382507.3421166

LieCatcher: Game Framework for Collecting Human Judgments of Deceptive Speech. / Levitan, Sarah Ita; Tan, Xinyue; Hirschberg, Julia.
ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction. Association for Computing Machinery, Inc, 2020. p. 762-763 (ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - LieCatcher

T2 - 22nd ACM International Conference on Multimodal Interaction, ICMI 2020

AU - Levitan, Sarah Ita

AU - Tan, Xinyue

AU - Hirschberg, Julia

PY - 2020/10/21

Y1 - 2020/10/21

N2 - Humans are notoriously poor at detecting deception - most are worse than chance. To address this issue we have developed LieCatcher, a single-player web-based Game With A Purpose (GWAP) that allows players to assess their lie detection skills while providing human judgments of deceptive speech. Players listen to audio recordings drawn from a corpus of deceptive and non-deceptive interview dialogues, and guess if the speaker is lying or telling the truth. They are awarded points for correct guesses and at the end of the game they receive a score summarizing their performance at lie detection. We present the game design and implementation, and describe a crowdsourcing experiment conducted to study perceived deception.

AB - Humans are notoriously poor at detecting deception - most are worse than chance. To address this issue we have developed LieCatcher, a single-player web-based Game With A Purpose (GWAP) that allows players to assess their lie detection skills while providing human judgments of deceptive speech. Players listen to audio recordings drawn from a corpus of deceptive and non-deceptive interview dialogues, and guess if the speaker is lying or telling the truth. They are awarded points for correct guesses and at the end of the game they receive a score summarizing their performance at lie detection. We present the game design and implementation, and describe a crowdsourcing experiment conducted to study perceived deception.

KW - deception

KW - games with a purpose

KW - speech annotation

KW - trust

UR - https://www.scopus.com/pages/publications/85096705326

U2 - 10.1145/3382507.3421166

DO - 10.1145/3382507.3421166

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85096705326

T3 - ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction

SP - 762

EP - 763

BT - ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction

PB - Association for Computing Machinery, Inc

Y2 - 25 October 2020 through 29 October 2020

ER -

Levitan SI, Tan X, Hirschberg J. LieCatcher: Game Framework for Collecting Human Judgments of Deceptive Speech. In ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction. Association for Computing Machinery, Inc. 2020. p. 762-763. (ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction). doi: 10.1145/3382507.3421166

LieCatcher: Game Framework for Collecting Human Judgments of Deceptive Speech

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this