Evaluating NLP Models via Contrast Sets

Matt Gardner; Yoav Artzi; Victoria Basmova; Jonathan Berant; Ben Bogin; Sihao Chen; Pradeep Dasigi; Dheeru Dua; Yanai Elazar; Ananth Gottumukkala; Nitish Gupta; Hanna Hajishirzi; Gabriel Ilharco; Daniel Khashabi; Kevin Lin; Jiangming Liu; Nelson F. Liu; Phoebe Mulcaire; Qiang Ning; Sameer Singh; Noah A. Smith; Sanjay Subramanian; Reut Tsarfaty; Eric Wallace; Ally Zhang; Ben Zhou

Evaluating NLP Models via Contrast Sets

Matt Gardner, Yoav Artzi, Victoria Basmova, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hanna Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F. Liu, Phoebe Mulcaire, Qiang Ning, Sameer SinghNoah A. Smith, Sanjay Subramanian, Reut Tsarfaty, Eric Wallace, Ally Zhang, Ben Zhou

Allen Institute for AI

Research output: Working paper / Preprint › Preprint

Original language	English
Volume	abs/2004.02709
State	Published - 2020

Publication series

Name	CoRR
Publisher	Cornell University Library, arXiv.org

Access to Document

https://arxiv.org/abs/2004.02709

Cite this

@techreport{c26d6e0886b6446fa4b717e9f238ad8e,

title = "Evaluating NLP Models via Contrast Sets",

author = "Matt Gardner and Yoav Artzi and Victoria Basmova and Jonathan Berant and Ben Bogin and Sihao Chen and Pradeep Dasigi and Dheeru Dua and Yanai Elazar and Ananth Gottumukkala and Nitish Gupta and Hanna Hajishirzi and Gabriel Ilharco and Daniel Khashabi and Kevin Lin and Jiangming Liu and Liu, {Nelson F.} and Phoebe Mulcaire and Qiang Ning and Sameer Singh and Smith, {Noah A.} and Sanjay Subramanian and Reut Tsarfaty and Eric Wallace and Ally Zhang and Ben Zhou",

year = "2020",

language = "אנגלית",

volume = "abs/2004.02709",

series = "CoRR",

publisher = "Cornell University Library, arXiv.org",

type = "WorkingPaper",

institution = "Cornell University Library, arXiv.org",

}

Gardner, M, Artzi, Y, Basmova, V, Berant, J, Bogin, B, Chen, S, Dasigi, P, Dua, D, Elazar, Y, Gottumukkala, A, Gupta, N, Hajishirzi, H, Ilharco, G, Khashabi, D, Lin, K, Liu, J, Liu, NF, Mulcaire, P, Ning, Q, Singh, S, Smith, NA, Subramanian, S, Tsarfaty, R, Wallace, E, Zhang, A & Zhou, B 2020 'Evaluating NLP Models via Contrast Sets' CoRR. <https://arxiv.org/abs/2004.02709>

TY - UNPB

T1 - Evaluating NLP Models via Contrast Sets

AU - Gardner, Matt

AU - Artzi, Yoav

AU - Basmova, Victoria

AU - Berant, Jonathan

AU - Bogin, Ben

AU - Chen, Sihao

AU - Dasigi, Pradeep

AU - Dua, Dheeru

AU - Elazar, Yanai

AU - Gottumukkala, Ananth

AU - Gupta, Nitish

AU - Hajishirzi, Hanna

AU - Ilharco, Gabriel

AU - Khashabi, Daniel

AU - Lin, Kevin

AU - Liu, Jiangming

AU - Liu, Nelson F.

AU - Mulcaire, Phoebe

AU - Ning, Qiang

AU - Singh, Sameer

AU - Smith, Noah A.

AU - Subramanian, Sanjay

AU - Tsarfaty, Reut

AU - Wallace, Eric

AU - Zhang, Ally

AU - Zhou, Ben

PY - 2020

Y1 - 2020

M3 - פרסום מוקדם

VL - abs/2004.02709

T3 - CoRR

BT - Evaluating NLP Models via Contrast Sets

ER -