McPhraSy: Multi-Context Phrase Similarity and Clustering

Amir D.N. Cohen, Hila Gonen, Ori Shapira, Ran Levy, Yoav Goldberg

Research output: Contribution to conferencePaperpeer-review

2 Scopus citations

Abstract

Phrase similarity is a key component of many NLP applications. Current phrase similarity methods focus on embedding the phrase itself and use the phrase context only during training of the pretrained model. To better leverage the information in the context, we propose McPhraSy (Multi-context Phrase Similarity), a novel algorithm for estimating the similarity of phrases based on multiple contexts. At inference time, McPhraSy represents each phrase by considering multiple contexts in which it appears and computes the similarity of two phrases by aggregating the pairwise similarities between the contexts of the phrases. Incorporating context during inference enables McPhraSy to outperform current state-of-the-art models on two phrase similarity datasets by up to 13.3%. Finally, we also present a new downstream task that relies on phrase similarity - keyphrase clustering - and create a new benchmark for it in the product reviews domain. We show that McPhraSy surpasses all other baselines for this task.

Original languageEnglish
Pages3538-3550
Number of pages13
StatePublished - 2022
Event2022 Findings of the Association for Computational Linguistics: EMNLP 2022 - Abu Dhabi, United Arab Emirates
Duration: 7 Dec 202211 Dec 2022

Conference

Conference2022 Findings of the Association for Computational Linguistics: EMNLP 2022
Country/TerritoryUnited Arab Emirates
CityAbu Dhabi
Period7/12/2211/12/22

Bibliographical note

Publisher Copyright:
© 2022 Association for Computational Linguistics.

Funding

This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme, grant agreement No. 802774 (iEX-TRACT). This project has received funding from the European Research Council (ERC) under the European Union's Horizon 2020 research and innovation programme, grant agreement No. 802774 (iEXTRACT).

FundersFunder number
Horizon 2020 Framework Programme
European Commission
Horizon 2020802774

    Fingerprint

    Dive into the research topics of 'McPhraSy: Multi-Context Phrase Similarity and Clustering'. Together they form a unique fingerprint.

    Cite this