Abstract
An established method for Word Sense Induction (WSI) uses a language model to predict probable substitutes for target words, and induces senses by clustering these resulting substitute vectors. We replace the ngram-based language model (LM) with a recurrent one. Beyond being more accurate, the use of the recurrent LM allows us to effectively query it in a creative way, using what we call dynamic symmetric patterns. The combination of the RNN-LM and the dynamic symmetric patterns results in strong substitute vectors for WSI, allowing to surpass the current state-of-the-art on the SemEval 2013 WSI shared task by a large margin.
Original language | English |
---|---|
Title of host publication | Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP 2018 |
Editors | Ellen Riloff, David Chiang, Julia Hockenmaier, Jun'ichi Tsujii |
Publisher | Association for Computational Linguistics |
Pages | 4860-4867 |
Number of pages | 8 |
ISBN (Electronic) | 9781948087841 |
State | Published - 2018 |
Event | 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP 2018 - Brussels, Belgium Duration: 31 Oct 2018 → 4 Nov 2018 |
Publication series
Name | Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP 2018 |
---|
Conference
Conference | 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP 2018 |
---|---|
Country/Territory | Belgium |
City | Brussels |
Period | 31/10/18 → 4/11/18 |
Bibliographical note
Publisher Copyright:© 2018 Association for Computational Linguistics
Funding
The work was supported in part by the Israeli Science Foundation (grant number 1555/15 and the German Research Foundation via the German-Israeli Project Cooperation (DIP, grant DA 1600/1-1). Acknowledgments The work was supported in part by the Israeli Science Foundation (grant number 1555/15 and the German Research Foundation via the German-Israeli Project Cooperation (DIP, grant DA 1600/1-1).
Funders | Funder number |
---|---|
DIP | DA 1600/1-1 |
German-Israeli Project Cooperation | |
Israeli Science Foundation | 1555/15 |
Deutsche Forschungsgemeinschaft | |
Israel Science Foundation |