Morphological inflection generation with hard monotonic attention

Roee Aharoni; Yoav Goldberg

doi:10.18653/v1/P17-1183

Morphological inflection generation with hard monotonic attention

Roee Aharoni
, Yoav Goldberg

Department of Computer Science and Artificial Intelligence

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

90 Scopus citations

Abstract

We present a neural model for morphological inflection generation which employs a hard attention mechanism, inspired by the nearly-monotonic alignment commonly found between the characters in a word and the characters in its inflection. We evaluate the model on three previously studied morphological inflection generation datasets and show that it provides state of the art results in various setups compared to previous neural and non-neural approaches. Finally we present an analysis of the continuous representations learned by both the hard and soft attention (Bahdanau et al., 2015) models for the task, shedding some light on the features such models extract.

Original language	English
Title of host publication	ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)
Publisher	Association for Computational Linguistics (ACL)
Pages	2004-2015
Number of pages	12
ISBN (Electronic)	9781945626753
DOIs	https://doi.org/10.18653/v1/P17-1183
State	Published - 2017
Event	55th Annual Meeting of the Association for Computational Linguistics, ACL 2017 - Vancouver, Canada Duration: 30 Jul 2017 → 4 Aug 2017

Publication series

Name	ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)
Volume	1

Conference

Conference	55th Annual Meeting of the Association for Computational Linguistics, ACL 2017
Country/Territory	Canada
City	Vancouver
Period	30/07/17 → 4/08/17

Bibliographical note

Publisher Copyright:
© 2017 Association for Computational Linguistics.

Funding

This work was supported by the Intel Collaborative Research Institute for Computational Intelligence (ICRI-CI), and The Israeli Science Foundation (grant number 1555/15).

Funders	Funder number
Israeli Science Foundation	1555/15
National Intelligence Service
Israel Science Foundation
Intel Collaboration Research Institute for Computational Intelligence

Access to Document

10.18653/v1/P17-1183

Cite this

Aharoni, R., & Goldberg, Y. (2017). Morphological inflection generation with hard monotonic attention. In ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers) (pp. 2004-2015). (ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers); Vol. 1). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/P17-1183

Aharoni, Roee ; Goldberg, Yoav. / Morphological inflection generation with hard monotonic attention. ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers). Association for Computational Linguistics (ACL), 2017. pp. 2004-2015 (ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)).

@inproceedings{8e740305a15c469abffa27615fc9a05b,

title = "Morphological inflection generation with hard monotonic attention",

abstract = "We present a neural model for morphological inflection generation which employs a hard attention mechanism, inspired by the nearly-monotonic alignment commonly found between the characters in a word and the characters in its inflection. We evaluate the model on three previously studied morphological inflection generation datasets and show that it provides state of the art results in various setups compared to previous neural and non-neural approaches. Finally we present an analysis of the continuous representations learned by both the hard and soft attention (Bahdanau et al., 2015) models for the task, shedding some light on the features such models extract.",

author = "Roee Aharoni and Yoav Goldberg",

note = "Publisher Copyright: {\textcopyright} 2017 Association for Computational Linguistics.; 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017 ; Conference date: 30-07-2017 Through 04-08-2017",

year = "2017",

doi = "10.18653/v1/P17-1183",

language = "אנגלית",

series = "ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)",

publisher = "Association for Computational Linguistics (ACL)",

pages = "2004--2015",

booktitle = "ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)",

address = "ארצות הברית",

}

Aharoni, R & Goldberg, Y 2017, Morphological inflection generation with hard monotonic attention. in ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers). ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers), vol. 1, Association for Computational Linguistics (ACL), pp. 2004-2015, 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, 30/07/17. https://doi.org/10.18653/v1/P17-1183

Morphological inflection generation with hard monotonic attention. / Aharoni, Roee; Goldberg, Yoav.
ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers). Association for Computational Linguistics (ACL), 2017. p. 2004-2015 (ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers); Vol. 1).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Morphological inflection generation with hard monotonic attention

AU - Aharoni, Roee

AU - Goldberg, Yoav

PY - 2017

Y1 - 2017

N2 - We present a neural model for morphological inflection generation which employs a hard attention mechanism, inspired by the nearly-monotonic alignment commonly found between the characters in a word and the characters in its inflection. We evaluate the model on three previously studied morphological inflection generation datasets and show that it provides state of the art results in various setups compared to previous neural and non-neural approaches. Finally we present an analysis of the continuous representations learned by both the hard and soft attention (Bahdanau et al., 2015) models for the task, shedding some light on the features such models extract.

AB - We present a neural model for morphological inflection generation which employs a hard attention mechanism, inspired by the nearly-monotonic alignment commonly found between the characters in a word and the characters in its inflection. We evaluate the model on three previously studied morphological inflection generation datasets and show that it provides state of the art results in various setups compared to previous neural and non-neural approaches. Finally we present an analysis of the continuous representations learned by both the hard and soft attention (Bahdanau et al., 2015) models for the task, shedding some light on the features such models extract.

UR - https://www.scopus.com/pages/publications/85040916628

U2 - 10.18653/v1/P17-1183

DO - 10.18653/v1/P17-1183

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85040916628

T3 - ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)

SP - 2004

EP - 2015

BT - ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)

PB - Association for Computational Linguistics (ACL)

T2 - 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017

Y2 - 30 July 2017 through 4 August 2017

ER -

Aharoni R, Goldberg Y. Morphological inflection generation with hard monotonic attention. In ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers). Association for Computational Linguistics (ACL). 2017. p. 2004-2015. (ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)). doi: 10.18653/v1/P17-1183

Morphological inflection generation with hard monotonic attention

Abstract

Publication series

Conference

Bibliographical note

Funding

Access to Document

Other files and links

Fingerprint

Cite this