UniMorph 4.0: Universal Morphology

Khuyagbaatar Batsuren; Omer Goldman; Salam Khalifa; Nizar Habash; Witold Kieraś; Gábor Bella; Brian Leonard; Garrett Nicolai; Kyle Gorman; Yustinus Ghanggo Ate; Maria Ryskina; Sabrina Mielke; Elena Budianskaya; Charbel El-Khaissi; Tiago Pimentel; Michael Gasser; William Lane; Mohit Raj; Matt Coler; Jaime Rafael Montoya Samame; Delio Siticonatzi Camaiteri; Esaú Zumaeta Rojas; Didier L. Francis; Arturo Oncevay; Juan L. Bautista; Gema Celeste Silva Villegas; Lucas Torroba Hennigen; Adam Ek; David Guriel; Peter Dirix; Jean Philippe Bernardy; Andrey Scherbakov; Aziyana Bayyr-Ool; Antonios Anastasopoulos; Roberto Zariquiey; Karina Sheifer; Sofya Ganieva; Hilaria Cruz; Ritván Karahóǧa; Stella Markantonatou; George Pavlidis; Matvey Plugaryov; Elena Klyachko; Ali Salehi; Candy Angulo; Jatayu Baxi; Andrew Krizhanovsky; Natalia Krizhanovsky; Elizabeth Salesky; Clara Vania; Sardana Ivanova; Jennifer White; Rowan Hall Maudslay; Josef Valvoda; Ran Zmigrod; Paula Czarnowska; Irene Nikkarinen; Aelita Salchak; Brijesh Bhatt; Christopher Straughn; Zoey Liu; Jonathan North Washington; Yuval Pinter; Duygu Ataman; Marcin Woliński; Totok Suhardijanto; Anna Yablonskaya; Niklas Stoehr; Hossep Dolatian; Zahroh Nuriah; Shyam Ratan; Francis M. Tyers; Edoardo M. Ponti; Grant Aiton; Aryaman Arora; Richard J. Hatcher; Ritesh Kumar; Jeremiah Young; Daria Rodionova; Anastasia Yemelina; Taras Andrushko; Igor Marchenko; Polina Mashkovtseva; Alexandra Serova; Emily Prud'Hommeaux; Maria Nepomniashchaya; Fausto Giunchiglia; Eleanor Chodroff; Mans Hulden; Miikka Silfverberg; Arya D. McCarthy; David Yarowsky; Ryan Cotterell; Reut Tsarfaty; Ekaterina Vylomova

UniMorph 4.0: Universal Morphology

Khuyagbaatar Batsuren, Omer Goldman, Salam Khalifa, Nizar Habash, Witold Kieraś, Gábor Bella, Brian Leonard, Garrett Nicolai, Kyle Gorman, Yustinus Ghanggo Ate, Maria Ryskina, Sabrina Mielke, Elena Budianskaya, Charbel El-Khaissi, Tiago Pimentel, Michael Gasser, William Lane, Mohit Raj, Matt Coler, Jaime Rafael Montoya SamameDelio Siticonatzi Camaiteri, Esaú Zumaeta Rojas, Didier L. Francis, Arturo Oncevay, Juan L. Bautista, Gema Celeste Silva Villegas, Lucas Torroba Hennigen, Adam Ek, David Guriel, Peter Dirix, Jean Philippe Bernardy, Andrey Scherbakov, Aziyana Bayyr-Ool, Antonios Anastasopoulos, Roberto Zariquiey, Karina Sheifer, Sofya Ganieva, Hilaria Cruz, Ritván Karahóǧa, Stella Markantonatou, George Pavlidis, Matvey Plugaryov, Elena Klyachko, Ali Salehi, Candy Angulo, Jatayu Baxi, Andrew Krizhanovsky, Natalia Krizhanovsky, Elizabeth Salesky, Clara Vania, Sardana Ivanova, Jennifer White, Rowan Hall Maudslay, Josef Valvoda, Ran Zmigrod, Paula Czarnowska, Irene Nikkarinen, Aelita Salchak, Brijesh Bhatt, Christopher Straughn, Zoey Liu, Jonathan North Washington, Yuval Pinter, Duygu Ataman, Marcin Woliński, Totok Suhardijanto, Anna Yablonskaya, Niklas Stoehr, Hossep Dolatian, Zahroh Nuriah, Shyam Ratan, Francis M. Tyers, Edoardo M. Ponti, Grant Aiton, Aryaman Arora, Richard J. Hatcher, Ritesh Kumar, Jeremiah Young, Daria Rodionova, Anastasia Yemelina, Taras Andrushko, Igor Marchenko, Polina Mashkovtseva, Alexandra Serova, Emily Prud'Hommeaux, Maria Nepomniashchaya, Fausto Giunchiglia, Eleanor Chodroff, Mans Hulden, Miikka Silfverberg, Arya D. McCarthy, David Yarowsky, Ryan Cotterell, Reut Tsarfaty, Ekaterina Vylomova

Department of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

33 Scopus citations

Abstract

The Universal Morphology (UniMorph) project is a collaborative effort providing broad-coverage instantiated normalized morphological inflection tables for hundreds of diverse world languages. The project comprises two major thrusts: a language-independent feature schema for rich morphological annotation and a type-level resource of annotated data in diverse languages realizing that schema. This paper presents the expansions and improvements made on several fronts over the last couple of years (since McCarthy et al. (2020)). Collaborative efforts by numerous linguists have added 67 new languages, including 30 endangered languages. We have implemented several improvements to the extraction pipeline to tackle some issues, e.g. missing gender and macron information. We have also amended the schema to use a hierarchical structure that is needed for morphological phenomena like multiple-argument agreement and case stacking, while adding some missing morphological features to make the schema more inclusive. In light of the last UniMorph release, we also augmented the database with morpheme segmentation for 16 languages. Lastly, this new release makes a push towards inclusion of derivational morphology in UniMorph by enriching the data and annotation schema with instances representing derivational processes from MorphyNet.

Original language	English
Title of host publication	2022 Language Resources and Evaluation Conference, LREC 2022
Editors	Nicoletta Calzolari, Frederic Bechet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Helene Mazo, Jan Odijk, Stelios Piperidis
Publisher	European Language Resources Association (ELRA)
Pages	840-855
Number of pages	16
ISBN (Electronic)	9791095546726
State	Published - 2022
Event	13th International Conference on Language Resources and Evaluation Conference, LREC 2022 - Marseille, France Duration: 20 Jun 2022 → 25 Jun 2022

Publication series

Name	2022 Language Resources and Evaluation Conference, LREC 2022

Conference

Conference	13th International Conference on Language Resources and Evaluation Conference, LREC 2022
Country/Territory	France
City	Marseille
Period	20/06/22 → 25/06/22

Bibliographical note

Publisher Copyright:
© European Language Resources Association (ELRA), licensed under CC-BY-NC-4.0.

Funding

Pomácko, Pomáhcku or other dialectic variants) is a non-standardised East South Slavic (ESS) language variety mainly spoken in the region of Greek Thrace, as well as in places of Pomak diaspora. Pomak is included in the map of the European Languages Equality Network.7 In comparison to all ESS languages, Pomak exhibits a more profound phonological, morphological, morphosyntactic and lexical influence by Medieval and Modern Greek and, due to the predominantly Muslim religion of its speakers, a more profound lexical and phonotactical influence by Ottoman and Modern Turkish. The Pomak data were collected by linguist and native Pomak speaker Ritván Karahógˇa, under the “PHILOTIS: State-of-the-art technologies for the recording, analysis and documentation of living languages” project (MIS 5047429), which is implemented under the “Action for the Support of Regional Excellence”, funded by the Operational Programme “Competitiveness, Entrepreneurship and Innovation” (NSRF 2014-2020) and co-financed by Greece and the European Union (European Regional Development Fund). The final dataset includes 233,533 lemmas and a total of 6,557,759 word-forms covering adjectives, nouns, and verbs. OG and RT wish to thank ERC grant no. 677352.

Funders	Funder number
European Commission
European Commission	677352
European Regional Development Fund

Cite this

Batsuren, K., Goldman, O., Khalifa, S., Habash, N., Kieraś, W., Bella, G., Leonard, B., Nicolai, G., Gorman, K., Ghanggo Ate, Y., Ryskina, M., Mielke, S., Budianskaya, E., El-Khaissi, C., Pimentel, T., Gasser, M., Lane, W., Raj, M., Coler, M., ... Vylomova, E. (2022). UniMorph 4.0: Universal Morphology. In N. Calzolari, F. Bechet, P. Blache, K. Choukri, C. Cieri, T. Declerck, S. Goggi, H. Isahara, B. Maegaard, J. Mariani, H. Mazo, J. Odijk, & S. Piperidis (Eds.), 2022 Language Resources and Evaluation Conference, LREC 2022 (pp. 840-855). (2022 Language Resources and Evaluation Conference, LREC 2022). European Language Resources Association (ELRA).

Batsuren, Khuyagbaatar ; Goldman, Omer ; Khalifa, Salam et al. / UniMorph 4.0 : Universal Morphology. 2022 Language Resources and Evaluation Conference, LREC 2022. editor / Nicoletta Calzolari ; Frederic Bechet ; Philippe Blache ; Khalid Choukri ; Christopher Cieri ; Thierry Declerck ; Sara Goggi ; Hitoshi Isahara ; Bente Maegaard ; Joseph Mariani ; Helene Mazo ; Jan Odijk ; Stelios Piperidis. European Language Resources Association (ELRA), 2022. pp. 840-855 (2022 Language Resources and Evaluation Conference, LREC 2022).

@inproceedings{d76759f2ba5b47ffbd1f212a9a5d6825,

title = "UniMorph 4.0: Universal Morphology",

abstract = "The Universal Morphology (UniMorph) project is a collaborative effort providing broad-coverage instantiated normalized morphological inflection tables for hundreds of diverse world languages. The project comprises two major thrusts: a language-independent feature schema for rich morphological annotation and a type-level resource of annotated data in diverse languages realizing that schema. This paper presents the expansions and improvements made on several fronts over the last couple of years (since McCarthy et al. (2020)). Collaborative efforts by numerous linguists have added 67 new languages, including 30 endangered languages. We have implemented several improvements to the extraction pipeline to tackle some issues, e.g. missing gender and macron information. We have also amended the schema to use a hierarchical structure that is needed for morphological phenomena like multiple-argument agreement and case stacking, while adding some missing morphological features to make the schema more inclusive. In light of the last UniMorph release, we also augmented the database with morpheme segmentation for 16 languages. Lastly, this new release makes a push towards inclusion of derivational morphology in UniMorph by enriching the data and annotation schema with instances representing derivational processes from MorphyNet.",

author = "Khuyagbaatar Batsuren and Omer Goldman and Salam Khalifa and Nizar Habash and Witold Kiera{\'s} and G{\'a}bor Bella and Brian Leonard and Garrett Nicolai and Kyle Gorman and {Ghanggo Ate}, Yustinus and Maria Ryskina and Sabrina Mielke and Elena Budianskaya and Charbel El-Khaissi and Tiago Pimentel and Michael Gasser and William Lane and Mohit Raj and Matt Coler and Samame, {Jaime Rafael Montoya} and Camaiteri, {Delio Siticonatzi} and Rojas, {Esa{\'u} Zumaeta} and Francis, {Didier L.} and Arturo Oncevay and Bautista, {Juan L.} and Villegas, {Gema Celeste Silva} and Hennigen, {Lucas Torroba} and Adam Ek and David Guriel and Peter Dirix and Bernardy, {Jean Philippe} and Andrey Scherbakov and Aziyana Bayyr-Ool and Antonios Anastasopoulos and Roberto Zariquiey and Karina Sheifer and Sofya Ganieva and Hilaria Cruz and Ritv{\'a}n Karah{\'o}ǧa and Stella Markantonatou and George Pavlidis and Matvey Plugaryov and Elena Klyachko and Ali Salehi and Candy Angulo and Jatayu Baxi and Andrew Krizhanovsky and Natalia Krizhanovsky and Elizabeth Salesky and Clara Vania and Sardana Ivanova and Jennifer White and Maudslay, {Rowan Hall} and Josef Valvoda and Ran Zmigrod and Paula Czarnowska and Irene Nikkarinen and Aelita Salchak and Brijesh Bhatt and Christopher Straughn and Zoey Liu and Washington, {Jonathan North} and Yuval Pinter and Duygu Ataman and Marcin Woli{\'n}ski and Totok Suhardijanto and Anna Yablonskaya and Niklas Stoehr and Hossep Dolatian and Zahroh Nuriah and Shyam Ratan and Tyers, {Francis M.} and Ponti, {Edoardo M.} and Grant Aiton and Aryaman Arora and Hatcher, {Richard J.} and Ritesh Kumar and Jeremiah Young and Daria Rodionova and Anastasia Yemelina and Taras Andrushko and Igor Marchenko and Polina Mashkovtseva and Alexandra Serova and Emily Prud'Hommeaux and Maria Nepomniashchaya and Fausto Giunchiglia and Eleanor Chodroff and Mans Hulden and Miikka Silfverberg and McCarthy, {Arya D.} and David Yarowsky and Ryan Cotterell and Reut Tsarfaty and Ekaterina Vylomova",

note = "Publisher Copyright: {\textcopyright} European Language Resources Association (ELRA), licensed under CC-BY-NC-4.0.; 13th International Conference on Language Resources and Evaluation Conference, LREC 2022 ; Conference date: 20-06-2022 Through 25-06-2022",

year = "2022",

language = "אנגלית",

series = "2022 Language Resources and Evaluation Conference, LREC 2022",

publisher = "European Language Resources Association (ELRA)",

pages = "840--855",

editor = "Nicoletta Calzolari and Frederic Bechet and Philippe Blache and Khalid Choukri and Christopher Cieri and Thierry Declerck and Sara Goggi and Hitoshi Isahara and Bente Maegaard and Joseph Mariani and Helene Mazo and Jan Odijk and Stelios Piperidis",

booktitle = "2022 Language Resources and Evaluation Conference, LREC 2022",

}

Batsuren, K, Goldman, O, Khalifa, S, Habash, N, Kieraś, W, Bella, G, Leonard, B, Nicolai, G, Gorman, K, Ghanggo Ate, Y, Ryskina, M, Mielke, S, Budianskaya, E, El-Khaissi, C, Pimentel, T, Gasser, M, Lane, W, Raj, M, Coler, M, Samame, JRM, Camaiteri, DS, Rojas, EZ, Francis, DL, Oncevay, A, Bautista, JL, Villegas, GCS, Hennigen, LT, Ek, A, Guriel, D, Dirix, P, Bernardy, JP, Scherbakov, A, Bayyr-Ool, A, Anastasopoulos, A, Zariquiey, R, Sheifer, K, Ganieva, S, Cruz, H, Karahóǧa, R, Markantonatou, S, Pavlidis, G, Plugaryov, M, Klyachko, E, Salehi, A, Angulo, C, Baxi, J, Krizhanovsky, A, Krizhanovsky, N, Salesky, E, Vania, C, Ivanova, S, White, J, Maudslay, RH, Valvoda, J, Zmigrod, R, Czarnowska, P, Nikkarinen, I, Salchak, A, Bhatt, B, Straughn, C, Liu, Z, Washington, JN, Pinter, Y, Ataman, D, Woliński, M, Suhardijanto, T, Yablonskaya, A, Stoehr, N, Dolatian, H, Nuriah, Z, Ratan, S, Tyers, FM, Ponti, EM, Aiton, G, Arora, A, Hatcher, RJ, Kumar, R, Young, J, Rodionova, D, Yemelina, A, Andrushko, T, Marchenko, I, Mashkovtseva, P, Serova, A, Prud'Hommeaux, E, Nepomniashchaya, M, Giunchiglia, F, Chodroff, E, Hulden, M, Silfverberg, M, McCarthy, AD, Yarowsky, D, Cotterell, R, Tsarfaty, R & Vylomova, E 2022, UniMorph 4.0: Universal Morphology. in N Calzolari, F Bechet, P Blache, K Choukri, C Cieri, T Declerck, S Goggi, H Isahara, B Maegaard, J Mariani, H Mazo, J Odijk & S Piperidis (eds), 2022 Language Resources and Evaluation Conference, LREC 2022. 2022 Language Resources and Evaluation Conference, LREC 2022, European Language Resources Association (ELRA), pp. 840-855, 13th International Conference on Language Resources and Evaluation Conference, LREC 2022, Marseille, France, 20/06/22.

UniMorph 4.0: Universal Morphology. / Batsuren, Khuyagbaatar; Goldman, Omer; Khalifa, Salam et al.
2022 Language Resources and Evaluation Conference, LREC 2022. ed. / Nicoletta Calzolari; Frederic Bechet; Philippe Blache; Khalid Choukri; Christopher Cieri; Thierry Declerck; Sara Goggi; Hitoshi Isahara; Bente Maegaard; Joseph Mariani; Helene Mazo; Jan Odijk; Stelios Piperidis. European Language Resources Association (ELRA), 2022. p. 840-855 (2022 Language Resources and Evaluation Conference, LREC 2022).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - UniMorph 4.0

T2 - 13th International Conference on Language Resources and Evaluation Conference, LREC 2022

AU - Batsuren, Khuyagbaatar

AU - Goldman, Omer

AU - Khalifa, Salam

AU - Habash, Nizar

AU - Kieraś, Witold

AU - Bella, Gábor

AU - Leonard, Brian

AU - Nicolai, Garrett

AU - Gorman, Kyle

AU - Ghanggo Ate, Yustinus

AU - Ryskina, Maria

AU - Mielke, Sabrina

AU - Budianskaya, Elena

AU - El-Khaissi, Charbel

AU - Pimentel, Tiago

AU - Gasser, Michael

AU - Lane, William

AU - Raj, Mohit

AU - Coler, Matt

AU - Samame, Jaime Rafael Montoya

AU - Camaiteri, Delio Siticonatzi

AU - Rojas, Esaú Zumaeta

AU - Francis, Didier L.

AU - Oncevay, Arturo

AU - Bautista, Juan L.

AU - Villegas, Gema Celeste Silva

AU - Hennigen, Lucas Torroba

AU - Ek, Adam

AU - Guriel, David

AU - Dirix, Peter

AU - Bernardy, Jean Philippe

AU - Scherbakov, Andrey

AU - Bayyr-Ool, Aziyana

AU - Anastasopoulos, Antonios

AU - Zariquiey, Roberto

AU - Sheifer, Karina

AU - Ganieva, Sofya

AU - Cruz, Hilaria

AU - Karahóǧa, Ritván

AU - Markantonatou, Stella

AU - Pavlidis, George

AU - Plugaryov, Matvey

AU - Klyachko, Elena

AU - Salehi, Ali

AU - Angulo, Candy

AU - Baxi, Jatayu

AU - Krizhanovsky, Andrew

AU - Krizhanovsky, Natalia

AU - Salesky, Elizabeth

AU - Vania, Clara

AU - Ivanova, Sardana

AU - White, Jennifer

AU - Maudslay, Rowan Hall

AU - Valvoda, Josef

AU - Zmigrod, Ran

AU - Czarnowska, Paula

AU - Nikkarinen, Irene

AU - Salchak, Aelita

AU - Bhatt, Brijesh

AU - Straughn, Christopher

AU - Liu, Zoey

AU - Washington, Jonathan North

AU - Pinter, Yuval

AU - Ataman, Duygu

AU - Woliński, Marcin

AU - Suhardijanto, Totok

AU - Yablonskaya, Anna

AU - Stoehr, Niklas

AU - Dolatian, Hossep

AU - Nuriah, Zahroh

AU - Ratan, Shyam

AU - Tyers, Francis M.

AU - Ponti, Edoardo M.

AU - Aiton, Grant

AU - Arora, Aryaman

AU - Hatcher, Richard J.

AU - Kumar, Ritesh

AU - Young, Jeremiah

AU - Rodionova, Daria

AU - Yemelina, Anastasia

AU - Andrushko, Taras

AU - Marchenko, Igor

AU - Mashkovtseva, Polina

AU - Serova, Alexandra

AU - Prud'Hommeaux, Emily

AU - Nepomniashchaya, Maria

AU - Giunchiglia, Fausto

AU - Chodroff, Eleanor

AU - Hulden, Mans

AU - Silfverberg, Miikka

AU - McCarthy, Arya D.

AU - Yarowsky, David

AU - Cotterell, Ryan

AU - Tsarfaty, Reut

AU - Vylomova, Ekaterina

PY - 2022

Y1 - 2022

N2 - The Universal Morphology (UniMorph) project is a collaborative effort providing broad-coverage instantiated normalized morphological inflection tables for hundreds of diverse world languages. The project comprises two major thrusts: a language-independent feature schema for rich morphological annotation and a type-level resource of annotated data in diverse languages realizing that schema. This paper presents the expansions and improvements made on several fronts over the last couple of years (since McCarthy et al. (2020)). Collaborative efforts by numerous linguists have added 67 new languages, including 30 endangered languages. We have implemented several improvements to the extraction pipeline to tackle some issues, e.g. missing gender and macron information. We have also amended the schema to use a hierarchical structure that is needed for morphological phenomena like multiple-argument agreement and case stacking, while adding some missing morphological features to make the schema more inclusive. In light of the last UniMorph release, we also augmented the database with morpheme segmentation for 16 languages. Lastly, this new release makes a push towards inclusion of derivational morphology in UniMorph by enriching the data and annotation schema with instances representing derivational processes from MorphyNet.

AB - The Universal Morphology (UniMorph) project is a collaborative effort providing broad-coverage instantiated normalized morphological inflection tables for hundreds of diverse world languages. The project comprises two major thrusts: a language-independent feature schema for rich morphological annotation and a type-level resource of annotated data in diverse languages realizing that schema. This paper presents the expansions and improvements made on several fronts over the last couple of years (since McCarthy et al. (2020)). Collaborative efforts by numerous linguists have added 67 new languages, including 30 endangered languages. We have implemented several improvements to the extraction pipeline to tackle some issues, e.g. missing gender and macron information. We have also amended the schema to use a hierarchical structure that is needed for morphological phenomena like multiple-argument agreement and case stacking, while adding some missing morphological features to make the schema more inclusive. In light of the last UniMorph release, we also augmented the database with morpheme segmentation for 16 languages. Lastly, this new release makes a push towards inclusion of derivational morphology in UniMorph by enriching the data and annotation schema with instances representing derivational processes from MorphyNet.

UR - http://www.scopus.com/inward/record.url?scp=85144397125&partnerID=8YFLogxK

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85144397125

T3 - 2022 Language Resources and Evaluation Conference, LREC 2022

SP - 840

EP - 855

BT - 2022 Language Resources and Evaluation Conference, LREC 2022

A2 - Calzolari, Nicoletta

A2 - Bechet, Frederic

A2 - Blache, Philippe

A2 - Choukri, Khalid

A2 - Cieri, Christopher

A2 - Declerck, Thierry

A2 - Goggi, Sara

A2 - Isahara, Hitoshi

A2 - Maegaard, Bente

A2 - Mariani, Joseph

A2 - Mazo, Helene

A2 - Odijk, Jan

A2 - Piperidis, Stelios

PB - European Language Resources Association (ELRA)

Y2 - 20 June 2022 through 25 June 2022

ER -

Batsuren K, Goldman O, Khalifa S, Habash N, Kieraś W, Bella G et al. UniMorph 4.0: Universal Morphology. In Calzolari N, Bechet F, Blache P, Choukri K, Cieri C, Declerck T, Goggi S, Isahara H, Maegaard B, Mariani J, Mazo H, Odijk J, Piperidis S, editors, 2022 Language Resources and Evaluation Conference, LREC 2022. European Language Resources Association (ELRA). 2022. p. 840-855. (2022 Language Resources and Evaluation Conference, LREC 2022).

UniMorph 4.0: Universal Morphology

Abstract

Publication series

Conference

Bibliographical note

Funding

Other files and links

Fingerprint

Cite this