Bayesian hierarchical words representation learning

Oren Barkan; Idan Rejwan; Avi Caciularu; Noam Koenigstein

Bayesian hierarchical words representation learning

Oren Barkan, Idan Rejwan, Avi Caciularu, Noam Koenigstein

Department of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

11 Scopus citations

Abstract

This paper presents the Bayesian Hierarchical Words Representation (BHWR) learning algorithm. BHWR facilitates Variational Bayes word representation learning combined with semantic taxonomy modeling via hierarchical priors. By propagating relevant information between related words, BHWR utilizes the taxonomy to improve the quality of such representations. Evaluation of several linguistic datasets demonstrates the advantages of BHWR over suitable alternatives that facilitate Bayesian modeling with or without semantic priors. Finally, we further show that BHWR produces better representations for rare words.

Original language	English
Title of host publication	ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference
Publisher	Association for Computational Linguistics (ACL)
Pages	3871-3877
Number of pages	7
ISBN (Electronic)	9781952148255
State	Published - 2020
Event	58th Annual Meeting of the Association for Computational Linguistics, ACL 2020 - Virtual, Online, United States Duration: 5 Jul 2020 → 10 Jul 2020

Publication series

Name	Proceedings of the Annual Meeting of the Association for Computational Linguistics
ISSN (Print)	0736-587X

Conference

Conference	58th Annual Meeting of the Association for Computational Linguistics, ACL 2020
Country/Territory	United States
City	Virtual, Online
Period	5/07/20 → 10/07/20

Bibliographical note

Publisher Copyright:
© 2020 Association for Computational Linguistics

Cite this

Barkan, O., Rejwan, I., Caciularu, A., & Koenigstein, N. (2020). Bayesian hierarchical words representation learning. In ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (pp. 3871-3877). (Proceedings of the Annual Meeting of the Association for Computational Linguistics). Association for Computational Linguistics (ACL).

Barkan, Oren ; Rejwan, Idan ; Caciularu, Avi et al. / Bayesian hierarchical words representation learning. ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. Association for Computational Linguistics (ACL), 2020. pp. 3871-3877 (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

@inproceedings{b45de9bdaa6a4f58a957234fc72309e9,

title = "Bayesian hierarchical words representation learning",

abstract = "This paper presents the Bayesian Hierarchical Words Representation (BHWR) learning algorithm. BHWR facilitates Variational Bayes word representation learning combined with semantic taxonomy modeling via hierarchical priors. By propagating relevant information between related words, BHWR utilizes the taxonomy to improve the quality of such representations. Evaluation of several linguistic datasets demonstrates the advantages of BHWR over suitable alternatives that facilitate Bayesian modeling with or without semantic priors. Finally, we further show that BHWR produces better representations for rare words.",

author = "Oren Barkan and Idan Rejwan and Avi Caciularu and Noam Koenigstein",

note = "Publisher Copyright: {\textcopyright} 2020 Association for Computational Linguistics; 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020 ; Conference date: 05-07-2020 Through 10-07-2020",

year = "2020",

language = "אנגלית",

series = "Proceedings of the Annual Meeting of the Association for Computational Linguistics",

publisher = "Association for Computational Linguistics (ACL)",

pages = "3871--3877",

booktitle = "ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference",

address = "ארצות הברית",

}

Barkan, O, Rejwan, I, Caciularu, A & Koenigstein, N 2020, Bayesian hierarchical words representation learning. in ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. Proceedings of the Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics (ACL), pp. 3871-3877, 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Virtual, Online, United States, 5/07/20.

Bayesian hierarchical words representation learning. / Barkan, Oren; Rejwan, Idan; Caciularu, Avi et al.
ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. Association for Computational Linguistics (ACL), 2020. p. 3871-3877 (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Bayesian hierarchical words representation learning

AU - Barkan, Oren

AU - Rejwan, Idan

AU - Caciularu, Avi

AU - Koenigstein, Noam

PY - 2020

Y1 - 2020

N2 - This paper presents the Bayesian Hierarchical Words Representation (BHWR) learning algorithm. BHWR facilitates Variational Bayes word representation learning combined with semantic taxonomy modeling via hierarchical priors. By propagating relevant information between related words, BHWR utilizes the taxonomy to improve the quality of such representations. Evaluation of several linguistic datasets demonstrates the advantages of BHWR over suitable alternatives that facilitate Bayesian modeling with or without semantic priors. Finally, we further show that BHWR produces better representations for rare words.

AB - This paper presents the Bayesian Hierarchical Words Representation (BHWR) learning algorithm. BHWR facilitates Variational Bayes word representation learning combined with semantic taxonomy modeling via hierarchical priors. By propagating relevant information between related words, BHWR utilizes the taxonomy to improve the quality of such representations. Evaluation of several linguistic datasets demonstrates the advantages of BHWR over suitable alternatives that facilitate Bayesian modeling with or without semantic priors. Finally, we further show that BHWR produces better representations for rare words.

UR - http://www.scopus.com/inward/record.url?scp=85092713013&partnerID=8YFLogxK

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85092713013

T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics

SP - 3871

EP - 3877

BT - ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference

PB - Association for Computational Linguistics (ACL)

T2 - 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020

Y2 - 5 July 2020 through 10 July 2020

ER -

Barkan O, Rejwan I, Caciularu A, Koenigstein N. Bayesian hierarchical words representation learning. In ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. Association for Computational Linguistics (ACL). 2020. p. 3871-3877. (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

Bayesian hierarchical words representation learning

Abstract

Publication series

Conference

Bibliographical note

Other files and links

Fingerprint

Cite this