Overview of uni-modal and multi-modal representations for classification tasks

Aryeh Wiesen; Yaakov HaCohen-Kerner

doi:10.1007/978-3-319-91947-8_41

Overview of uni-modal and multi-modal representations for classification tasks

Aryeh Wiesen, Yaakov HaCohen-Kerner

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

Classification is one of the most fundamental tasks in data mining and machine learning. It is being applied in an increasing number of fields, e.g. filtering, identification, information retrieval, information extraction, and similarity detection. A basic and necessary condition for the success of a classification task is the proper representation of the information it wishes to classify. Classification is needed in domains that are based on uni-modal representations such as text, images, audio, and speech, as well as in domains that are based on multi-modal representations. This paper aims to provide a short review on the developing area of multi-modal representations for classification with emphasis on state-of-the-art systems in this area. Firstly, fundamentals of uni-modal representations are given. Secondly, an overview of multi-modal representations is given. Thirdly, various related systems using multi-modal representations and the datasets used by them are briefly summarized with a comparative summary of these systems.

Original language	English
Title of host publication	Natural Language Processing and Information Systems - 23rd International Conference on Applications of Natural Language to Information Systems, NLDB 2018, Proceedings
Editors	Farid Meziane, Max Silberztein, Faten Atigui, Elena Kornyshova, Elisabeth Metais
Publisher	Springer Verlag
Pages	397-404
Number of pages	8
ISBN (Print)	9783319919461
DOIs	https://doi.org/10.1007/978-3-319-91947-8_41
State	Published - 2018
Externally published	Yes
Event	23rd International Conference on Natural Language and Information Systems, NLDB 2018 - Paris, France Duration: 13 Jun 2018 → 15 Jun 2018

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	10859 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	23rd International Conference on Natural Language and Information Systems, NLDB 2018
Country/Territory	France
City	Paris
Period	13/06/18 → 15/06/18

Bibliographical note

Publisher Copyright:
© 2018, Springer International Publishing AG, part of Springer Nature.

Keywords

Classification
Multi-modal representation
Textual features
Uni-modal representation
Visual features

Access to Document

10.1007/978-3-319-91947-8_41

Cite this

Wiesen, A., & HaCohen-Kerner, Y. (2018). Overview of uni-modal and multi-modal representations for classification tasks. In F. Meziane, M. Silberztein, F. Atigui, E. Kornyshova, & E. Metais (Eds.), Natural Language Processing and Information Systems - 23rd International Conference on Applications of Natural Language to Information Systems, NLDB 2018, Proceedings (pp. 397-404). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10859 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-91947-8_41

Wiesen, Aryeh ; HaCohen-Kerner, Yaakov. / Overview of uni-modal and multi-modal representations for classification tasks. Natural Language Processing and Information Systems - 23rd International Conference on Applications of Natural Language to Information Systems, NLDB 2018, Proceedings. editor / Farid Meziane ; Max Silberztein ; Faten Atigui ; Elena Kornyshova ; Elisabeth Metais. Springer Verlag, 2018. pp. 397-404 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{39db96bc341a4bfb9160a812df86605f,

title = "Overview of uni-modal and multi-modal representations for classification tasks",

abstract = "Classification is one of the most fundamental tasks in data mining and machine learning. It is being applied in an increasing number of fields, e.g. filtering, identification, information retrieval, information extraction, and similarity detection. A basic and necessary condition for the success of a classification task is the proper representation of the information it wishes to classify. Classification is needed in domains that are based on uni-modal representations such as text, images, audio, and speech, as well as in domains that are based on multi-modal representations. This paper aims to provide a short review on the developing area of multi-modal representations for classification with emphasis on state-of-the-art systems in this area. Firstly, fundamentals of uni-modal representations are given. Secondly, an overview of multi-modal representations is given. Thirdly, various related systems using multi-modal representations and the datasets used by them are briefly summarized with a comparative summary of these systems.",

keywords = "Classification, Multi-modal representation, Textual features, Uni-modal representation, Visual features",

author = "Aryeh Wiesen and Yaakov HaCohen-Kerner",

note = "Publisher Copyright: {\textcopyright} 2018, Springer International Publishing AG, part of Springer Nature.; 23rd International Conference on Natural Language and Information Systems, NLDB 2018 ; Conference date: 13-06-2018 Through 15-06-2018",

year = "2018",

doi = "10.1007/978-3-319-91947-8_41",

language = "אנגלית",

isbn = "9783319919461",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "397--404",

editor = "Farid Meziane and Max Silberztein and Faten Atigui and Elena Kornyshova and Elisabeth Metais",

booktitle = "Natural Language Processing and Information Systems - 23rd International Conference on Applications of Natural Language to Information Systems, NLDB 2018, Proceedings",

address = "גרמניה",

}

Wiesen, A & HaCohen-Kerner, Y 2018, Overview of uni-modal and multi-modal representations for classification tasks. in F Meziane, M Silberztein, F Atigui, E Kornyshova & E Metais (eds), Natural Language Processing and Information Systems - 23rd International Conference on Applications of Natural Language to Information Systems, NLDB 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10859 LNCS, Springer Verlag, pp. 397-404, 23rd International Conference on Natural Language and Information Systems, NLDB 2018, Paris, France, 13/06/18. https://doi.org/10.1007/978-3-319-91947-8_41

Overview of uni-modal and multi-modal representations for classification tasks. / Wiesen, Aryeh; HaCohen-Kerner, Yaakov.
Natural Language Processing and Information Systems - 23rd International Conference on Applications of Natural Language to Information Systems, NLDB 2018, Proceedings. ed. / Farid Meziane; Max Silberztein; Faten Atigui; Elena Kornyshova; Elisabeth Metais. Springer Verlag, 2018. p. 397-404 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10859 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Overview of uni-modal and multi-modal representations for classification tasks

AU - Wiesen, Aryeh

AU - HaCohen-Kerner, Yaakov

PY - 2018

Y1 - 2018

N2 - Classification is one of the most fundamental tasks in data mining and machine learning. It is being applied in an increasing number of fields, e.g. filtering, identification, information retrieval, information extraction, and similarity detection. A basic and necessary condition for the success of a classification task is the proper representation of the information it wishes to classify. Classification is needed in domains that are based on uni-modal representations such as text, images, audio, and speech, as well as in domains that are based on multi-modal representations. This paper aims to provide a short review on the developing area of multi-modal representations for classification with emphasis on state-of-the-art systems in this area. Firstly, fundamentals of uni-modal representations are given. Secondly, an overview of multi-modal representations is given. Thirdly, various related systems using multi-modal representations and the datasets used by them are briefly summarized with a comparative summary of these systems.

AB - Classification is one of the most fundamental tasks in data mining and machine learning. It is being applied in an increasing number of fields, e.g. filtering, identification, information retrieval, information extraction, and similarity detection. A basic and necessary condition for the success of a classification task is the proper representation of the information it wishes to classify. Classification is needed in domains that are based on uni-modal representations such as text, images, audio, and speech, as well as in domains that are based on multi-modal representations. This paper aims to provide a short review on the developing area of multi-modal representations for classification with emphasis on state-of-the-art systems in this area. Firstly, fundamentals of uni-modal representations are given. Secondly, an overview of multi-modal representations is given. Thirdly, various related systems using multi-modal representations and the datasets used by them are briefly summarized with a comparative summary of these systems.

KW - Classification

KW - Multi-modal representation

KW - Textual features

KW - Uni-modal representation

KW - Visual features

UR - http://www.scopus.com/inward/record.url?scp=85048044762&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-91947-8_41

DO - 10.1007/978-3-319-91947-8_41

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85048044762

SN - 9783319919461

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 397

EP - 404

BT - Natural Language Processing and Information Systems - 23rd International Conference on Applications of Natural Language to Information Systems, NLDB 2018, Proceedings

A2 - Meziane, Farid

A2 - Silberztein, Max

A2 - Atigui, Faten

A2 - Kornyshova, Elena

A2 - Metais, Elisabeth

PB - Springer Verlag

T2 - 23rd International Conference on Natural Language and Information Systems, NLDB 2018

Y2 - 13 June 2018 through 15 June 2018

ER -

Wiesen A, HaCohen-Kerner Y. Overview of uni-modal and multi-modal representations for classification tasks. In Meziane F, Silberztein M, Atigui F, Kornyshova E, Metais E, editors, Natural Language Processing and Information Systems - 23rd International Conference on Applications of Natural Language to Information Systems, NLDB 2018, Proceedings. Springer Verlag. 2018. p. 397-404. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-91947-8_41

Overview of uni-modal and multi-modal representations for classification tasks

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this