Stylistic feature sets as classifiers of documents according to their historical period and ethnic origin

Yaakov HaCohen-Kerner, Hananya Beck, Elchai Yehudai, Dror Mughaz

Research output: Contribution to journalArticlepeer-review

27 Scopus citations

Abstract

This research investigates classification of documents according to the ethnic group of their authors and/or to the historical period when the documents were written. The classification is done using various combinations of six sets of stylistic features: quantitative, orthographic, topographic, lexical, function, and vocabulary richness. The application domain is Jewish Law articles written in Hebrew-Aramaic, languages that are rich in their morphological forms. Four popular machine learning methods have been applied. The logistic regression method led to the best accuracy results: about 99.6% while classifying to the ethnic group of their authors or to the historical period when the articles were written and about 98.3% while classifying to both classifications. The quantitative feature set was found as very successful and superior to all other sets. The lexical and function feature sets have also been found to be useful. The quantitative and the function features are domain independent and language independent. These two feature sets might be generalized to similar classification tasks for other languages and can therefore be useful for the text classification community at large.

Original languageEnglish
Pages (from-to)847-862
Number of pages16
JournalApplied Artificial Intelligence
Volume24
Issue number9
DOIs
StatePublished - Oct 2010

Fingerprint

Dive into the research topics of 'Stylistic feature sets as classifiers of documents according to their historical period and ethnic origin'. Together they form a unique fingerprint.

Cite this