FAST: Fast and accurate synoptic texts

Oran Brill, Moshe Koppel, Avi Shmidman

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

Many classical texts are available in multiple versions that almost always differ from each other due to transcription error and editorial discretion. One of the central challenges in the study of such texts is the preparation of a 'synoptic' text: an aligned presentation of the various versions in which corresponding words or phrases, even if not identical, are mapped to each other. Multiple text alignment of this sort must take into account orthographic and conceptual relationships between words. In this article, we define this text alignment problem as an optimization problem by providing a formal measure of alignment quality. Unlike previous measures, our measure uses word embeddings to take into account conceptual similarity between aligned words. We propose an efficient and scalable alignment method in accordance with the proposed criteria. This method splits the texts to be aligned into smaller subtexts, thus improving both efficiency and accuracy. Empirical comparisons on sample data indicate our method is significantly faster than existing methods, often rendering intractable problems tractable, and that the alignment obtained by our method is considerably better than that obtained by other methods.

Original languageEnglish
Pages (from-to)254-264
Number of pages11
JournalDigital Scholarship in the Humanities
Volume35
Issue number2
DOIs
StatePublished - 2020

Bibliographical note

Publisher Copyright:
© The Author(s) 2019. Published by Oxford University Press on behalf of EADH. All rights reserved.

Fingerprint

Dive into the research topics of 'FAST: Fast and accurate synoptic texts'. Together they form a unique fingerprint.

Cite this