Improved alignment based algorithm for multilingual text compression

Ehud S. Conley, Shmuel Tomi Klein

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


Multilingual text compression exploits the existence of the same text in several languages to compress the second and subsequent copies by reference to the first. This is done based on bilingual text alignment, a mapping of words and phrases in one text to their semantic equivalents in the translation. A new multilingual text compression scheme is suggested, which improves over an immediate generalization of bilingual algorithms. The idea is to store the necessary markup data within the source language text; the incurred compression loss due to this overhead is smaller than the savings in the compressed target language texts, for a large enough number of the latter. Experimental results are presented for a parallel corpus in six languages extracted from the EUR-Lex website of the European Union. These results show the superiority of the new algorithm as a function of the number languages.

Original languageEnglish
Title of host publicationLanguage and Automata Theory and Applications - 5th International Conference, LATA 2011, Proceedings
PublisherSpringer Verlag
Number of pages12
ISBN (Print)9783642212536
StatePublished - 2011

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume6638 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Bibliographical note

Place of conference:Spain


Dive into the research topics of 'Improved alignment based algorithm for multilingual text compression'. Together they form a unique fingerprint.

Cite this