A systematic approach to compressing a full-text retrieval system

Abraham Bookstein; Shmuel T. Klein; D. A. Ziff

doi:10.1016/0306-4573(92)90069-c

A systematic approach to compressing a full-text retrieval system

Abraham Bookstein
, Shmuel T. Klein
, D. A. Ziff

The University of Chicago

Research output: Contribution to journal › Article › peer-review

23 Scopus citations

Abstract

This article reports on a variety of compression algorithms developed in the context of a project to put all the data files for a full-text retrieval system on CD-ROM. In the context of inexpensive pre-processing, a text-compression algorithm is presented that is based on Markov-modeled Huffman coding on an extended alphabet. Data structures are examined for facilitating random access into the compressed text. In addition, new algorithms are presented for compression of word indices, both the dictionaries (word lists) and the text pointers (concordances). The ARTFL database is used as a test case throughout the article.

Original language	English
Pages (from-to)	795-806
Number of pages	12
Journal	Information Processing and Management
Volume	28
Issue number	6
DOIs	https://doi.org/10.1016/0306-4573(92)90069-c
State	Published - 1992

Access to Document

10.1016/0306-4573(92)90069-c

Cite this

@article{35074a1be27947c1bee9336ea3d3b2a7,

title = "A systematic approach to compressing a full-text retrieval system",

abstract = "This article reports on a variety of compression algorithms developed in the context of a project to put all the data files for a full-text retrieval system on CD-ROM. In the context of inexpensive pre-processing, a text-compression algorithm is presented that is based on Markov-modeled Huffman coding on an extended alphabet. Data structures are examined for facilitating random access into the compressed text. In addition, new algorithms are presented for compression of word indices, both the dictionaries (word lists) and the text pointers (concordances). The ARTFL database is used as a test case throughout the article.",

author = "Abraham Bookstein and Klein, \{Shmuel T.\} and Ziff, \{D. A.\}",

year = "1992",

doi = "10.1016/0306-4573(92)90069-c",

language = "אנגלית",

volume = "28",

pages = "795--806",

journal = "Information Processing and Management",

issn = "0306-4573",

publisher = "Elsevier Ltd.",

number = "6",

}

TY - JOUR

T1 - A systematic approach to compressing a full-text retrieval system

AU - Bookstein, Abraham

AU - Klein, Shmuel T.

AU - Ziff, D. A.

PY - 1992

Y1 - 1992

N2 - This article reports on a variety of compression algorithms developed in the context of a project to put all the data files for a full-text retrieval system on CD-ROM. In the context of inexpensive pre-processing, a text-compression algorithm is presented that is based on Markov-modeled Huffman coding on an extended alphabet. Data structures are examined for facilitating random access into the compressed text. In addition, new algorithms are presented for compression of word indices, both the dictionaries (word lists) and the text pointers (concordances). The ARTFL database is used as a test case throughout the article.

AB - This article reports on a variety of compression algorithms developed in the context of a project to put all the data files for a full-text retrieval system on CD-ROM. In the context of inexpensive pre-processing, a text-compression algorithm is presented that is based on Markov-modeled Huffman coding on an extended alphabet. Data structures are examined for facilitating random access into the compressed text. In addition, new algorithms are presented for compression of word indices, both the dictionaries (word lists) and the text pointers (concordances). The ARTFL database is used as a test case throughout the article.

UR - https://www.scopus.com/pages/publications/0041619493

U2 - 10.1016/0306-4573(92)90069-c

DO - 10.1016/0306-4573(92)90069-c

M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???

AN - SCOPUS:0041619493

SN - 0306-4573

VL - 28

SP - 795

EP - 806

JO - Information Processing and Management

JF - Information Processing and Management

IS - 6

ER -

A systematic approach to compressing a full-text retrieval system

Abstract

Access to Document

Other files and links

Fingerprint

Cite this