Improving deduplication techniques by accelerating remainder calculations

M. Hirsch, S. T. Klein, Y. Toaff

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

The time efficiency of many storage systems rely critically on the ability to perform a large number of evaluations of certain hashing functions fast enough. The remainder function BmodP, generally applied with a large prime number P, is often used as a building block of such hashing functions, which leads to the need of accelerating remainder evaluations, possibly using parallel processors. We suggest several improvements exploiting the mathematical properties of the remainder function, leading to iterative or hierarchical evaluations. Experimental results show a 2 to 5-fold increase in the processing speed.

Original languageEnglish
Pages (from-to)307-315
Number of pages9
JournalDiscrete Applied Mathematics
Volume163
Issue numberPART 3
DOIs
StatePublished - 30 Jan 2014

Keywords

  • Deduplication
  • Hierarchical evaluation
  • Modular arithmetic
  • Rabin-Karp

Fingerprint

Dive into the research topics of 'Improving deduplication techniques by accelerating remainder calculations'. Together they form a unique fingerprint.

Cite this