Improving deduplication techniques by accelerating remainder calculations

Michael Hirsch, Shmuel T. Klein, Yair Toaffl

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

The time efficiency of many storage systems rely critically on the ability to perform a large number of evaluations of certain hashing functions fast enough. The remainder function B mod P, generally applied with a large prime number P, is often used as a building block of such hashing functions, which leads to the need of accelerating remainder evaluations, possibly using parallel processors. We suggest several improvements exploiting the mathematical properties of the remainder function, leading to iterative or hierarchical evaluations. Experimental results show a 2 to 5-fold increase in the processing speed.

Original languageEnglish
Title of host publicationProceedings of the Prague Stringology Conference 2011
Pages173-183
Number of pages11
StatePublished - 2011
EventPrague Stringology Conference 2011, PSC 2011 - Prague, Czech Republic
Duration: 29 Aug 201131 Aug 2011

Publication series

NameProceedings of the Prague Stringology Conference 2011

Conference

ConferencePrague Stringology Conference 2011, PSC 2011
Country/TerritoryCzech Republic
CityPrague
Period29/08/1131/08/11

Bibliographical note

Place of conference:Czech Republic

Fingerprint

Dive into the research topics of 'Improving deduplication techniques by accelerating remainder calculations'. Together they form a unique fingerprint.

Cite this