Abstract
Deduplication is a special case of data compression in which repeated chunks of data are stored only once. For very large chunks, this process may be applied even if the chunks are similar and not necessarily identical, and then the encoding of duplicate data consists of a sequence of pointers to matching parts. However, not all the pointers are worth being kept, as they incur some storage overhead. A linear, sub-optimal solution of this partition problem is presented, followed by an optimal solution with cubic time complexity and requiring quadratic space.
| Original language | English |
|---|---|
| Pages (from-to) | 104-114 |
| Number of pages | 11 |
| Journal | Discrete Applied Mathematics |
| Volume | 212 |
| DOIs | |
| State | Published - 30 Oct 2016 |
Bibliographical note
Publisher Copyright:© 2016 Elsevier B.V.
Keywords
- Deduplication
- Dynamic programming
- Partitioning data chunks
Fingerprint
Dive into the research topics of 'Optimal partitioning of data chunks in deduplication systems'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver