Support Optimality and Adaptive Cuckoo Filters

Tsvi Kopelowitz, Samuel McCauley, Ely Porat

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Filters (such as Bloom Filters) are a fundamental data structure that speed up network routing and measurement operations by storing a compressed representation of a set. Filters are very space efficient, but can make bounded one-sided errors: with tunable probability ϵ, they may report that a query element is stored in the filter when it is not. This is called a false positive. Recent research has focused on designing methods for dynamically adapting filters to false positives, thereby reducing the number of false positives when some elements are queried repeatedly. Ideally, an adaptive filter would incur a false positive with bounded probability ϵ for each new query element, and would incur o(ϵ) total false positives over all repeated queries to that element. We call such a filter support optimal. In this paper we design a new Adaptive Cuckoo Filter, and show that it is support optimal (up to additive logarithmic terms) over any n queries when storing a set of size n. We complement these bounds with experiments that show that our data structure is effective at fixing false positives on network trace datasets, outperforming previous Adaptive Cuckoo Filters. Finally, we investigate adversarial adaptivity, a stronger notion of adaptivity in which an adaptive adversary repeatedly queries the filter, using the result of previous queries to drive the false positive rate as high as possible. We prove a lower bound showing that a broad family of filters, including all known Adaptive Cuckoo Filters, can be forced by such an adversary to incur a large number of false positives.

Original languageEnglish
Title of host publicationAlgorithms and Data Structures - 17th International Symposium, WADS 2021, Proceedings
EditorsAnna Lubiw, Mohammad Salavatipour
PublisherSpringer Science and Business Media Deutschland GmbH
Pages556-570
Number of pages15
ISBN (Print)9783030835071
DOIs
StatePublished - 2021
Event17th International Symposium on Algorithms and Data Structures, WADS 2021 - Virtual, Online
Duration: 9 Aug 202111 Aug 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12808 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference17th International Symposium on Algorithms and Data Structures, WADS 2021
CityVirtual, Online
Period9/08/2111/08/21

Bibliographical note

Publisher Copyright:
© 2021, Springer Nature Switzerland AG.

Fingerprint

Dive into the research topics of 'Support Optimality and Adaptive Cuckoo Filters'. Together they form a unique fingerprint.

Cite this