Constructions and applications for accurate counting of the bloom filter false positive free zone

Ori Rottenstreich, Pedro Reviriego, Ely Porat, S. Muthukrishnan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

12 Scopus citations

Abstract

Bloom filters are used in many networking applications to answer set membership queries at low cost but suffer from false positives. We study Bloom filter constructions that when representing a set of size up to d taken from a finite universe of size n, completely avoid false positives. We suggest memory-efficient Bloom filters constructions with a false positive free zone to allow representations of larger sets through linear memory dependency in the set size. Our first construction relies on Orthogonal Latin Square (OLS) codes and the second relies on the representation of elements through values of polynomials defined modulo primes. Beyond Bloom filters supporting set membership, we also consider sketches allowing a more general functionality such as flow size estimation. In particular, we show the applicability of the false positive free zone for accurate size estimation in the famous Count-Min sketch. We compare the new constructions to existing approaches through analytical and experimental evaluations for showing their superiority.

Original languageEnglish
Title of host publicationSOSR 2020 - Proceedings of the 2020 Symposium on SDN Research
PublisherAssociation for Computing Machinery, Inc
Pages135-145
Number of pages11
ISBN (Electronic)9781450371018
DOIs
StatePublished - 3 Mar 2020
Event2020 Symposium on SDN Research, SOSR 2020 - San Jose, United States
Duration: 3 Mar 2020 → …

Publication series

NameSOSR 2020 - Proceedings of the 2020 Symposium on SDN Research

Conference

Conference2020 Symposium on SDN Research, SOSR 2020
Country/TerritoryUnited States
CitySan Jose
Period3/03/20 → …

Bibliographical note

Publisher Copyright:
© 2020 Association for Computing Machinery.

Funding

Ori Rottenstreich was partially supported by the Taub Family Foundation, by the German-Israeli Foundation for Scientific Research and Development (GIF), by the Gordon Fund for System Engineering as well as by the Technion Hiroshi Fujiwara Cyber Security Research Center and the Israel National Cyber Directorate. Pedro Reviriego would like to acknowledge the support of the TEXEO project TEC2016-80339-R funded by the Spanish Ministry of Economy and Competitivity and of the Madrid Community research project TAPIR-CM grant no. P2018/TCS-4496. This work is also partially supported by the European Commission in the frame of the Horizon 2020 project PASSION (grant #780326).

FundersFunder number
Israel National Cyber DirectorateTEC2016-80339-R
Spanish Ministry of Economy and Competitivity
Taub Family Foundation
Technion Hiroshi Fujiwara Cyber Security Research Center
European Commission
German-Israeli Foundation for Scientific Research and Development
Horizon 2020780326

    Keywords

    • Bloom filter
    • Count-Min Sketch
    • Flow size estimation
    • Measurement

    Fingerprint

    Dive into the research topics of 'Constructions and applications for accurate counting of the bloom filter false positive free zone'. Together they form a unique fingerprint.

    Cite this