Memento: Making sliding windows efficient for heavy hitters

Ran Ben Basat, Gil Einziger, Isaac Keslassy, Ariel Orda, Shay Vargaftik, Erez Waisbard

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

34 Scopus citations

Abstract

Cloud operators require real-time identification of Heavy Hitters (HH) and Hierarchical Heavy Hitters (HHH) for applications such as load balancing, traffic engineering, and attack mitigation. However, existing techniques are slow in detecting new heavy hitters. In this paper, we make the case for identifying heavy hitters through sliding windows. Sliding windows are quicker and more accurate to detect new heavy hitters than current interval based methods, but to date had no practical algorithms. Accordingly, we introduce, design and analyze the Memento family of sliding window algorithms for the HH and HHH problems in the single-device and network-wide settings. Using extensive evaluations, we show that our single-device solutions attain similar accuracy and are by up to 273× faster than existing window-based techniques. Furthermore, we exemplify our network-wide HHH detection capabilities on a realistic testbed. To that end, we implemented Memento as an open-source extension to the popular HAProxy cloud load-balancer. In our evaluations, using an HTTP flood by 50 subnets, our network-wide approach detected the new subnets faster, and reduced the number of undetected flood requests by up to 37× compared to the alternatives.

Original languageEnglish
Title of host publicationCoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies
PublisherAssociation for Computing Machinery, Inc
Pages254-266
Number of pages13
ISBN (Electronic)9781450360807
DOIs
StatePublished - 4 Dec 2018
Externally publishedYes
Event14th International Conference on Emerging Networking EXperiments and Technologies, CoNEXT 2018 - Heraklion, Greece
Duration: 4 Dec 20187 Dec 2018

Publication series

NameCoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies

Conference

Conference14th International Conference on Emerging Networking EXperiments and Technologies, CoNEXT 2018
Country/TerritoryGreece
CityHeraklion
Period4/12/187/12/18

Bibliographical note

Publisher Copyright:
© 2018 Association for Computing Machinery.

Fingerprint

Dive into the research topics of 'Memento: Making sliding windows efficient for heavy hitters'. Together they form a unique fingerprint.

Cite this