Light guardian: A full-visibility, lightweight, in-band telemetry system using sketchlets

Zhao，Yikai1; Yang，Kaicheng1; Liu，Zirui1; Yang，Tong1,2; Chen，Li3; Liu，Shiyi1; Zheng，Naiqian1; Wang，Ruixin1; Wu，Hanbo1; Wang，Yi2,4; Zhang，Nicholas3

2021

Proceedings of the 18th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2021

991-1007

Network traffic measurement is central to successful network operations, especially for today's hyper-scale networks. Although existing works have made great contributions, they fail to achieve the following three criteria simultaneously: 1) full-visibility, which refers to the ability to acquire any desired per-hop flow-level information for all flows; 2) low overhead in terms of computation, memory, and bandwidth; and 3) robustness, meaning the system can survive partial network failures. We design LightGuardian to meet these three criteria. Our key innovation is a (small) constant-sized data structure, called sketchlet, which can be embedded in packet headers. Specifically, we design a novel SuMax sketch to accurately capture flow-level information. SuMax can be divided into sketchlets, which are carried in-band by passing packets to the end-hosts for aggregation, reconstruction, and analysis. We have fully implemented a LightGuardian prototype on a testbed with 10 programmable switches and 8 end-hosts in a FatTree topology, and conduct extensive experiments and evaluations. Experimental results show that LightGuardian can obtain per-flow per-hop flow-level information within 1:0 ∼ 1:5 seconds with consistently low overhead, using only 0.07% total bandwidth capacity of the network. We believe LightGuardian is the first system to collect perflow per-hop information for all flows in the network with negligible overhead.

Corresponding

English

EI

National Natural Science Foundation of China[U20A20179];

20212110398643

Bandwidth ; Systems analysis

Information Theory and Signal Processing:716.1 ; Vision:741.2 ; Systems Science:961

2-s2.0-85106200539

Scopus

1.Department of Computer Science,Peking University,China
2.Peng Cheng Laboratory,Shenzhen,China
3.Huawei Theory Lab,China
4.Southern University of Science and Technology,China

Zhao，Yikai,Yang，Kaicheng,Liu，Zirui,et al. Light guardian: A full-visibility, lightweight, in-band telemetry system using sketchlets[C],2021:991-1007.