The emergence of programmable switches allows operators to collect a vast amount of fine-grained telemetry data in real time. However, consolidating the telemetry reports at centralized collectors to gain a network-wide view poses an immense challenge. The received data has to be transported from the switches, parsed, manipulated, and inserted in queryable data structures. As the network scales, this requires excessive CPU processing. RDMA is a transport protocol that bypasses the CPU and allows extremely high data transfer rates. Yet, RDMA is not designed for telemetry collection: it requires a stateful connection, supports only a small number of concurrent writers, and has limited writing primitives, which restricts its data aggregation applicability. We introduce Direct Telemetry Access (DTA), a solution that allows fast and efficient telemetry collection, aggregation, and indexing. Our system establishes RDMA connections only from collectors' ToR switches, called \emph{translators}, that process DTA reports from all other switches. DTA features novel and expressive reporting primitives such as Key-Write, Append, Sketch-Merge, and Key-Increment that allow integration of telemetry systems such as INT and others. The translators then aggregate, batch, and write the reports to collectors' memory in queryable form.
翻译:编程式开关的出现使得操作员能够实时收集大量精细测遥测数据。 然而, 将集中收集器的遥测报告合并到集中收集器, 以获得整个网络的视野, 却是一个巨大的挑战。 收到的数据必须从开关、 剖析、 操纵和插入可查询的数据结构中传输。 由于网络规模的扩大, 这需要超量的CPU处理。 RDMA是一个绕过CPU并允许极高数据传输率的运输协议。 然而, RDMA并不是为遥测采集设计的: 它需要一种状态式连接, 只需要少数同时的作者, 并且有有限的写作原始数据, 从而限制了其数据汇总的实用性。 我们引入了直接遥测访问( DTA), 这个解决方案可以快速和高效地收集、 解析、 汇总和索引。 我们的系统只建立RDMA 连接来自收藏器的开关, 称为\ emph{ Transtrator}, 这个进程来自所有其他开关的DTA报告。 DTA 设置了新和直观报告原始报告, 如 Key-Writere、 Append、 Set- mest- mest、 和 Kegraphrals reports reports andsmaldrictions andsmaldrictionsmal- drictions, 和Crictionsmaldripoldddddds ands ands ands, 这样可以将IP、 和Criply- reports 和Criplyplyplyplyplydridddddddddddddddddddddddddddddddddddrivesddddridddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddssssssssmdddddddddddddddddddddddd