Skip to Main content Skip to Navigation
Conference papers

Learning-based Incast Performance Inference in Software-Defined Data Centers

Abstract : Incast traffic is a many-to-one communication pattern used in many applications, including distributed storage, web-search with partition/aggregation design pattern, and MapReduce, commonly in data centers. It is generally composed of short-lived flows that may be queued behind large flows' packets in congested switches where performance degradation is observed. Smart buffering at the switch level is sensed to mitigate this issue by automatically and dynamically adapting to traffic conditions changes in the highly dynamic data center environment. But for this dynamic and smart buffer management to become effectively beneficial for all the traffic, and especially for incast the most critical one, incast performance models that provide insights on how various factors affect it are needed. The literature lacks these types of models. The existing ones are analytical models, which are either tightly coupled with a particular protocol version or specific to certain empirical data. Motivated by this observation, we propose a machine-learning-based incast performance inference. With this prediction capability, smart buffering scheme or other QoS optimization algorithms could anticipate and efficiently optimize system parameters adjustment to achieve optimal performance. Since applying machine learning to networks managed in a distributed fashion is hard, the prediction mechanism will be deployed on an SDN control plane. We could then take advantage of SDN's centralized global view, its telemetry capabilities, and its management flexibility.
Complete list of metadata

https://hal.laas.fr/hal-03188914
Contributor : Kokouvi Benoit Nougnanke <>
Submitted on : Friday, April 2, 2021 - 3:31:15 PM
Last modification on : Wednesday, June 9, 2021 - 10:00:22 AM

File

Incast_ICIN_2021_HAL-LAAS.pdf
Files produced by the author(s)

Identifiers

Citation

Kokouvi Benoit Nougnanke, Yann Labit, Marc Bruyère, Simone Ferlin, Ulrich Aivodji. Learning-based Incast Performance Inference in Software-Defined Data Centers. 24th Conference on Innovation in Clouds, Internet and Networks, Mar 2021, Paris (Virtual Conference), France. ⟨10.1109/ICIN51074.2021.9385546⟩. ⟨hal-03188914⟩

Share

Metrics

Record views

39

Files downloads

62