A dynamic performance-based flow control method for high-speed data transfer

Ben Eckart, Xubin He, Qishi Wu, Changsheng Xie

Research output: Contribution to journalArticlepeer-review

14 Scopus citations

Abstract

New types of specialized network applications are being created that need to be able to transmit large amounts of data across dedicated network links. TCP fails to be a suitable method of bulk data transfer in many of these applications, giving rise to new classes of protocols designed to circumvent TCP's shortcomings. It is typical in these high-performance applications, however, that the system hardware is simply incapable of saturating the bandwidths supported by the network infrastructure. When the bottleneck for data transfer occurs in the system itself and not in the network, it is critical that the protocol scales gracefully to prevent buffer overflow and packet loss. It is therefore necessary to build a high-speed protocol adaptive to the performance of each system by including a dynamic performance-based flow control. This paper develops such a protocol, Performance Adaptive UDP (henceforth PA-UDP), which aims to dynamically and autonomously maximize performance under different systems. A mathematical model and related algorithms are proposed to describe the theoretical basis behind effective buffer and CPU management. A novel delay-based rate-throttling model is also demonstrated to be very accurate under diverse system latencies. Based on these models, we implemented a prototype under Linux, and the experimental results demonstrate that PA-UDP outperforms other existing high-speed protocols on commodity hardware in terms of throughput, packet loss, and CPU utilization. PA-UDP is efficient not only for high-speed research networks, but also for reliable high-performance bulk data transfer over dedicated local area networks where congestion and fairness are typically not a concern.

Original languageEnglish (US)
Article number4798156
Pages (from-to)114-125
Number of pages12
JournalIEEE Transactions on Parallel and Distributed Systems
Volume21
Issue number1
DOIs
StatePublished - Jan 2010
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Hardware and Architecture
  • Computational Theory and Mathematics

Keywords

  • Bulk transfer.
  • Flow control
  • High-speed protocol
  • Reliable UDP

Fingerprint Dive into the research topics of 'A dynamic performance-based flow control method for high-speed data transfer'. Together they form a unique fingerprint.

Cite this