An Integrated High-Performance Transport Solution for Big Data Transfer over Wide-Area Networks

Xukang Lyu, Chase Q. Wu, Nageswara S.V. Rao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Transport control plays an important role in the performance of large-scale scientific applications involving transfer of large data sets, online computational steering, and interactive visualization. In general, large-scale scientific applications require high bandwidths to move big data across wide-area networks. One of the primary challenges is to explore and compose a set of feasible route options with multiple constraints. Another challenge essentially arises from the randomness inherent in wide-area networks, particularly the Internet. This randomness must be explicitly accounted for to achieve both goodput maximization and stabilization over the constructed routes by suitably adjusting the source rate in response to both network and host dynamics. Unfortunately, the widely deployed Transmission Control Protocol is inadequate for such tasks due to its performance limitations. We conduct rigorous analytical study of the design and performance of transport solutions, and develop an integrated transport solution in a systematical way to overcome the limitations of current transport methods. The superior and robust performance of the proposed transport solution is extensively evaluated in an experimental environment in comparison with existing transport methods.

Original languageEnglish (US)
Title of host publicationProceedings - 20th International Conference on High Performance Computing and Communications, 16th International Conference on Smart City and 4th International Conference on Data Science and Systems, HPCC/SmartCity/DSS 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1661-1668
Number of pages8
ISBN (Electronic)9781538666142
DOIs
StatePublished - Jan 22 2019
Event20th International Conference on High Performance Computing and Communications, 16th IEEE International Conference on Smart City and 4th IEEE International Conference on Data Science and Systems, HPCC/SmartCity/DSS 2018 - Exeter, United Kingdom
Duration: Jun 28 2018Jun 30 2018

Publication series

NameProceedings - 20th International Conference on High Performance Computing and Communications, 16th International Conference on Smart City and 4th International Conference on Data Science and Systems, HPCC/SmartCity/DSS 2018

Conference

Conference20th International Conference on High Performance Computing and Communications, 16th IEEE International Conference on Smart City and 4th IEEE International Conference on Data Science and Systems, HPCC/SmartCity/DSS 2018
CountryUnited Kingdom
CityExeter
Period6/28/186/30/18

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture
  • Control and Optimization
  • Computer Networks and Communications
  • Computer Science Applications

Keywords

  • Big data transfer
  • Dedicated channels
  • Resource provisioning
  • Transport control

Fingerprint Dive into the research topics of 'An Integrated High-Performance Transport Solution for Big Data Transfer over Wide-Area Networks'. Together they form a unique fingerprint.

Cite this