Experiments and analyses of data transfers over wide-area dedicated connections

Nageswara S.V. Rao, Qiang Liu, Satyabrata Sen, Jesse Hanley, Ian Foster, Rajkumar Kettimuthu, Chase Q. Wu, Daqing Yun, Don Towsley, Gayane Vardoyan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Scopus citations

Abstract

Dedicated wide-area network connections are increasingly employed in high-performance computing and big data scenarios. One might expect the performance and dynamics of data transfers over such connections to be easy to analyze due to the lack of competing traffic. However, non-linear transport dynamics and end-system complexities (e.g., multi-core hosts and distributed filesystems) can in fact make analysis surprisingly challenging. We present extensive measurements of memory-to-memory and disk-to-disk file transfers over 10Gbps physical and emulated connections with 0-366ms round trip times (RTTs). For memory-to-memory transfers, profiles of both TCP and UDT throughput as a function of RTT show concave and convex regions; large buffer sizes and more parallel flows lead to wider concave regions, which are highly desirable. TCP and UDT both also display complex throughput dynamics, as indicated by their Poincaré maps and Lyapunov exponents. For disk-to-disk transfers, we determine that high throughput can be achieved via a combination of parallel I/O threads, parallel network threads, and direct I/O mode. Our measurements also show that Lustre filesystems can be mounted over long-haul connections using LNet routers, although challenges remain in jointly optimizing file I/O and transport method parameters to achieve peak throughput.

Original languageEnglish (US)
Title of host publication2017 26th International Conference on Computer Communications and Networks, ICCCN 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509029914
DOIs
StatePublished - Sep 14 2017
Event26th International Conference on Computer Communications and Networks, ICCCN 2017 - Vancouver, Canada
Duration: Jul 31 2017Aug 3 2017

Publication series

Name2017 26th International Conference on Computer Communications and Networks, ICCCN 2017

Other

Other26th International Conference on Computer Communications and Networks, ICCCN 2017
Country/TerritoryCanada
CityVancouver
Period7/31/178/3/17

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Networks and Communications
  • Software
  • Management of Technology and Innovation
  • Information Systems and Management
  • Safety, Risk, Reliability and Quality
  • Media Technology
  • Control and Optimization

Keywords

  • Dedicated connections
  • Lyapunov exponent
  • Poincaré map
  • TCP
  • Throughput and file I/O profiles
  • Throughput dynamics
  • UDT
  • Wide-area transport

Fingerprint

Dive into the research topics of 'Experiments and analyses of data transfers over wide-area dedicated connections'. Together they form a unique fingerprint.

Cite this