Characterization of Input/Output bandwidth performance models in NUMA architecture for data intensive applications

Tan Li, Yufei Ren, Dantong Yu, Shudong Jin, Thomas Robertazzi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Scopus citations

Abstract

Data-intensive applications frequently rely on multicore computer systems, in which Non-Uniform Memory Access (NUMA) is a dominant architecture. To transfer data into and out from these high-performance computers becomes a bottleneck, and thus it is crucial to understand their I/O performance characteristics. However, the complexity in NUMA architecture presents a new challenge in modeling its I/O access cost, and thus lead to difficulties in configuring proper processor and memory affinity. In this paper, we show that existing NUMA experimental methods and metrics are inappropriate on contemporary highend systems. We characterize a state-of-the-art NUMA host, and propose, to the best of our knowledge, the first methodology to simulate I/O operations using memory semantics, and model the I/O bandwidth performance. Our methodology is thoroughly tested and validated by mapping multiple parallel I/O streams to different sets of hardware components (CPU, memory, network cards, and SSDs) and by measuring the performance of each mapping. The experimental results and analysis reveal that our methodology can dramatically reduce characterization workload, accurately estimate the overall I/O performance, and effectively mitigate resource contention among I/O tasks.

Original languageEnglish (US)
Title of host publicationProceedings
Subtitle of host publicationInternational Conference on Parallel Processing - The 42nd Annual Conference, ICPP 2013
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages369-378
Number of pages10
ISBN (Print)9780769551173
DOIs
StatePublished - 2013
Externally publishedYes
Event42nd Annual International Conference on Parallel Processing, ICPP 2013 - Lyon, France
Duration: Oct 1 2013Oct 4 2013

Publication series

NameProceedings of the International Conference on Parallel Processing
ISSN (Print)0190-3918

Other

Other42nd Annual International Conference on Parallel Processing, ICPP 2013
CountryFrance
CityLyon
Period10/1/1310/4/13

All Science Journal Classification (ASJC) codes

  • Software
  • Mathematics(all)
  • Hardware and Architecture

Keywords

  • Data transfer
  • Input/output(I/O)
  • NUMA effects
  • Performance model

Fingerprint Dive into the research topics of 'Characterization of Input/Output bandwidth performance models in NUMA architecture for data intensive applications'. Together they form a unique fingerprint.

Cite this