TY - GEN
T1 - Design and performance evaluation of NUMA-aware RDMA-based end-to-end data transfer systems
AU - Ren, Yufei
AU - Li, Tan
AU - Yu, Dantong
AU - Jin, Shudong
AU - Robertazzi, Thomas
N1 - Copyright:
Copyright 2014 Elsevier B.V., All rights reserved.
PY - 2013
Y1 - 2013
N2 - Data-intensive applications place stringent requirements on the performance of both back-end storage systems and front-end network interfaces. However, for ultra high-speed data transfer, for example, at 100 Gbps and higher, the effects of multiple bottlenecks along a full end-to-end path, have not been resolved efficiently. In this paper, we describe our implementation of an end-to-end data transfer software at such high-speeds. At the back-end, we construct a storage area network with the iSCSI protocols, and utilize efficient RDMA technology. At the front-end, we design network communication software to transfer data in parallel, and utilize NUMA techniques to maximize the performance of multiple network interfaces. We demonstrate that our sys-tem can deliver the full 100 Gbps end-to-end data trans-fer throughput. The software product is tested rigorously and demonstrated applicable to supporting various data-intensive applications that constantly move bulk data within and across data centers.
AB - Data-intensive applications place stringent requirements on the performance of both back-end storage systems and front-end network interfaces. However, for ultra high-speed data transfer, for example, at 100 Gbps and higher, the effects of multiple bottlenecks along a full end-to-end path, have not been resolved efficiently. In this paper, we describe our implementation of an end-to-end data transfer software at such high-speeds. At the back-end, we construct a storage area network with the iSCSI protocols, and utilize efficient RDMA technology. At the front-end, we design network communication software to transfer data in parallel, and utilize NUMA techniques to maximize the performance of multiple network interfaces. We demonstrate that our sys-tem can deliver the full 100 Gbps end-to-end data trans-fer throughput. The software product is tested rigorously and demonstrated applicable to supporting various data-intensive applications that constantly move bulk data within and across data centers.
KW - Multi-Core Architecture
KW - Network Protocols
KW - Non-Uniform Memory Access
KW - Remote Direct Memory Access
KW - Storage Area Network
UR - http://www.scopus.com/inward/record.url?scp=84899667344&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84899667344&partnerID=8YFLogxK
U2 - 10.1145/2503210.2503260
DO - 10.1145/2503210.2503260
M3 - Conference contribution
AN - SCOPUS:84899667344
SN - 9781450323789
T3 - International Conference for High Performance Computing, Networking, Storage and Analysis, SC
BT - Proceedings of SC 2013
PB - IEEE Computer Society
T2 - 2013 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2013
Y2 - 17 November 2013 through 22 November 2013
ER -