GDM: DevicE MEMORY MANAGEMENT for GPGPU computing

Kaibo Wang, Xiaoning Ding, Rubao Lee, Xiaodong Zhang, Shinpei Kato

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Scopus citations

Abstract

GPGPUs are evolving from dedicated accelerators towards mainstream commodity computing resources. During the transition, the lack of system management of device memory space on GPGPUs has become a major hurdle. In existing GPGPU systems, device memory space is still managed ex- plicitly by individual applications, which not only increases the burden of programmers but can also cause application crashes, hangs, or low performance. In this paper, we present the design and implementation of GDM, a fully functional GPGPU device memory man- ager to address the above problems and unleash the com- puting power of GPGPUs in general-purpose environments. To effectively coordinate the device memory usage of dif- ferent applications, GDM takes control over device memory allocations and data transfers to and from device memory, leveraging a buffer allocated in each application's virtual memory. GDM utilizes the unique features of GPGPU sys- tems and relies on several effective optimization techniques to guarantee the efficient usage of device memory space and to achieve high performance. We have evaluated GDM and compared it against state- of-the-art GPGPU system software on a range of workloads. The results show that GDM can prevent applications from crashes, including those induced by device memory leaks, and improve system performance by up to 43%.

Original languageEnglish (US)
Title of host publicationSIGMETRICS 2014 - Proceedings of the 2014 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems
PublisherAssociation for Computing Machinery
Pages533-545
Number of pages13
ISBN (Print)9781450327893
DOIs
StatePublished - Jan 1 2014
Event2014 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, SIGMETRICS 2014 - Austin, TX, United States
Duration: Jun 16 2014Jun 20 2014

Publication series

NameSIGMETRICS 2014 - Proceedings of the 2014 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems

Other

Other2014 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, SIGMETRICS 2014
CountryUnited States
CityAustin, TX
Period6/16/146/20/14

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Modeling and Simulation

Keywords

  • GPU
  • Memory Management
  • Operating System

Fingerprint Dive into the research topics of 'GDM: DevicE MEMORY MANAGEMENT for GPGPU computing'. Together they form a unique fingerprint.

Cite this