TY - GEN
T1 - Diagnosing virtualization overhead for multi-threaded computation on multicore platforms
AU - Ding, Xiaoning
AU - Shan, Jianchen
N1 - Publisher Copyright:
© 2015 IEEE.
PY - 2016/2/1
Y1 - 2016/2/1
N2 - Hardware-assisted virtualization, as an effective approach to low virtualization overhead, has been dominantly used. However, existing hardware assistance mainly focuses on single-thread performance. Much less attention has been paid to facilitate the efficient interaction between threads, which is critical to the execution of multi-threaded computation on virtualized multicore platforms. This paper aims to answer two questions: 1) what is the performance impact of virtualization on multi-threaded computation, and 2) what are the factors impeding multi-threaded computation from gaining full speed on virtualized platforms. Targeting the first question, the paper measures the virtualization overhead for computation-intensive applications that are designed for multicore processors. We show that some multicore applications still suffer significant performance losses in virtual machines. Even with hardware assistance for reducing virtualization overhead fully enabled, the execution time may be increased by more than 150% when the system is not over-committed, and the system throughput can be reduced by 6x when the system is over-committed. To answer the second question, with experiments, the paper diagnoses the main causes for the performance losses. Focusing the interaction between threads and between VCPUs, the paper identifies and examines a few performance factors, including the intervention of the virtual machine monitor (VMM) to schedule/switch virtual CPUs (VCPUs) and to handle interrupts required by inter-core communication, excessive spinning in user space, and cache-unaware data sharing.
AB - Hardware-assisted virtualization, as an effective approach to low virtualization overhead, has been dominantly used. However, existing hardware assistance mainly focuses on single-thread performance. Much less attention has been paid to facilitate the efficient interaction between threads, which is critical to the execution of multi-threaded computation on virtualized multicore platforms. This paper aims to answer two questions: 1) what is the performance impact of virtualization on multi-threaded computation, and 2) what are the factors impeding multi-threaded computation from gaining full speed on virtualized platforms. Targeting the first question, the paper measures the virtualization overhead for computation-intensive applications that are designed for multicore processors. We show that some multicore applications still suffer significant performance losses in virtual machines. Even with hardware assistance for reducing virtualization overhead fully enabled, the execution time may be increased by more than 150% when the system is not over-committed, and the system throughput can be reduced by 6x when the system is over-committed. To answer the second question, with experiments, the paper diagnoses the main causes for the performance losses. Focusing the interaction between threads and between VCPUs, the paper identifies and examines a few performance factors, including the intervention of the virtual machine monitor (VMM) to schedule/switch virtual CPUs (VCPUs) and to handle interrupts required by inter-core communication, excessive spinning in user space, and cache-unaware data sharing.
KW - Hardware assistance
KW - Multicore
KW - Performance
KW - Virtualization
UR - http://www.scopus.com/inward/record.url?scp=84964328507&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84964328507&partnerID=8YFLogxK
U2 - 10.1109/CloudCom.2015.102
DO - 10.1109/CloudCom.2015.102
M3 - Conference contribution
AN - SCOPUS:84964328507
T3 - Proceedings - IEEE 7th International Conference on Cloud Computing Technology and Science, CloudCom 2015
SP - 226
EP - 233
BT - Proceedings - IEEE 7th International Conference on Cloud Computing Technology and Science, CloudCom 2015
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 7th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2015
Y2 - 30 November 2015 through 3 December 2015
ER -