Optimizing Task Scheduling in Cloud VMs with Accurate vCPU Abstraction

Edward Guo, Weiwei Jia, Xiaoning Ding, Jianchen Shan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The paper shows that task scheduling in Cloud VMs hasn’t evolved quickly to handle the dynamic vCPU resources. The existing vCPU abstraction cannot accurately depict the vCPU dynamics in capacity, activity, and topology, and these mismatches can mislead the scheduler, causing performance degradation and system anomalies. The paper proposes a novel solution, vSched, which probes accurate vCPU abstraction through a set of lightweight microbenchmarks (vProbers) without modifying the hypervisor, and leverages the probed information to optimize task scheduling in cloud VMs with three new techniques: biased vCPU selection, intra-VM harvesting, and relaxed work conservation. Our evaluation of vSched’s implementation in x86 Linux Kernel demonstrates that it can effectively improve both system throughput and workload latency across various VM types in the dynamic multi-cloud environment.

Original languageEnglish (US)
Title of host publicationEuroSys 2025 - Proceedings of the 2025 20th European Conference on Computer Systems
PublisherAssociation for Computing Machinery, Inc
Pages753-768
Number of pages16
ISBN (Electronic)9798400711961
DOIs
StatePublished - Mar 30 2025
Event20th European Conference on Computer Systems, EuroSys 2025, co-located 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS 2025 - Rotterdam, Netherlands
Duration: Mar 30 2025Apr 3 2025

Publication series

NameEuroSys 2025 - Proceedings of the 2025 20th European Conference on Computer Systems

Conference

Conference20th European Conference on Computer Systems, EuroSys 2025, co-located 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS 2025
Country/TerritoryNetherlands
CityRotterdam
Period3/30/254/3/25

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Hardware and Architecture
  • Control and Systems Engineering

Keywords

  • Cloud Computing
  • Operating Systems
  • Resource Probing
  • Task Scheduling
  • Virtualization

Fingerprint

Dive into the research topics of 'Optimizing Task Scheduling in Cloud VMs with Accurate vCPU Abstraction'. Together they form a unique fingerprint.

Cite this