Viewport-Adaptive Scalable Multi-User Virtual Reality Mobile-Edge Streaming

Research output: Contribution to journalArticlepeer-review

45 Scopus citations

Abstract

Virtual reality (VR) holds tremendous potential to advance our society, expected to make impact on quality of life, energy conservation, and the economy. To bring us closer to this vision, the present paper investigates a novel communications system that integrates for the first time scalable multi-layer 360° video tiling, viewport-adaptive rate-distortion optimal resource allocation, and VR-centric edge computing and caching, to enable next generation high-quality untethered VR streaming. Our system comprises a collection of 5G small cells that can pool their communication, computing, and storage resources to collectively deliver scalable 360° video content to mobile VR clients at much higher quality. The major contributions of the paper are the rigorous design of multi-layer 360° tiling and related models of statistical user navigation, analysis and optimization of edge-based multi-user VR streaming that integrates viewport adaptation and server cooperation, and base station 360° video packet scheduling. We also explore the possibility of network coded data operation and its implications for the analysis, optimization, and system performance we pursue in this setting. The advances introduced by our framework over the state-of-the-art comprise considerable gains in delivered immersion fidelity, featuring much higher 360° viewport peak signal to noise ratio (PSNR) and VR video frame rates and spatial resolutions.

Original languageEnglish (US)
Article number9086630
Pages (from-to)6330-6342
Number of pages13
JournalIEEE Transactions on Image Processing
Volume29
DOIs
StatePublished - 2020

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Graphics and Computer-Aided Design

Keywords

  • 5G small cell systems
  • Mobile edge computing and streaming
  • Mobile virtual reality
  • Multiple knapsack problem with multiple constraints
  • Resource allocation
  • Scalable 360° video tiling
  • Statistical VR navigation analysis

Fingerprint

Dive into the research topics of 'Viewport-Adaptive Scalable Multi-User Virtual Reality Mobile-Edge Streaming'. Together they form a unique fingerprint.

Cite this