Viewport-Driven Rate-Distortion Optimized 360° Video Streaming

Jacob Chakareski, Ridvan Aksu, Xavier Corbillon, Gwendal Simon, Viswanathan Swaminathan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

48 Scopus citations

Abstract

The growing popularity of virtual and augmented reality communications and mathbf 360 video streaming is moving video communication systems into much more dynamic and resource-limited operating settings. The enormous data volume of mathbf 360 videos requires an efficient use of network bandwidth to maintain the desired quality of experience for the end user. To this end, we propose a framework for viewport-driven rate-distortion optimized mathbf 360 video streaming that integrates the user view navigation pattern and the spatiotemporal rate-distortion characteristics of the mathbf 360 video content to maximize the delivered user quality of experience for the given network/system resources. The framework comprises a methodology for constructing dynamic heat maps that capture the likelihood of navigating different spatial segments of a mathbf 360 video over time by the user, an analysis and characterization of its spatiotemporal rate-distortion characteristics that leverage preprocessed spatial tilling of the mathbf 360 view sphere, and an optimization problem formulation that characterizes the delivered user quality of experience given the user navigation patterns, mathbf 360 video encoding decisions, and the available system/network resources. Our experimental results demonstrate the advantages of our framework over the conventional approach of streaming a monolithic uniformly-encoded mathbf 360 video and a state-of-the-art reference method. Considerable video quality gains of 4 - 5 dB are demonstrated in the case of two popular 4K mathbf 360 videos.

Original languageEnglish (US)
Title of host publication2018 IEEE International Conference on Communications, ICC 2018 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Print)9781538631805
DOIs
StatePublished - Jul 27 2018
Externally publishedYes
Event2018 IEEE International Conference on Communications, ICC 2018 - Kansas City, United States
Duration: May 20 2018May 24 2018

Publication series

NameIEEE International Conference on Communications
Volume2018-May
ISSN (Print)1550-3607

Other

Other2018 IEEE International Conference on Communications, ICC 2018
Country/TerritoryUnited States
CityKansas City
Period5/20/185/24/18

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Viewport-Driven Rate-Distortion Optimized 360° Video Streaming'. Together they form a unique fingerprint.

Cite this