Wifi-VLC dual connectivity streaming system for 6DOF multi-user virtual reality

Jacob Chakareski, Mahmudur Khan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Scopus citations

Abstract

We investigate a future WiFi-VLC dual connectivity streaming system for 6DOF multi-user virtual reality that enables reliable high-fidelity remote scene immersion. The system integrates an edge server that uses scalable 360° tiling to adaptively split the present 360° view of a VR user into a panoramic baseline content layer and a viewport-specific enhancement content layer. The user is then served the two content layers over complementary WiFi and VLC wireless links such that the delivered viewport quality is maximized for the given WiFi and VLC transmission resources. We formally characterize the actions of the server using rate-distortion optimization that we solve at low complexity. To account for the users' mobility as they explore different 360° viewpoints of the 6DOF remote scene content and maintain reliable high-quality VLC connectivity, we explore dynamic VLC transmitter steering and assignment in the system as graph bottleneck matching that aims to maximize the received VLC SNR across all users. We formulate an effective low-complexity solution to this discrete combinatorial optimization problem of high complexity. The paper also contributes a first actual 6DOF body and head movement VR navigation dataset that we collected and facilitate to assess the performance of our system via simulation experiments. These demonstrate enhanced VLC transmission performance and an up to 7 dB gain in viewport quality over a state-of-The-Art VLC cellular system (LiFi), and an up to 10 dB gain in viewport quality over a state-of-The-Art traditional wireless streaming method, for 12K-120fps 360° 6DOF VR content. Moreover, the synergistic WiFi-VLC dual connectivity of the proposed system augments its reliability over the reference method LiFi that comprises only VLC links. These outcomes motivate further exploration and prototype implementation of our system.

Original languageEnglish (US)
Title of host publicationNOSSDAV 2021 - Proceedings of the 2021 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2021
PublisherAssociation for Computing Machinery, Inc
Pages107-113
Number of pages7
ISBN (Electronic)9781450384353
DOIs
StatePublished - Jul 16 2021
Event31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2021 - Virtual, Online, Turkey
Duration: Sep 28 2021Oct 1 2021

Publication series

NameNOSSDAV 2021 - Proceedings of the 2021 Workshop on Network and Operating System Support for Digital Audio and Video, Part of MMSys 2021

Conference

Conference31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2021
Country/TerritoryTurkey
CityVirtual, Online
Period9/28/2110/1/21

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition

Keywords

  • 6DOF virtual reality
  • scalable 360° video tiling
  • visible light communication
  • wifi-VLC dual connectivity wireless streaming

Fingerprint

Dive into the research topics of 'Wifi-VLC dual connectivity streaming system for 6DOF multi-user virtual reality'. Together they form a unique fingerprint.

Cite this