FBDT: Forward and Backward Data Transmission Across RATs for High Quality Mobile 360-Degree Video VR Streaming

Suresh Srinivasan, Sam Shippey, Ehsan Aryafar, Jacob Chakareski

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The metaverse encompasses many virtual universes and relies on streaming high-quality 360° videos to VR/AR headsets. This type of video transmission requires very high data rates to meet the desired Quality of Experience (QoE) for all clients. Simultaneous data transmission across multiple Radio Access Technologies (RATs) such as WiFi and WiGig is a key solution to meet this required capacity demand. However, existing transport layer multi-RAT traffic aggregation schemes suffer from Head-of-Line (HoL) blocking and sub-optimal traffic splitting across the RATs, particularly when there is a high fluctuation in their channel conditions. As a result, state-of-The-Art multi-path TCP (MPTCP) solutions can achieve aggregate transmission data rates that are lower than that of using only a single WiFi RAT in many practical settings, e.g., when the client is mobile. We make two key contributions to enable high quality mobile 360° video VR streaming using multiple RATs. First, we propose the design of FBDT, a novel multi-path transport layer solution that can achieve the sum of individual transmission rates across the RATs despite their system dynamics. We implemented FBDT in the Linux kernel and showed substantial improvement in transmission throughput relative to state-of-The-Art schemes, e.g, 2.5x gain in a dual-RAT scenario (WiFi and WiGig) when the VR client is mobile. Second, we formulate an optimization problem to maximize a mobile VR client's viewport quality by taking into account statistical models of how clients explore the 360° look-Around panorama and the transmission data rate of each RAT. We explore an iterative method to solve this problem and evaluate its performance through measurement-driven simulations leveraging our testbed. We show up to 12 dB increase in viewport quality when our optimization framework is employed.

Original languageEnglish (US)
Title of host publicationMMSys 2023 - Proceedings of the 14th ACM Multimedia Systems Conference
PublisherAssociation for Computing Machinery, Inc
Pages130-141
Number of pages12
ISBN (Electronic)9798400701481
DOIs
StatePublished - Jun 7 2023
Event14th ACM Multimedia Systems Conference, MMSys 2023 - Vancouver, Canada
Duration: Jun 7 2023Jun 10 2023

Publication series

NameMMSys 2023 - Proceedings of the 14th ACM Multimedia Systems Conference

Conference

Conference14th ACM Multimedia Systems Conference, MMSys 2023
Country/TerritoryCanada
CityVancouver
Period6/7/236/10/23

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Keywords

  • rate distortion
  • transport layer protocol
  • virtual reality

Fingerprint

Dive into the research topics of 'FBDT: Forward and Backward Data Transmission Across RATs for High Quality Mobile 360-Degree Video VR Streaming'. Together they form a unique fingerprint.

Cite this