RF-FSO Dual-Path UAV Network for High Fidelity Multi-Viewpoint Scalable 360° Video Streaming

Mahmudur Khan, Jacob Chakareski, Sabyasachi Gupta

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

We explore a novel RF-FSO dual-path UAV net-work for remote scene aerial scalable 360° video capture and streaming, to enable future virtual human teleportation. One UAV captures the 360° video viewpoint and constructs a scalable tiling representation of the data comprising a base layer and an enhancement layer. The base layer is sent by the UAV to a ground-based remote server using a direct RF link. The enhancement layer is relayed by the UAV to the server over a multi-hop path comprising directed UAV to UAV FSO links. The viewport-specific content from the two layers is then integrated at the server to construct high fidelity content to stream to a remote VR user. The dual-path connectivity ensures both reliability and high fidelity remote immersion. We formulate an optimization problem to maximize the delivered immersion fidelity which depends on the content capture rate, FSO and RF link rates, effective routing path selection, and fast UAV deployment. The problem is mixed integer programming and we formulate an optimization framework that captures the optimal solution at lower complexity. Our experimental results demonstrate an up to 6 dB gain in delivered immersion fidelity over a state-of-the-art method and for the first time enable 12K-120fps 360° video streaming at high fidelity.

Original languageEnglish (US)
Title of host publicationIEEE 22nd International Workshop on Multimedia Signal Processing, MMSP 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728193205
DOIs
StatePublished - Sep 21 2020
Event22nd IEEE International Workshop on Multimedia Signal Processing, MMSP 2020 - Virtual, Tampere, Finland
Duration: Sep 21 2020Sep 24 2020

Publication series

NameIEEE 22nd International Workshop on Multimedia Signal Processing, MMSP 2020

Conference

Conference22nd IEEE International Workshop on Multimedia Signal Processing, MMSP 2020
Country/TerritoryFinland
CityVirtual, Tampere
Period9/21/209/24/20

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Media Technology

Fingerprint

Dive into the research topics of 'RF-FSO Dual-Path UAV Network for High Fidelity Multi-Viewpoint Scalable 360° Video Streaming'. Together they form a unique fingerprint.

Cite this