Towards Immersive Metaverse Experience: A Wireless Adaptive 3D Human Modeling System

Mingrui Yin, Sohom Sen, Yongjie Guan, Xueyu Hou, Tao Han, Nirwan Ansari

Research output: Contribution to journalArticlepeer-review

Abstract

The concept of the metaverse envisions an immersive environment where people can interact, participate in 3D meetings, engage in immersive gaming, and work, and experience the seamless integration of real and virtual worlds. Mixed reality (MR) systems hold significant potential to realize this vision. However, current MR environments face key technical challenges, such as limited network bandwidth and computing capacity. This paper addresses these issues by proposing A wireless adaptive 3D human modeling system calledWadmanMR. WadmanMR dynamically adapts to varying computational and network conditions through a sophisticated integration of smart cameras, servers, and MR headsets, enabling real-time 3D human modeling from 2D images and videos. Performance evaluations of WadmanMR demonstrate that it can maintain real-time processing standards, achieving an average end-to-end latency of less than 100ms and packet loss below 1%, under varying network conditions. WadmanMR outperforms the current state-of-the-art like MagicStream, ExPose and Pixie. Furthermore, this paper explores several open research issues aimed at further improving the performance and applicability of MR systems.

Original languageEnglish (US)
JournalIEEE Network
DOIs
StateAccepted/In press - 2025

All Science Journal Classification (ASJC) codes

  • Software
  • Information Systems
  • Hardware and Architecture
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Towards Immersive Metaverse Experience: A Wireless Adaptive 3D Human Modeling System'. Together they form a unique fingerprint.

Cite this