Poster: Extracting Speech from Subtle Room Object Vibrations Using Remote mmWave Sensing

Cong Shi, Tianfang Zhang, Zhaoyi Xu, Shuping Li, Donglin Gao, Changming Li, Athina Petropulu, Chung Tse Michael Wu, Yingying Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Speech privacy leakage has long been a public concern. Existing non-microphone-based eavesdropping attacks rely on physical contact or line-of-sight between the sensor (e.g., a motion sensor or a radar) and the victim sound source. In this poster, we investigate a new form of attack that remotely elicits speech from minute surface vibrations upon common room objects (e.g., paper bags, plastic storage bin) via mmWave sensing. We design and implement a highresolution software-defined phased-MIMO radar that integrates transmit beamforming, virtual array, and receive beamforming. The proposed system enhances sensing directivity by focusing all the mmWave beams toward a target room object. We successfully demonstrate such an attack by developing a deep speech recognition scheme grounded on unsupervised domain adaptation. Without prior training on the victim's data, our attack can achieve a high success rate of over 90% in recognizing simple digits.

Original languageEnglish (US)
Title of host publicationMobiHoc 2023 - Proceedings of the 2023 International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing
PublisherAssociation for Computing Machinery
Pages306-307
Number of pages2
ISBN (Electronic)9781450399265
DOIs
StatePublished - Oct 23 2023
Event2023 International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing, MobiHoc 2023 - Washington, United States
Duration: Oct 23 2023Oct 26 2023

Publication series

NameProceedings of the International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc)

Conference

Conference2023 International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing, MobiHoc 2023
Country/TerritoryUnited States
CityWashington
Period10/23/2310/26/23

All Science Journal Classification (ASJC) codes

  • Software
  • Hardware and Architecture
  • Computer Networks and Communications

Keywords

  • mmWave sensing
  • phased-MIMO
  • speech privacy attack

Fingerprint

Dive into the research topics of 'Poster: Extracting Speech from Subtle Room Object Vibrations Using Remote mmWave Sensing'. Together they form a unique fingerprint.

Cite this