Speech privacy attack via vibrations from room objects leveraging a phased-MIMO radar

Cong Shi, Tianfang Zhang, Zhaoyi Xu, Shuping Li, Yichao Yuan, Athina Petropulu, Chung Tse Michael Wu, Yingying Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Speech privacy leakage has long been a public concern. Through speech eavesdropping, an adversary may steal a user's private information or an enterprise's financial/intellectual properties, leading to catastrophic consequences. Existing non-microphone-based eavesdropping attacks rely on physical contact or line-of-sight between the sensor (e.g., a motion sensor or a radar) and the victim sound source. In this poster, we discover a new form of speech eavesdropping attack that senses minor speech-induced vibrations upon common room objects using mmWave. By integrating phasedarray and multiple-input and multiple-output (MIMO) on a single mmWave transceiver, our attack can capture and fuse micrometerlevel vibrations upon the surfaces of multiple objects to reveal speech content in a remote and non-line-of-sight fashion. We successfully demonstrate such an attack by developing a deep speech recognition scheme grounded on unsupervised domain adaptation. Without prior training on the victim's data, our attack can achieve a high success rate of over 90% in recognizing simple speech content.

Original languageEnglish (US)
Title of host publicationMobiSys 2022 - Proceedings of the 2022 20th Annual International Conference on Mobile Systems, Applications and Services
PublisherAssociation for Computing Machinery, Inc
Pages573-574
Number of pages2
ISBN (Electronic)9781450391856
DOIs
StatePublished - Jun 27 2022
Externally publishedYes
Event20th ACM International Conference on Mobile Systems, Applications and Services, MobiSys 2022 - Portland, United States
Duration: Jun 27 2022Jul 1 2022

Publication series

NameMobiSys 2022 - Proceedings of the 2022 20th Annual International Conference on Mobile Systems, Applications and Services

Conference

Conference20th ACM International Conference on Mobile Systems, Applications and Services, MobiSys 2022
Country/TerritoryUnited States
CityPortland
Period6/27/227/1/22

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Computer Science Applications

Keywords

  • mmWave sensing
  • phased-MIMO
  • speech privacy attack

Fingerprint

Dive into the research topics of 'Speech privacy attack via vibrations from room objects leveraging a phased-MIMO radar'. Together they form a unique fingerprint.

Cite this