Neuromorphic Wireless Cognition: Event-Driven Semantic Communications for Remote Inference

Jiechen Chen, Nicolas Skatchkovsky, Osvaldo Simeone

Research output: Contribution to journalArticlepeer-review

8 Scopus citations

Abstract

Neuromorphic computing is an emerging computing paradigm that moves away from batched processing towards the online, event-driven, processing of streaming data. Neuromorphic chips, when coupled with spike-based sensors, can inherently adapt to the 'semantics' of the data distribution by consuming energy only when relevant events are recorded in the timing of spikes and by proving a low-latency response to changing conditions in the environment. This paper proposes an end-to-end design for a neuromorphic wireless Internet-of-Things system that integrates spike-based sensing, processing, and communication. In the proposed NeuroComm system, each sensing device is equipped with a neuromorphic sensor, a spiking neural network (SNN), and an impulse radio (IR) transmitter with multiple antennas. Transmission takes place over a shared fading channel to a receiver equipped with a multi-antenna impulse radio receiver and with an SNN. In order to enable adaptation of the receiver to the fading channel conditions, we introduce a hypernetwork to control the weights of the decoding SNN using pilots. Pilots, encoding SNNs, decoding SNN, and hypernetwork are jointly trained across multiple channel realizations. The proposed system is shown to significantly improve over conventional frame-based digital solutions, as well as over alternative non-adaptive training methods, in terms of time-to-accuracy and energy consumption metrics.

Original languageEnglish (US)
Pages (from-to)252-265
Number of pages14
JournalIEEE Transactions on Cognitive Communications and Networking
Volume9
Issue number2
DOIs
StatePublished - Apr 1 2023

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Hardware and Architecture
  • Computer Networks and Communications

Keywords

  • Neuromorphic computing
  • semantic communications
  • spiking neural networks

Fingerprint

Dive into the research topics of 'Neuromorphic Wireless Cognition: Event-Driven Semantic Communications for Remote Inference'. Together they form a unique fingerprint.

Cite this