From Pixels to Reasoning: A Cross-Layer Photonic Design for Edge Visual Intelligence

  • Deniz Najafi
  • , Mehrdad Morsali
  • , Hamza Errahmouni Barkam
  • , Brendan Reidy
  • , Sepehr Tabrizchi
  • , Arman Roohi
  • , Mahdi Nikdast
  • , Ramtin Zand
  • , Mohsen Imani
  • , Shaahin Angizi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Advancing energy-efficient, real-time visual intelligence at the sensor edge is crucial for applications such as autonomous systems, surveillance, drones, and augmented reality. In this paper, we present a unified summary of our recent photonic accelerator designs OISA, Lightator, and NeuroPhotonix which collectively demonstrate a new paradigm for near-sensor vision processing through silicon photonic neural networks and neuro-symbolic computing. These works adopt a cross-layer hardware-software co-design methodology to process visual data directly at the sensor, dramatically reducing the need for data transmission to the cloud. OISA and Lightator achieve power reductions of 24× and 73×, respectively, over conventional photonic and GPU-based baselines. Neuro-Photonix extends this foundation by enabling neuro-symbolic AI at the edge, combining analog photonic computation with efficient, granularity-controllable convolutions, a low-cost ADC, and native generation of HyperDimensional (HD) vectors for symbolic reasoning. Together, these designs pave the way for explainable, ultralow-power, and high-performance edge AI, with Neuro-Photonix reaching up to 30 GOPS/W and achieving 20.8× and 4.1×

Original languageEnglish (US)
Title of host publicationIEEE Computer Society Annual Symposium on VLSI, ISVLSI 2025 - Conference Proceedings
PublisherIEEE Computer Society
ISBN (Electronic)9798331534776
DOIs
StatePublished - 2025
Event28th IEEE Computer Society Annual Symposium on VLSI, ISVLSI 2025 - Kalamata, Greece
Duration: Jul 6 2025Jul 9 2025

Publication series

NameProceedings of IEEE Computer Society Annual Symposium on VLSI, ISVLSI
ISSN (Print)2159-3469
ISSN (Electronic)2159-3477

Conference

Conference28th IEEE Computer Society Annual Symposium on VLSI, ISVLSI 2025
Country/TerritoryGreece
CityKalamata
Period7/6/257/9/25

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Hardware and Architecture
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'From Pixels to Reasoning: A Cross-Layer Photonic Design for Edge Visual Intelligence'. Together they form a unique fingerprint.

Cite this