PINSim: A Processing In- and Near-Sensor Simulator to Model Intelligent Vision Sensors

Sepehr Tabrizchi, Mehrdad Morsali, David Pan, Shaahin Angizi, Arman Roohi

Research output: Contribution to journalArticlepeer-review

Abstract

This letter introduces PINSim, a user-friendly and flexible framework for simulating emerging smart vision sensors in the early design stages. PINSim enables the realization of integrated sensing and processing near and in the sensor, effectively addressing challenges such as data movement and power-hungry analog-to-digital converters. The framework offers a flexible interface and a wide range of design options for customizing the efficiency and accuracy of processing-near/in-sensor-based accelerators using a hierarchical structure. Its organization spans from the device level upward to the algorithm level. PINSim realizes instruction-accurate evaluation of circuit-level performance metrics. PINSim achieves over <FOR VERIFICATION>$25,000\times$ speed-up compared to SPICE simulation with less than a <FOR VERIFICATION>$4.1\%$ error rate on average. Furthermore, it supports both multilayer perceptron (MLP) and convolutional neural network (CNN) models, with limitations determined by IoT budget constraints. By facilitating the exploration and optimization of various design parameters, PiNSim empowers researchers and engineers to develop energy-efficient and high-performance smart vision sensors for a wide range of applications.

Original languageEnglish (US)
JournalIEEE Computer Architecture Letters
DOIs
StateAccepted/In press - 2024

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture

Keywords

  • neural network
  • numerical simulation
  • processing-in-sensor
  • processing-near-sensor

Fingerprint

Dive into the research topics of 'PINSim: A Processing In- and Near-Sensor Simulator to Model Intelligent Vision Sensors'. Together they form a unique fingerprint.

Cite this