Decision-Tree-Initialized Dendritic Neuron Model for Fast and Accurate Data Classification

Xudong Luo, Xiaohao Wen, Meng Chu Zhou, Abdullah Abusorrah, Lukui Huang

Research output: Contribution to journalArticlepeer-review

Abstract

This work proposes a decision tree (DT)-based method for initializing a dendritic neuron model (DNM). Neural networks become larger and larger, thus consuming more and more computing resources. This calls for a strong need to prune neurons that do not contribute much to their network's output. Pruning those with low contribution may lead to a loss of accuracy of DNM. Our proposed method is novel because 1) it can reduce the number of dendrites in DNM while improving training efficiency without affecting accuracy and 2) it can select proper initialization weight and threshold of neurons. The Adam algorithm is used to train DNM after its initialization with our proposed DT-based method. To verify its effectiveness, we apply it to seven benchmark datasets. The results show that decision-tree-initialized DNM is significantly better than the original DNM, k-nearest neighbor, support vector machine, back-propagation neural network, and DT classification methods. It exhibits the lowest model complexity and highest training speed without losing any accuracy. The interactions among attributes can also be observed in its dendritic neurons.

Original languageEnglish (US)
JournalIEEE Transactions on Neural Networks and Learning Systems
DOIs
StateAccepted/In press - 2021

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Science Applications
  • Computer Networks and Communications
  • Artificial Intelligence

Keywords

  • Biological neural networks
  • Biomembranes
  • Classification
  • Computational modeling
  • decision tree (DT)
  • dendritic neuron model (DNM)
  • machine learning
  • neural network.
  • Neurons
  • Sparse matrices
  • Synapses
  • Training

Fingerprint Dive into the research topics of 'Decision-Tree-Initialized Dendritic Neuron Model for Fast and Accurate Data Classification'. Together they form a unique fingerprint.

Cite this