The impact of encoding–decoding schemes and weight normalization in spiking neural networks

Zhengzhong Liang, David Schwartz, Gregory Ditzler, Onur Ozan Koyluoglu

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

Spike-timing Dependent Plasticity (STDP) is a learning mechanism that can capture causal relationships between events. STDP is considered a foundational element of memory and learning in biological neural networks. Previous research efforts endeavored to understand the functionality of STDP's learning window in spiking neural networks (SNNs). In this study, we investigate the interaction among different encoding/decoding schemes, STDP learning windows and normalization rules for the SNN classifier, trained and tested on MNIST, NIST and ETH80-Contour datasets. The results show that when no normalization rules are applied, classical STDP typically achieves the best performance. Additionally, first-spike decoding classifiers require much less decoding time than a spike count decoding classifier. Thirdly, when no normalization rule is applied, the classifier accuracy decreases as the encoding duration increases from 10ms to 34ms using count decoding scheme. Finally, normalization of output weights is shown to improve the performance of a first-spike decoding classifier, which reveals the importance of weight normalization to SNN.

Original languageEnglish (US)
Pages (from-to)365-378
Number of pages14
JournalNeural Networks
Volume108
DOIs
StatePublished - Dec 1 2018

Keywords

  • Decoding
  • Encoding
  • Learning window
  • Normalization
  • Spike-timing dependent plasticity
  • Spiking neural network

ASJC Scopus subject areas

  • Cognitive Neuroscience
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'The impact of encoding–decoding schemes and weight normalization in spiking neural networks'. Together they form a unique fingerprint.

Cite this