Supervised learning in spiking, neural networks with noise-threshold

Malu Zhang, Hong Qu*, Xiurui Xie, Juergen Kurths

*Corresponding author for this work

Research output: Contribution to journalArticle

23 Citations (Scopus)

Abstract

With a similar capability of processing spikes as biological neural systems, networks of spiking neurons are expected to achieve a performance similar to that of living brains. Despite the achievement of spiking neuron based applications, most of them assume noise-free condition for learning and testing. This assumption, though fairly general, ignores the fact that noise widely exists in spiking neural networks (SNNs) and the neural response can be significantly disturbed by noise. Therefore, how to deal with noise is an important issue in the applications of SNNs. Here, by analyzing strategies employed to make spiking neurons robust to noise, also inspired by biological neurons, we propose a strategy that train spiking neurons with a dynamic firing threshold named noise-threshold. The noise-threshold can be applied by the existing supervised learning methods to improve the noise tolerance of them. Experimental results show that, with a combination of noise-threshold, the anti-noise capability of the existing supervised learning methods improves significantly, and the trained neuron can precisely and reliably reproduce target sequences of spikes even under highly noisy conditions. More importantly, the SNNs-based computational model equipped with a noise-threshold is more robust and can achieve a good performance even with different types of noise. Therefore, the noise-threshold is significant to practical applications and theoretical researches of SNNs.

Original languageEnglish
Pages (from-to)333-349
Number of pages17
JournalNeurocomputing
Volume219
Early online date24 Sep 2016
DOIs
Publication statusPublished - 5 Jan 2017

Keywords

  • Spiking neurons
  • Noise-threshold
  • Supervised learning
  • Spiking neural networks (SNNs)
  • Anti-noise capability
  • RETINAL GANGLION-CELLS
  • IN-VIVO
  • NEURONS
  • PRECISION
  • INFORMATION
  • RELIABILITY
  • SIGNALS
  • TRAINS
  • MODEL

Cite this