Self Tuning Stochastic Weighted Neural Networks

2020

Closed access Metadata (CSL-JSON)
DOI 10.1109/iscas45731.2020.9180809
Data confidence 85 high
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

The operation of stochastic neural networks with randomly disconnected or blanked out synaptic connections can optimize the power consumption of its circuit implementations in traditional crossbars. However, the permanent disconnection of some synaptic weights can lead to the poor performance of the network, which will require further optimization of the remaining active synapses. In this work, we propose a learning scheme for such stochastically blanked out neural networks. The architecture of the neural network is implemented with standard 0.18u CMOS circuits, in 1T1M crossbar configuration for controlling the blank out rate. The results of the retraining the network with up to 50% of disconnected synapses are reported for the standard image classification problem such as MNIST handwritten digits recognition.