[R] A brain-inspired algorithm that mitigates catastrophic forgetting of artificial and spiking neural networks with low computational cost – Chinese Academy of Sciences 2023


Paper: https://www.science.org/doi/10.1126/sciadv.adi2947#abstract

Code: https://zenodo.org/record/8037309


Neuromodulators in the brain act globally at many forms of synaptic plasticity, represented as metaplasticity, which is rarely considered by existing spiking (SNNs) and nonspiking artificial neural networks (ANNs). Here, we report an efficient brain-inspired computing algorithm for SNNs and ANNs, referred to here as neuromodulation-assisted credit assignment (NACA), which uses expectation signals to induce defined levels of neuromodulators to selective synapses, whereby the long-term synaptic potentiation and depression are modified in a nonlinear manner depending on the neuromodulator level. The NACA algorithm achieved high recognition accuracy with substantially reduced computational cost in learning spatial and temporal classification tasks. Notably, NACA was also verified as efficient for learning five different class continuous learning tasks with varying degrees of complexity, exhibiting a markedly mitigated catastrophic forgetting at low computational cost. Mapping synaptic weight changes showed that these benefits could be explained by the sparse and targeted synaptic modifications attributed to expectation-based global neuromodulation.






submitted by /u/Singularian2501

Source link


Please enter your comment!
Please enter your name here

Share post:

Share post:




More like this

The Guessing Game is Over. Taylor Swift reveals ‘1989 (Taylor’s Version)’ vault song names.

Taylor Swift's devoted fans were in for an exciting...

How to Get a Car Insurance Quote Online in Dubai

Car insurance is a mandatory requirement for all drivers...

Enhancing Focus and Productivity: A Comprehensive Guide to ADHD Music, Products, Chairs, Online Tests, and Planners

Attention Deficit Hyperactivity Disorder (ADHD) is a neurodevelopmental disorder...

Reliable Postal and Courier Services Dubai – Fast & Secure Delivery

When it comes to sending and receiving packages and...