[R] A brain-inspired algorithm that mitigates catastrophic forgetting of artificial and spiking neural networks with low computational cost – Chinese Academy of Sciences 2023

Date:


Paper: https://www.science.org/doi/10.1126/sciadv.adi2947#abstract

Code: https://zenodo.org/record/8037309

Abstract:

Neuromodulators in the brain act globally at many forms of synaptic plasticity, represented as metaplasticity, which is rarely considered by existing spiking (SNNs) and nonspiking artificial neural networks (ANNs). Here, we report an efficient brain-inspired computing algorithm for SNNs and ANNs, referred to here as neuromodulation-assisted credit assignment (NACA), which uses expectation signals to induce defined levels of neuromodulators to selective synapses, whereby the long-term synaptic potentiation and depression are modified in a nonlinear manner depending on the neuromodulator level. The NACA algorithm achieved high recognition accuracy with substantially reduced computational cost in learning spatial and temporal classification tasks. Notably, NACA was also verified as efficient for learning five different class continuous learning tasks with varying degrees of complexity, exhibiting a markedly mitigated catastrophic forgetting at low computational cost. Mapping synaptic weight changes showed that these benefits could be explained by the sparse and targeted synaptic modifications attributed to expectation-based global neuromodulation.

https://preview.redd.it/5lcx3sn8ramb1.jpg?width=711&format=pjpg&auto=webp&s=4431b81708bb9ab98e6351f4b979897ad8244ed9

https://preview.redd.it/vgsuqsn8ramb1.jpg?width=718&format=pjpg&auto=webp&s=f0602185fcb0dc6ec29308f77f1db77a4f4a562d

https://preview.redd.it/hpfuftn8ramb1.jpg?width=709&format=pjpg&auto=webp&s=545f4fab3033cb68637052e7ff2c4775a12a7b99

https://preview.redd.it/7plm0tn8ramb1.jpg?width=714&format=pjpg&auto=webp&s=b138b1c43a2078297b69c09d26de013865629e77

https://preview.redd.it/uc6tnrn8ramb1.jpg?width=703&format=pjpg&auto=webp&s=fcf747b2515fbf6e78b1ef7aa66ce9ca4d223cd3

submitted by /u/Singularian2501
[comments]



Source link

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Share post:

Share post:

Subscribe

spot_imgspot_img

Popular

More like this
Related

Which districts in Dubai are good for Remote work and for digital nomads?

Dubai offers several districts that are conducive to remote...

Bharat Mart and the Rise of a New Ecommerce Success Story in Dubai

In a significant stride towards strengthening trade ties between...

Top Loyalty Programs in Dubai

Dubai, the city of luxury and extravagance, knows a...

Navigating the Ivy League Journey: A Closer Look at HarvardMentoring.com

In the competitive landscape of college admissions, aspiring students...