TY - JOUR
T1 - Advances in Biologically Inspired Reservoir Computing
AU - Scardapone, S
AU - Butcher, John
AU - Bianchi, SM
AU - Malik, ZK
N1 - © Springer Nature B.V. 2017. The final publication is available at Springer via http://dx.doi.org/10.1007/s12559-017-9469-1
PY - 2017/6/1
Y1 - 2017/6/1
N2 - The interplay between randomness and optimization has always been a major theme in the design of neural networks [3]. In the last 15 years, the success of reservoir computing (RC) showed that, in many scenarios, the algebraic structure of the recurrent component is far more important than the precise fine-tuning of its weights. As long as the recurrent part of the network possesses a form of fading memory of the input, the dynamics of the neurons are enough to efficiently process many spatio-temporal signals, provided that their activations are sufficiently heterogeneous. Even if today it is feasible to fully optimize deep recurrent networks, their implementation still requires a vast degree of experience and practice, not to mention vast computational resources, limiting their applicability in simpler architectures (e.g., embedded systems) or in areas where time is of key importance (e.g., online systems). Not surprisingly, then, RC remains a powerful tool for quickly solving dynamical problems, and it has become an invaluable tool for modeling and analysis in neuroscience.
AB - The interplay between randomness and optimization has always been a major theme in the design of neural networks [3]. In the last 15 years, the success of reservoir computing (RC) showed that, in many scenarios, the algebraic structure of the recurrent component is far more important than the precise fine-tuning of its weights. As long as the recurrent part of the network possesses a form of fading memory of the input, the dynamics of the neurons are enough to efficiently process many spatio-temporal signals, provided that their activations are sufficiently heterogeneous. Even if today it is feasible to fully optimize deep recurrent networks, their implementation still requires a vast degree of experience and practice, not to mention vast computational resources, limiting their applicability in simpler architectures (e.g., embedded systems) or in areas where time is of key importance (e.g., online systems). Not surprisingly, then, RC remains a powerful tool for quickly solving dynamical problems, and it has become an invaluable tool for modeling and analysis in neuroscience.
UR - https://link.springer.com/article/10.1007/s12559-017-9469-1
U2 - 10.1007/s12559-017-9469-1
DO - 10.1007/s12559-017-9469-1
M3 - Article
VL - 9
SP - 295
EP - 296
JO - Cognitive Computation
JF - Cognitive Computation
IS - 3
ER -