nips nips2013 nips2013-246 nips2013-246-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Christian Albers, Maren Westkott, Klaus Pawelzik
Abstract: Recent extensions of the Perceptron as the Tempotron and the Chronotron suggest that this theoretical concept is highly relevant for understanding networks of spiking neurons in the brain. It is not known, however, how the computational power of the Perceptron might be accomplished by the plasticity mechanisms of real synapses. Here we prove that spike-timing-dependent plasticity having an anti-Hebbian form for excitatory synapses as well as a spike-timing-dependent plasticity of Hebbian shape for inhibitory synapses are sufficient for realizing the original Perceptron Learning Rule if these respective plasticity mechanisms act in concert with the hyperpolarisation of the post-synaptic neurons. We also show that with these simple yet biologically realistic dynamics Tempotrons and Chronotrons are learned. The proposed mechanism enables incremental associative learning from a continuous stream of patterns and might therefore underly the acquisition of long term memories in cortex. Our results underline that learning processes in realistic networks of spiking neurons depend crucially on the interactions of synaptic plasticity mechanisms with the dynamics of participating neurons.
[1] Hertz J, Krogh A, Palmer RG (1991) Introduction to the Theory of Neural Computation., Addison-Wesley.
[2] Rosenblatt F (1957) The Perceptron–a perceiving and recognizing automaton. Report 85-460-1.
[3] Minsky ML, Papert SA (1969) Perceptrons. Cambridge, MA: MIT Press.
[4] Diederich S, Opper M (1987) Learning of correlated patterns in spin-glass networks by local learning rules. Physical Review Letters 58(9):949-952.
[5] G¨ tig R, Sompolinsky H (2006) The Tempotron: a neuron that learns spike timing-based decisions. Nature u Neuroscience 9(3):420-8.
[6] Dan Y, Poo M (2004) Spike Timing-Dependent Plasticity of Neural Circuits. Neuron 44:2330.
[7] Dan Y, Poo M (2006) Spike timing-dependent plasticity: from synapse to perception. Physiological Reviews 86(3):1033-48.
[8] Caporale N, Dan Y (2008) Spike TimingDependent Plasticity: A Hebbian Learning Rule. Annual Review of Neuroscience 31:2546.
[9] Froemke RC, Poo MM, Dan Y (2005) Spike-timing-dependent synaptic plasticity depends on dendritic location. Nature 434:221-225.
[10] Sj¨ str¨ m PJ, H¨ usser M (2006) A Cooperative Switch Determines the Sign of Synaptic Plasticity in Distal o o a Dendrites of Neocortical Pyramidal Neurons. Neuron 51:227-238.
[11] Haas JS, Nowotny T, Abarbanel HDI (2006) Spike-Timing-Dependent Plasticity of Inhibitory Synapses in the Entorhinal Cortex. Journal of Neurophysiology 96(6):3305-3313.
[12] Sj¨ str¨ m PJ, Turrigiano GG, Nelson SB (2004) Endocannabinoid-Dependent Neocortical Layer-5 LTD o o in the Absence of Postsynaptic Spiking. J Neurophysiol 92:3338-3343
[13] D’Souza P, Liu SC, Hahnloser RHR (2010) Perceptron learning rule derived from spike-frequency adaptation and spike-time-dependent plasticity. PNAS 107(10):47224727.
[14] Song S, Miller KD, Abbott LF (2000) Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature Neuroscience 3:919-926.
[15] Izhikevich EM, Desai NS (2003) Relating STDP to BCM. Neural Computation 15:1511-1523
[16] Vogels TP, Sprekeler H, Zenkel F, Clopath C, Gerstner W (2011) Inhibitory Plasticity Balances Excitation and Inhibition in Sensory Pathways and Memory Networks. Science 334(6062):1569-1573.
[17] Florian RV (2012) The Chronotron: A Neuron That Learns to Fire Temporally Precise Spike Patterns. PLoS ONE 7(8): e40233
[18] Rubin R, Monasson R, Sompolinsky H (2010) Theory of Spike Timing-Based Neural Classifiers. Physical Review Letters 105(21): 218102.
[19] Ponulak F, Kasinski, A (2010) Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting. Neural Computation 22:467-510
[20] Xu Y, Zeng X, Zhong S (2013) A New Supervised Learning Algorithm for Spiking Neurons. Neural Computation 25: 1475-1511
[21] Legenstein R, Naeger C, Maass W (2005) What Can a Neuron Learn with Spike-Timing-Dependent Plasticity? Neural Computation 17:2337-2382
[22] Clopath C, B¨ sing L, Vasilaki E, Gerstner W (2010) Connectivity reflects coding: a model of voltageu based STDP with homeostasis. Nature Neuroscience 13:344-355
[23] Fino E, Deniau JM, Venance L (2009) Brief Subthreshold Events Can Act as Hebbian Signals for LongTerm Plasticity. PLoS ONE 4(8): e6557 9