nips nips2001 nips2001-166 nips2001-166-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: N. Matsumoto, M. Okada
Abstract: Recent biological experimental findings have shown that the synaptic plasticity depends on the relative timing of the pre- and postsynaptic spikes which determines whether Long Term Potentiation (LTP) occurs or Long Term Depression (LTD) does. The synaptic plasticity has been called “Temporally Asymmetric Hebbian plasticity (TAH)”. Many authors have numerically shown that spatiotemporal patterns can be stored in neural networks. However, the mathematical mechanism for storage of the spatio-temporal patterns is still unknown, especially the effects of LTD. In this paper, we employ a simple neural network model and show that interference of LTP and LTD disappears in a sparse coding scheme. On the other hand, it is known that the covariance learning is indispensable for storing sparse patterns. We also show that TAH qualitatively has the same effect as the covariance learning when spatio-temporal patterns are embedded in the network. 1
[1] G. Q. Bi and M. M. Poo. Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type. The Journal of Neuroscience, 18:10464–10472, 1998.
[2] H. Markram, J. L¨bke, M. Frotscher, and B. Sakmann. Regulation of synaptic u efficacy by coincidence of postsynaptic aps and epsps. Science, 275:213–215, 1997.
[3] L. I. Zhang, H. W. Tao, C. E. Holt, W. A. Harris, and M. M. Poo. A critical window for cooperation and competition among developing retinotectal synapses. Nature, 395:37–44, 1998.
[4] L. F. Abbott and S. Song. Temporally asymmetric hebbian learning, spike timing and neuronal response variability. In Advances in Neural Information Processing Systems 11, pages 69–75. MIT Press, 1999.
[5] J. Rubin, D. D. Lee, and H. Sompolinsky. Equilibrium properties of temporally asymmetric hebbian plasticity. Physical Review Letters, 86:364–367, 2001.
[6] S. Song, K. D. Miller, and L. F. Abbott. Competitive hebbian learning through spike-timing-dependent synaptic plasticity. Nature Neuroscience, 3:919–926, 2000.
[7] W. Gerstner, R. Kempter, J. L. van Hemmen, and H. Wagner. A neuronal learning rule for sub-millisecond temporal coding. Nature, 383:76–78, 1996.
[8] R. Kempter, W. Gerstner, and J. L. van Hemmen. Hebbian learning and spiking neurons. Physical Review E, 59:4498–4514, 1999.
[9] P. Munro and G. Hernandez. LTD facilitates learning in a noisy environment. In Advances in Neural Information Processing Systems 12, pages 150–156. MIT Press, 2000.
[10] R. P. N. Rao and T. J. Sejnowski. Predictive sequence learning in recurrent neocortical circuits. In Advances in Neural Information Processing Systems 12, pages 164–170. MIT Press, 2000.
[11] M. Yoshioka. to be published in Physical Review E, 2001.
[12] G. Chechik, I. Meilijson, and E. Ruppin. Effective learning requires neuronal remodeling of hebbian synapses. In Advances in Neural Information Processing Systems 11, pages 96–102. MIT Press, 1999.
[13] K. Kitano and T. Aoyagi. Retrieval dynamics of neural networks for sparsely coded sequential patterns. Journal of Physics A: Mathematical and General, 31:L613–L620, 1998.
[14] M. Miyashita. Neuronal correlate of visual associative long-term memory in the primate temporal cortex. Nature, 335:817–820, 1988.
[15] S. Amari. Characteristics of sparsely encoded associative memory. Neural Networks, 2:1007–1018, 1989.
[16] M. Okada. Notions of associative memory and sparse coding. Neural Networks, 9:1429–1458, 1996.
[17] S. Amari and K. Maginu. Statistical neurodynamics of various versions of correlation associative memory. Neural Networks, 1:63–73, 1988.
[18] M. Okada. A hierarchy of macrodynamical equations for associative memory. Neural Networks, 8:833–838, 1995.
[19] M. V. Tsodyks and M. V. Feigle’man. The enhanced strage capacity in neural networks with low activity level. Europhysics Letters, 6:101–105, 1988.
[20] C. J. Perez-Vicente and D. J. Amit. Optimized network for sparsely coded patterns. Journal of Physics A: Mathematical and General, 22:559–569, 1989.