nips nips2009 nips2009-13 nips2009-13-reference knowledge-graph by maker-knowledge-mining

13 nips-2009-A Neural Implementation of the Kalman Filter


Source: pdf

Author: Robert Wilson, Leif Finkel

Abstract: Recent experimental evidence suggests that the brain is capable of approximating Bayesian inference in the face of noisy input stimuli. Despite this progress, the neural underpinnings of this computation are still poorly understood. In this paper we focus on the Bayesian filtering of stochastic time series and introduce a novel neural network, derived from a line attractor architecture, whose dynamics map directly onto those of the Kalman filter in the limit of small prediction error. When the prediction error is large we show that the network responds robustly to changepoints in a way that is qualitatively compatible with the optimal Bayesian model. The model suggests ways in which probability distributions are encoded in the brain and makes a number of testable experimental predictions. 1


reference text

[1] R.P. Adams and D.J.C. MacKay. Bayesian online changepoint detection. Technical report, University of Cambridge, Cambridge, UK, 2007.

[2] J. S. Anderson, I. Lampl, D. C. Gillespie, and D. Ferster. The contribution of noise to contrast invariance of orientation tuning in cat visual cortex. Science, 290:1968–1972, 2000. 8

[3] M. J. Barber, J. W. Clark, and C. H. Anderson. Neural representation of probabilistic information. Neural Computation, 15:1843–1864, 2003.

[4] J. Beck, W. J. Ma, P. E. Latham, and A. Pouget. Probabilistic population codes and the exponential family of distributions. Progress in Brain Research, 165:509–519, 2007.

[5] K. H. Britten, M. N. Shadlen, W. T. Newsome, and J. A. Movshon. Response of neurons in macaque mt to stochastic motion signals. Visual Neuroscience, 10(1157-1169), 1993.

[6] S. Deneve. Bayesian spiking neurons i: Inference. Neural Computation, 20:91–117, 2008.

[7] S. Deneve. Bayesian spiking neurons ii: Learning. Neural Computation, 20:118–145, 2008.

[8] S. Deneve, J.-R. Duhammel, and A. Pouget. Optimal sensorimotor integration in recurrent cortical networks: a neural implementation of kalman filters. Journal of Neuroscience, 27(21):5744–5756, 2007.

[9] S. Deneve, P. E. Latham, and A. Pouget. Reading population codes: a neural implementation of ideal observers. Nature Neuroscience, 2(8):740–745, 1999.

[10] S. Deneve, P. E. Latham, and A. Pouget. Efficient computation and cue integration with noisy population codes. Nature Neuroscience, 4(8):826–831, 2001.

[11] J. I. Gold and M. N. Shadlen. Representation of a perceptual decision in developing oculomotor commands. Nature, 404(390-394), 2000.

[12] N. J. Gordon, D. J. Salmond, and A. F. M. Smith. Novel approach to nonlinear/non-gaussian bayesian state estimation. IEE-Proceedings-F, 140:107–113, 1993.

[13] D. J. Heeger. Modeling simple cell direction selectivity with normalized half-squared, linear operators. Journal of Neurophysiology, 70:1885–1897, 1993.

[14] D. J. Heeger. Normalization of cell responses in cat striate cortex. Visual Neuroscience, 9:181–198, 1993.

[15] P. E. Latham, S. Deneve, and A. Pouget. Optimal computation with attractor networks. Journal of Physiology Paris, 97(683-694), 2003.

[16] W. J. Ma, J. M. Beck, P. E. Latham, and A. Pouget. Bayesian inference with probabilistic population codes. Nature Neuroscience, 9(11):1432–1438, 2006.

[17] R. P. N. Rao. Bayesian computation in recurrent neural circuits. Neural Computation, 16:1–38, 2004.

[18] R. P. N. Rao. Hierarchical bayesian inference in networks of spiking neurons. In Advances in Neural Information Processing Systems, volume 17, 2005.

[19] M. Sahani and P. Dayan. Doubly distributional population codes: simultaneous representation of uncertainty and multiplicity. Neural Computation, 15:2255–2279, 2003.

[20] G. Sclar and R. D. Freeman. Orientation selectivity in the cat’s striate cortex is invariant with stimulus contrast. Experimental Brain Research, 46:457–461, 1982.

[21] J. S. Taube, R. U. Muller, and J. B. Ranck. Head-direction cells recorded from postsubiculum in freely moving rats. i. description and quantitative analysis. Journal of Neuroscience, 10(2):420–435, 1990.

[22] J. S. Taube, R. U. Muller, and J. B. Ranck. Head-direction cells recorded from postsubiculum in freely moving rats. ii. effects of environmental manipulations. Journal of Neuroscience, 10(2):436–447, 1990.

[23] S. I. Wiener and J. S. Taube. Head direction cells and the neural mechanisms of spatial orientation. MIT Press, 2005.

[24] L.-G. Wu and P. Saggau. Presynaptic inhibition of elicited neurotransmitter release. Trends in Neuroscience, 20:204–212, 1997.

[25] X. Xie, R. H. Hahnloser, and H. S. Seung. Double-ring network model of the head-direction system. Physical Review E, 66:0419021–0419029, 2002.

[26] K. Zhang. Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory. Journal of Neuroscience, 16(6):2112–2126, 1996. 9