nips nips2004 nips2004-76 nips2004-76-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Rajesh P. Rao
Abstract: There is growing evidence from psychophysical and neurophysiological studies that the brain utilizes Bayesian principles for inference and decision making. An important open question is how Bayesian inference for arbitrary graphical models can be implemented in networks of spiking neurons. In this paper, we show that recurrent networks of noisy integrate-and-fire neurons can perform approximate Bayesian inference for dynamic and hierarchical graphical models. The membrane potential dynamics of neurons is used to implement belief propagation in the log domain. The spiking probability of a neuron is shown to approximate the posterior probability of the preferred state encoded by the neuron, given past inputs. We illustrate the model using two examples: (1) a motion detection network in which the spiking probability of a direction-selective neuron becomes proportional to the posterior probability of motion in a preferred direction, and (2) a two-level hierarchical network that produces attentional effects similar to those observed in visual cortical areas V2 and V4. The hierarchical model offers a new Bayesian interpretation of attentional modulation in V2 and V4. 1
[1] C. H. Anderson and D. C. Van Essen. Neurobiological computational systems. In Computational Intelligence: Imitating Life, pages 213–222. New York, NY: IEEE Press, 1994.
[2] R. H. S. Carpenter and M. L. L. Williams. Neural computation of log likelihood in control of saccadic eye movements. Nature, 377:59–62, 1995.
[3] S. Deneve and A. Pouget. Bayesian estimation by interconnected neural networks (abstract no. 237.11). Society for Neuroscience Abstracts, 27, 2001.
[4] W. Gerstner. Population dynamics of spiking neurons: Fast transients, asynchronous states, and locking. Neural Computation, 12(1):43–89, 2000.
[5] J. I. Gold and M. N. Shadlen. Neural computations that underlie decisions about sensory stimuli. Trends in Cognitive Sciences, 5(1):10–16, 2001.
[6] M. Hausser and B. Mel. Dendrites: bug or feature? Current Opinion in Neurobiology, 13:372– 383, 2003.
[7] D. C. Knill and W. Richards. Perception as Bayesian Inference. Cambridge, UK: Cambridge University Press, 1996.
[8] K. P. K¨ rding and D. Wolpert. Bayesian integration in sensorimotor learning. Nature, 427:244– o 247, 2004.
[9] T. S. Lee and D. Mumford. Hierarchical Bayesian inference in the visual cortex. Journal of the Optical Society of America A, 20(7):1434–1448, 2003.
[10] B. W. Mel. NMDA-based pattern discrimination in a modeled cortical neuron. Neural Computation, 4(4):502–517, 1992.
[11] K. Murphy, Y. Weiss, and M. Jordan. Loopy belief propagation for approximate inference: An empirical study. In Proceedings of UAI (Uncertainty in AI), pages 467–475. 1999.
[12] J. Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Mateo, CA, 1988.
[13] H. E. Plesser and W. Gerstner. Noise in integrate-and-fire neurons: From stochastic input to escape rates. Neural Computation, 12(2):367–384, 2000.
[14] A. Pouget, P. Dayan, and R. S. Zemel. Inference and computation with population codes. Annual Review of Neuroscience, 26:381–410, 2003.
[15] R. P. N. Rao. Bayesian computation in recurrent neural circuits. Neural Computation, 16(1):1– 38, 2004.
[16] R. P. N. Rao, B. A. Olshausen, and M. S. Lewicki. Probabilistic Models of the Brain: Perception and Neural Function. Cambridge, MA: MIT Press, 2002.
[17] J. H. Reynolds, L. Chelazzi, and R. Desimone. Competitive mechanisms subserve attention in macaque areas V2 and V4. Journal of Neuroscience, 19:1736–1753, 1999.
[18] M. Sahani and P. Dayan. Doubly distributional population codes: Simultaneous representation of uncertainty and multiplicity. Neural Computation, 15:2255–2279, 2003.
[19] Y. Weiss, E. P. Simoncelli, and E. H. Adelson. Motion illusions as optimal percepts. Nature Neuroscience, 5(6):598–604, 2002.
[20] R. S. Zemel, P. Dayan, and A. Pouget. Probabilistic interpretation of population codes. Neural Computation, 10(2):403–430, 1998.