nips nips2005 nips2005-129 nips2005-129-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Frank Wood, Stefan Roth, Michael J. Black
Abstract: Probabilistic modeling of correlated neural population firing activity is central to understanding the neural code and building practical decoding algorithms. No parametric models currently exist for modeling multivariate correlated neural data and the high dimensional nature of the data makes fully non-parametric methods impractical. To address these problems we propose an energy-based model in which the joint probability of neural activity is represented using learned functions of the 1D marginal histograms of the data. The parameters of the model are learned using contrastive divergence and an optimization procedure for finding appropriate marginal directions. We evaluate the method using real data recorded from a population of motor cortical neurons. In particular, we model the joint probability of population spiking times and 2D hand position and show that the likelihood of test data under our model is significantly higher than under other models. These results suggest that our model captures correlations in the firing activity. Our rich probabilistic model of neural population activity is a step towards both measurement of the importance of correlations in neural coding and improved decoding of population activity. 1
[1] S. C. Zhu, Z. N. Wu, and D. Mumford, “Minimax entropy principle and its application to texture modeling,” Neural Comp., vol. 9, no. 8, pp. 1627–1660, 1997.
[2] C. Liu, S. C. Zhu, and H. Shum, “Learning inhomogeneous Gibbs model of faces by minimax entropy,” in ICCV, pp. 281–287, 2001.
[3] G. Hinton, “Training products of experts by minimizing contrastive divergence,” Neural Comp., vol. 14, pp. 1771–1800, 2002.
[4] Y. Teh, M. Welling, S. Osindero, and G. E. Hinton, “Energy-based models for sparse overcomplete representations,” JMLR, vol. 4, pp. 1235–1260, 2003.
[5] G. Hinton, “Product of experts,” in ICANN, vol. 1, pp. 1–6, 1999.
[6] A. J. Bell and L. C. Parra, “Maximising sensitivity in a spiking network,” in Advances in NIPS, vol. 17, pp. 121–128, 2005.
[7] R. S. Zemel, Q. J. M. Huys, R. Natarajan, and P. Dayan, “Probabilistic computation in spiking populations,” in Advances in NIPS, vol. 17, pp. 1609–1616, 2005.
[8] M. Serruya, N. Hatsopoulos, M. Fellows, L. Paninski, and J. Donoghue, “Robustness of neuroprosthetic decoding algorithms,” Biological Cybernetics, vol. 88, no. 3, pp. 201–209, 2003.
[9] M. D. Serruya, N. G. Hatsopoulos, L. Paninski, M. R. Fellows, and J. P. Donoghue, “Brain-machine interface: Instant neural control of a movement signal,” Nature, vol. 416, pp. 141–142, 2002.
[10] W. Wu, M. J. Black, Y. Gao, E. Bienenstock, M. Serruya, A. Shaikhouni, and J. P. Donoghue, “Neural decoding of cursor motion using a Kalman filter,” in Advances in NIPS, vol. 15, pp. 133–140, 2003.
[11] Y. Gao, M. J. Black, E. Bienenstock, S. Shoham, and J. P. Donoghue, “Probabilistic inference of arm motion from neural activity in motor cortex,” Advances in NIPS, vol. 14, pp. 221–228, 2002.
[12] M. Welling, G. Hinton, and S. Osindero, “Learning sparse topographic representations with products of Student-t distributions,” in Advances in NIPS, vol. 15, pp. 1359–1366, 2003.
[13] A. Gelman, J. B. Carlin, H. S. Stern, and D. B. Rubin, Bayesian Data Analysis, 2nd ed. Chapman & Hall/CRC, 2004.
[14] S. Roth and M. J. Black, “Fields of experts: A framework for learning image priors,” in CVPR, vol. 2, pp. 860–867, 2005.
[15] D. R. Brillinger, “The identification of point process systems,” The Annals of Probability, vol. 3, pp. 909–929, 1975.
[16] E. S. Chornoboy, L. P. Schramm, and A. F. Karr, “Maximum likelihood identification of neuronal point process systems,” Biological Cybernetics, vol. 59, pp. 265–275, 1988.
[17] Y. Gao, M. J. Black, E. Bienenstock, W. Wu, and J. P. Donoghue, “A quantitative comparison of linear and non-linear models of motor cortical activity for the encoding and decoding of arm motions,” in First International IEEE/EMBS Conference on Neural Engineering, pp. 189–192, 2003.
[18] M. Okatan, “Maximum likelihood identification of neuronal point process systems,” Biological Cybernetics, vol. 59, pp. 265–275, 1988.
[19] W. Truccolo, U. T. Eden, M. R. Fellows, J. P. Donoghue, and E. N. Brown, “A point process framework for relating neural spiking activity to spiking history,” J. Neurophysiology, vol. 93, pp. 1074–1089, 2005.
[20] P. E. Latham and S. Nirenberg, “Synergy, redundancy, and independence in population codes, revisited,” J. Neuroscience, vol. 25, pp. 5195–5206, 2005.
[21] S. Nirenberg and P. E. Latham, “Decoding neuronal spike trains: How important are correlations?” PNAS, vol. 100, pp. 7348–7353, 2003.
[22] S. Panzeri, H. D. R. Golledge, F. Zheng, M. Tovee, and M. P. Young, “Objective assessment of the functional role of spike train correlations using information measures,” Visual Cognition, vol. 8, pp. 531–547, 2001.