nips nips2006 nips2006-16 nips2006-16-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Eizaburo Doi, Michael S. Lewicki
Abstract: Efficient coding models predict that the optimal code for natural images is a population of oriented Gabor receptive fields. These results match response properties of neurons in primary visual cortex, but not those in the retina. Does the retina use an optimal code, and if so, what is it optimized for? Previous theories of retinal coding have assumed that the goal is to encode the maximal amount of information about the sensory signal. However, the image sampled by retinal photoreceptors is degraded both by the optics of the eye and by the photoreceptor noise. Therefore, de-blurring and de-noising of the retinal signal should be important aspects of retinal coding. Furthermore, the ideal retinal code should be robust to neural noise and make optimal use of all available neurons. Here we present a theoretical framework to derive codes that simultaneously satisfy all of these desiderata. When optimized for natural images, the model yields filters that show strong similarities to retinal ganglion cell (RGC) receptive fields. Importantly, the characteristics of receptive fields vary with retinal eccentricities where the optical blur and the number of RGCs are significantly different. The proposed model provides a unified account of retinal coding, and more generally, it may be viewed as an extension of the Wiener filter with an arbitrary number of noisy units. 1
[1] R. W. Rodieck. The First Steps in Seeing. Sinauer, MA, 1998.
[2] E. Doi, D. C. Balcan, and M. S. Lewicki. A theoretical analysis of robust coding over noisy overcomplete channels. In Advances in Neural Information Processing Systems, volume 18. MIT Press, 2006.
[3] R. Navarro, P. Artal, and D. R. Williams. Modulation transfer of the human eye as a function of retinal eccentricity. Journal of Optical Society of America A, 10:201–212, 1993.
[4] M. V. Srinivasan, S. B. Laughlin, and A. Dubs. Predictive coding: a fresh view of inhibition in the retina. Proc. R. Soc. Lond. B, 216:427–459, 1982.
[5] R. C. Gonzalez and R. E. Woods. Digital image processing. Prentice Hall, 2nd edition, 2002.
[6] J. J. Atick and A. N. Redlich. Towards a theory of early visual processing. Neural Computation, 2:308– 320, 1990.
[7] J. H. van Hateren. Theoretical predictions of spatiotemporal receptive fields of fly LMCs, and experimental validation. J. Comp. Physiol. A, 171:157–170, 1992.
[8] D. L. Ruderman. Designing receptive fields for highest fidelity. Network, 5:147–155, 1994.
[9] D. J. Field. Relations between the statistics of natural images and the response properties of cortical cells. J. Opt. Soc. Am. A, 4:2379–2394, 1987.
[10] R. M. Gray. Toeplitz and circulant matrices: A review. Foundations and Trends in Communications and Information Theory, 2:155–239, 2006.
[11] E. Doi, T. Inui, T.-W. Lee, T. Wachtler, and T. J. Sejnowski. Spatiochromatic receptive field properties derived from information-theoretic analyses of cone mosaic responses to natural scenes. Neural Computation, 15:397–417, 2003.
[12] E. S. Frechette, A. Sher, M. I. Grivich, D. Petrusca, A. M. Litke, and E. J. Chichilnisky. Fidelity of the ensemble code for visual motion in primate retina. Journal of Neurophysiology, 94:119–135, 2005.
[13] C. A. Curcio and K. A. Allen. Topography of ganglion cells in human retina. Journal of Comparative Neurology, 300:5–25, 1990.
[14] A. Borst and F. E. Theunissen. Information theory and neural coding. Nature Neuroscience, 2:947–957, 1999.
[15] E. Doi and M. S. Lewicki. Sparse coding of natural images using an overcomplete set of limited capacity units. In Advances in Neural Information Processing Systems, volume 17. MIT Press, 2005.
[16] B. T. Vincent and R. J. Baddeley. Synaptic energy efficiency in retinal processing. Vision Research, 43:1283–1290, 2003.
[17] R. L. De Valois, H. Morgan, and D. M. Snodderly. Psychophysical studies of monkey vision - III. Spatial luminance contrast sensitivity test of macaque and human observers. Vision Research, 14:75–81, 1974.