nips nips2002 nips2002-18 nips2002-18-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Peter Dayan, Maneesh Sahani, Gregoire Deback
Abstract: Adaptation is a ubiquitous neural and psychological phenomenon, with a wealth of instantiations and implications. Although a basic form of plasticity, it has, bar some notable exceptions, attracted computational theory of only one main variety. In this paper, we study adaptation from the perspective of factor analysis, a paradigmatic technique of unsupervised learning. We use factor analysis to re-interpret a standard view of adaptation, and apply our new model to some recent data on adaptation in the domain of face discrimination.
[1] Abbott, LF, Varela, JA, Sen, K, & Nelson, SB (1997) Synaptic depression and cortical gain control. Science 275, 220-224.
[2] Atick, JJ (1992) Could information theory provide an ecological theory of sensory processing? Network: Computation in Neural Systems 3, 213-251.
[3] Atick, JJ, & Redlich, AN (1990) Towards a theory of early visual processing. Neural Computation 2, 308-320.
[4] Attneave, F (1954) Some informational aspects of visual perception. Psychological Review 61, 183-193.
[5] Barlow, HB (1961) Possible principles underlying the transformation of sensory messages. In WA Rosenblith, ed., Sensory Communication. Cambridge, MA: MIT Press.
[6] Barlow, HB (1969) Pattern recognition and the responses of sensory neurones.,Annals of the New York Academy of Sciences 156, 872-881.
[7] Barlow, HB (1989) Unsupervised learning, Neural Computation, 1, 295-311.
[8] Barlow, H (2001) Redundancy reduction revisited. Network 12,:241-253.
[9] Campbell, FW & Maffei, L (1971) The tilt after-effect: a fresh look. Vision Research 11, 833-40.
[10] Clifford, CWG, Wenderoth, P & Spehar, B. (2000) A functional angle on some after-effects in cortical vision, Proceedings of the Royal Society of London, Series B 267, 1705-1710.
[11] Davis, PJ (1979) Circulant Matrices. New York, NY: Wiley.
[12] Dayan, P & Abbott, LF (2001). Theoretical Neuroscience. Cambridge, MA: MIT Press.
[13] Diamond, ME, Huang, W & Ebner, FF (1994) Laminar comparison of somatosensory cortical plasticity. Science 265, 1885-1888.
[14] Dong, DW, & Atick, JJ (1995) Temporal decorrelation: A theory of lagged and nonlagged responses in the lateral geniculate nucleus. Network: Computation in Neural Systems 6, 159-178.
[15] Everitt, BS (1984) An Introduction to Latent Variable Models, London: Chapman and Hall.
[16] Gibson, JJ & Radner, M (1937) Adaptation, after-effect and contrast in the perception of tilted lines. Journal of Experimental Psychology 20, 453-467.
[17] Heeger, DJ (1992) Normalization of responses in cat striate cortex. Visual Neuroscience 9, 181-198.
[18] Hinton, GE, Dayan, P, Frey, BJ, & Neal, RM (1995) The wake-sleep algorithm for unsupervised neural networks. Science 268, 1158-1160.
[19] Hinton, GE & Sejnowski, TJ (1999) Unsupervised Learning. Cambridge, MA: MIT Press.
[20] Jolliffe, IT (1986) Principal Component Analysis, New York: Springer.
[21] J¨ reskog, KG (1967) Some contributions to maximum likelihood factor analysis, Psychometrika, 32, 443-482. o
[22] J¨ reskog, KG (1969) A general approach to confirmatory maximum likelihood factor analysis, Psychometrika, 34, o 183-202.
[23] Kohonen, T & Oja, E (1976) Fast adaptive formation of orthogonalizing filters and associative memory in recurrent networks of neuron-like elements. Biological Cybernetics 21, 85-95.
[24] Leopold, DA, O’Toole, AJ, Vetter, T & Blanz, V (2001). Prototype-referenced shape encoding revealed by high-level aftereffects. Nature Neuroscience 4, :89-94.
[25] Li, Z & Atick, JJ (1994a) Efficient stereo coding in the multiscale representation. Network: Computation in Neural Systems 5, 157-174.
[26] Linsker, R (1988) Self-organization in a perceptual network, Computer, 21, 105-128.
[27] Maguire G, Hamasaki DI (1994) The retinal dopamine network alters the adaptational properties of retinal ganglion cells in the cat.Journal of Neurophysiology, 72, 730-741.
[28] McCormick, DA (1990) Membrane properties and neurotransmitter actions. In GM Shepherd, ed., The Synaptic Organization of the Brain. New York: Oxford University Press.
[29] Neal, RM & Dayan, P (1997). Factor Analysis using delta-rule wake-sleep learning. Neural Computation, 9, 1781-1803.
[30] Neisser, U (1967) Cognitive Psychology. New York: Appleton-Century-Crofts.
[31] Olshausen, BA, & Field, DJ (1996) Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381, 607-609.
[32] Rao, RPN, & Ballard, DH (1997) Dynamic model of visual recognition predicts neural response properties in the visual cortex. Neural Computation 9, 721-763.
[33] Regan, D & Beverley, KI (1985) Postadaptation orientation discrimination. JOSA A, 2, 147-155.
[34] Roweis, S & Ghahramani, Z (1999) A unifying review of linear gaussian models. Neural Computation 11, 305-345.
[35] Rubin, DB & Thayer, DT (1982) EM algorithms for ML factor analysis, Psychometrika, 47, 69-76.
[36] Ruderman DL & Bialek W (1994) Statistics of natural images: Scaling in the woods. Physical Review Letters 73, 814-817.
[37] Schwartz, O & Simoncelli, EP (2001) Natural signal statistics and sensory gain control. Nature Neuroscience 4, 819-825.
[38] Shapley, R & Enroth-Cugell, C (1984) Visual adaptation and retinal gain control. Progress in Retinal Research 3, 263-346.
[39] Tipping, ME & Bishop, CM (1999) Mixtures of probabilistic principal component analyzers. Neural Computation 11, 443-482.
[40] van Hateren, JH (1992) A theory of maximizing sensory information. Biological Cybernetics 68, 23-29.
[41] Wainwright, MJ (1999) Visual adaptation as optimal information transmission. Vision Research 39, 3960-3974.
[42] Weiler R & Wagner HJ (1984) Light-dependent change of cone-horizontal cell interactions in carp retina. Brain Resesarch 298, 1-9.