nips nips2002 nips2002-180 knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Luk Chong Yeung, Brian S. Blais, Leon N. Cooper, Harel Z. Shouval
Abstract: A unified, biophysically motivated Calcium-Dependent Learning model has been shown to account for various rate-based and spike time-dependent paradigms for inducing synaptic plasticity. Here, we investigate the properties of this model for a multi-synapse neuron that receives inputs with different spike-train statistics. In addition, we present a physiological form of metaplasticity, an activity-driven regulation mechanism, that is essential for the robustness of the model. A neuron thus implemented develops stable and selective receptive fields, given various input statistics 1
Reference: text
sentIndex sentText sentNum sentScore
1 edu Abstract A unified, biophysically motivated Calcium-Dependent Learning model has been shown to account for various rate-based and spike time-dependent paradigms for inducing synaptic plasticity. [sent-8, score-0.301]
2 Here, we investigate the properties of this model for a multi-synapse neuron that receives inputs with different spike-train statistics. [sent-9, score-0.102]
3 In addition, we present a physiological form of metaplasticity, an activity-driven regulation mechanism, that is essential for the robustness of the model. [sent-10, score-0.117]
4 Activation of NMDA receptors is also essential for functional plasticity in vivo [5]. [sent-12, score-0.315]
5 An influential hypothesis holds that modest elevations of Ca above the basal line would induce LTD, while higher elevations would induce LTP[6, 7]. [sent-13, score-0.076]
6 In this model, cellular activity is translated locally into the dendritic calcium concentrations Cai , through the voltage and time-dependence of the NMDA channels. [sent-16, score-0.445]
7 The level of Cai determines the sign and magnitude of synaptic plasticity as determined through a function of local calcium Ω(Cai )(see Methods). [sent-17, score-0.614]
8 Implementation of this simple yet biophysical model has shown that it is sufficient to account for the outcome of different induction protocols of synaptic plasticity in a one-dimensional input space, as illustrated in Figure 1. [sent-19, score-0.45]
9 In the pairing protocol, LTD occurs when LFS is paired with a small depolarization of the postsynaptic voltage while a larger depolarization yields LTP (Figure 1a), due to the voltage-dependence of the NMDA currents. [sent-20, score-0.379]
10 In the rate-based protocol, low-frequency stimulation (LFS) gives rise to LTD while high-frequency stimulation (HFS) produces LTP (Figure 1b), due to the time-integration dynamics of the calcium transients. [sent-21, score-0.226]
11 Finally, STDP gives LTD if a post-spike comes before a pre-spike within a time-window, and LTP if a post-spike comes after a pre-spike (Figure 1c); this is due to the coincidencedetector property of the NMDA receptors and the shape of the BPAP. [sent-22, score-0.12]
12 The Pairing Protocol was simulated with a fixed input rate of 3 Hz; STDP curve is shown for 1 Hz. [sent-26, score-0.123]
13 In this study we investigate characteristics of the Calcium Control Hypothesis such as cooperativity and competition, and examine how they give rise to input selectivity. [sent-28, score-0.137]
14 A neuron is called selective to a specific input pattern if it responds strongly to it and not to other patterns, which is equivalent to having a potentiated pathway to this pattern. [sent-29, score-0.313]
15 Input selectivity is a general feature of neurons and underlies the formation of receptive fields and topographic mappings. [sent-30, score-0.327]
16 We demonstrate that using the UCM alone, selectivity can arise, but only within a narrow range of parameters. [sent-31, score-0.196]
17 Metaplasticity, the activity-dependent modulation of synaptic plasticity, is essential for robustness of the BCM model [11]. [sent-32, score-0.261]
18 2 Selectivity to Spike Train Correlations The development of neuronal selectivity, given any learning rule, depends on the statistical structures of the input environment. [sent-36, score-0.109]
19 One method of examining this feature is to generate input spike trains with different statistics across synapses. [sent-38, score-0.136]
20 We use a simple scenario in which half of the synapses (group B) receive noisy Poisson spike trains with a mean rate rin , and the other half (group A), receive correlated spikes with the same rate rin . [sent-39, score-0.742]
21 One might expect that, by firing together, group A will gain control of the post-synaptic firing times and thus be potentiated, while group B will be depressed, in a manner similar to the STDP described by Song et al. [sent-41, score-0.124]
22 In addition to the 100 excitatory neurons our neuron receives 20 inhibitory inputs. [sent-43, score-0.235]
23 There exists a range of input frequencies (Figure 2a, left) at which segregation occurs between the correlated and uncorrelated groups. [sent-45, score-0.276]
24 The cooperativity among the synapses in group A enhances its probability of generating a post-spike, which, through the BPAP causes strong depolarization. [sent-46, score-0.313]
25 Since the NMDA channels are still open due to a recent pre-spike, this is likely to potentiates these synapses in a Hebbian-associative fashion. [sent-47, score-0.243]
26 Group B will fire with equal probability before and after a post-spike which, given a sufficiently low NMDA receptor conductance, ensures that, on average, depression takes place. [sent-48, score-0.113]
27 At the final state, the output spike train is irregular (Figure 2a, right) but its rate is stable (Figure 2a, center), indicating that the system had reached a fixed point with a balance between excitation and inhibition. [sent-49, score-0.135]
28 5 0 0 5 10 5 Time (ms x 10 ) 10 2 CV Average weight 1 Output rate (Hz) a) 5 0 0 10 5 5 Time (ms x 10 ) 1 0 10 5 5 Time (ms x 10 ) b) 8 Hz 0. [sent-51, score-0.113]
29 5 0 0 1 2 Time (ms x 10 5 ) 1 Average weight Average weight 1 12 Hz 0. [sent-52, score-0.104]
30 5 0 0 1 2 Time (ms x 10 5 ) Figure 2: Segregation of the synapses for different input structures. [sent-53, score-0.238]
31 Left, time evolutions of the average synaptic weight for the groups A (solid) and B (dashed). [sent-55, score-0.314]
32 In fact, a slight change in the value of rin disrupts the segregation described previously (Figure 2b). [sent-61, score-0.306]
33 For too high or too low values of rin , both channels are potentiated and depressed, respectively. [sent-62, score-0.312]
34 3 Metaplasticity In the BCM theory the threshold between LTD and LTP moves as a function of the history of postsynaptic activity [11]. [sent-65, score-0.168]
35 This type of activity-dependent regulation of the properties of synaptic plasticity, or metaplasticity, was developed to ensure selectivity and stability. [sent-66, score-0.466]
36 Experimental results have linked some forms of metaplasticity to the magnitude of the NMDA conductance; it is shown that as the cellular activity increases, NMDA conductance is down-regulated, and vice-versa [15, 16, 13, 17]. [sent-67, score-0.493]
37 Under the Calcium Control Hypothesis, this sets the ground for a more physiological formulation of metaplasticity [18]. [sent-68, score-0.343]
38 NMDA conductance is interpreted here as the total number (gm ) of NMDA channels inserted in the membrane of the postsynaptic terminal. [sent-69, score-0.238]
39 Consider a simple kinetic model in which additional channels can be inserted from an intracellular pool (gi ) or removed and returned to the pool in an activity dependent manner. [sent-70, score-0.133]
40 The fixed point is: gt ∗ gm = (1) k– /(k+ V α ) + 1 If, in this model, cellular activity is translated into Ca, then gm can be loosely interpreted as the inverse of the BCM sliding threshold θm [18]. [sent-72, score-0.717]
41 Notice that in the original form of BCM, θm is the time average of a non-linear function of the postsynaptic the activity level. [sent-73, score-0.203]
42 In order to achieve competition, gm should not depend solely on local (synaptic) variables, but should rather detect changes of the global patterns of cellular activity. [sent-74, score-0.322]
43 Here, the activity-signaling global variable is taken to be postsynaptic membrane potential. [sent-75, score-0.102]
44 Implementation of metaplasticity widens significantly the range of input frequencies for which segregation between the weights of correlated and uncorrelated synapses is observed; this is shown in Figure 3a. [sent-76, score-0.755]
45 At low spiking activity, the subthreshold depolarization levels prevent significant inward Ca currents. [sent-77, score-0.113]
46 Persistent post-spike generation will lead gm and therefore Ca to decrease, hence scaling the synaptic weights downwards. [sent-79, score-0.45]
47 Competition arises as the system searches for the balance between the selective positive feed-back of a standard Hebbian rule and the overall negative feed-back of a sliding threshold mechanism. [sent-80, score-0.089]
48 However, consistent with the rate-based protocol described before, at too low and too high rin selectivity is disrupted, and the synapses will eventually all depress or potentiate, regardless of the statistical structures of the stimulus. [sent-81, score-0.592]
49 Strengthening the correlation increases segregation (Figure 3b), demonstrating the effects of lateral cooperativity in potentiation. [sent-82, score-0.223]
50 On the other hand, increasing the fraction of correlated inputs weakens the final weight of the correlated group (Figure 3c), suggesting that less potentiation is needed to control the output spike-timing. [sent-83, score-0.284]
51 5 Correlation parameter 0 100 50 % of correlated inputs Figure 3: The effects of metaplasticity. [sent-86, score-0.068]
52 (a) The weights segregate within the range of input frequency = [5, 35] Hz in a half correlated (solid), half uncorrelated (dashed) input environment; shown are the average final weights within each group, correlation parameter c = 0. [sent-87, score-0.297]
53 (b) The average final weight as a function of the correlation parameter, rin = 10 Hz. [sent-89, score-0.274]
54 (c) The average final weight as a function of the fraction of correlated inputs, rin = 10 Hz, c = 0. [sent-90, score-0.306]
55 4 Selectivity to patterns of rate distribution An alternative input environment is one in which the rates vary across the synapses and over time. [sent-92, score-0.343]
56 Since the mean switching time is constant and much smaller than the time constant of learning, each synapse receives the same average input over time. [sent-97, score-0.155]
57 However, we observe that, after training, the neuron spontaneously breaks the symmetry, as a subset of synapses becomes potentiated, while others are depressed (Figure 4b). [sent-98, score-0.347]
58 The final state of the neuron is one that is selective to the last pattern ( a), left most). [sent-103, score-0.157]
59 5 Discussion Neurons in many cortical areas develop receptive fields that are selective to a small subset of stimulating inputs. [sent-104, score-0.101]
60 It is likely, therefore, that receptive field formation relies on the same type of NMDA-dependent synaptic plasticity observed in vitro [1, 2, 4]. [sent-106, score-0.471]
61 Previous work has shown that these in vitro rate and spike time-induced plasticity can be accounted for by the biologicallyinspired Unified Calcium Model. [sent-107, score-0.296]
62 Metaplasticity adds robustness to the system and reinforces temporal competition between input patterns [11] , by controlled scaling of NMDAR currents. [sent-109, score-0.17]
63 We have shown here that even in simple input environments there is segregation among the synaptic strengths, depending on the temporal input statistics of different channels. [sent-110, score-0.463]
64 Because the UCM is responsive to input rates, in addition to spike-timing, we are able to achieve selectivity for rate-distribution patterns in spiking neurons that is comparable to the selectivity obtained in simplified, continuous-valued systems [23]. [sent-112, score-0.584]
65 This result suggests that the coexistence and complementarity of rate- and spike time-dependent plasticities, previously demonstrated for a one-dimensional neuron [8], can also be extended to multi-dimensional input environments. [sent-113, score-0.238]
66 We are currently investigating the formation of receptive fields in more realistic environments, such as natural stimuli and examining how the their statistical properties can be translated into a physiological mechanism for emergence of input selectivity. [sent-114, score-0.221]
67 6 Methods We simulate a single neuron with 20 non-plastic inhibitory synapses and 100 excitatory synapses undergoing the Calcium-Dependent learning rule: wi = η(Cai ) (Ω(Cai ) − λw) , ˙ (2) where wi is the synaptic weight of the synapse i, i = 1, . [sent-115, score-0.964]
68 5; additionally, wi is constrained within hard boundaries: wi ∈ [0, 1] for the cases where no metaplasticity is used. [sent-124, score-0.391]
69 The NMDA-mediated calcium concentration varies as: dCai Cai =I− , dt τCa (3) where I is the NMDA current and τCa = 20 ms is the passive decay time constant [24]. [sent-125, score-0.358]
70 I depends on the association between pre-spike times and postsynaptic depolarization level, described by I = gm f (t, tpre )H(V ) [7]. [sent-126, score-0.4]
71 70% of this value decays with time constant τf = 50 ms, the remaining N decays with time constant τs = 200 ms. [sent-131, score-0.106]
72 57 (4) with the reversal potential for calcium Vrev = 130 mV. [sent-134, score-0.226]
73 If a pre-spike arrives at the max excitatory [inhibitory] synapse i, Gex[in] (t) = Gex[in] (t − 1) + gex[in] gi ; otherwise, Gex and Gin decay exponentially with time constant τ = 5 ms. [sent-136, score-0.145]
74 For excitatory and inhibitory synapses, (gi , g max ) = (wi , 0. [sent-137, score-0.085]
75 75% of this value decays rapidly (τf = 3 ms) and the B remaining decays slowly (τs = 35 ms) [25]. [sent-141, score-0.106]
76 The voltage at the synaptic site is thus given by the sum V = Vm +BPAP. [sent-142, score-0.289]
77 For simulations involving different rates, the 100 synapses were first divided into 4 channels of 25 synapses. [sent-147, score-0.243]
78 At each epoch, one of the channels was randomly chosen and assigned a mean rate r ∗ , while others receive spike-trains with mean rate r < r∗ . [sent-149, score-0.189]
79 For metaplasticity in Equation 1, we use the parameters: k– /(k+ ) = 9. [sent-150, score-0.303]
80 A synaptic model of memory; long-term potentiation the hippocampus. [sent-162, score-0.261]
81 Homosynaptic long-term depression in area CA1 of hippocampus and the effects on NMDA receptor blockade. [sent-169, score-0.113]
82 Regulation of synaptic efficacy u by coincidence of postsynaptic APs and EPSPs. [sent-180, score-0.329]
83 Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type. [sent-185, score-0.403]
84 Blockade of NMDA receptors disrupts experience-dependent plasticity of kitten striate cortex. [sent-194, score-0.324]
85 A physiological basis for a theory of synapse modification. [sent-202, score-0.098]
86 A unified theory of nmda receptordependent bidirectional synaptic plasticity. [sent-219, score-0.622]
87 Calcium stores regulate the polarity and input specificity of synaptic modification. [sent-232, score-0.289]
88 Rate, timing, and cooperativity o o jointly determine cortical synaptic plasticity. [sent-241, score-0.302]
89 Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. [sent-249, score-0.239]
90 Visual experience and deprivation bidirectionally modify the composition and function of NMDA receptors in visual cortex. [sent-270, score-0.219]
91 Activity dependent increase in NMDA receptor responses during development of visual cotex. [sent-284, score-0.178]
92 Rapid, experiencedependent expression of synaptic NMDA receptors in visual cortex in vivo. [sent-295, score-0.446]
93 Activity co-regulates quantal ampa and nmda currents at neocortical synapses. [sent-310, score-0.395]
94 Converging evidence for a simplified biophysical model of synaptic plasticity. [sent-322, score-0.227]
95 Early development of visual cortical cells in normal and e dark reared kittens: relationship between orientation selectivity and ocular dominance. [sent-329, score-0.333]
96 Development of orientation preference maps in ferret primary visual cortex. [sent-339, score-0.09]
97 Suppression of cortical nmda receptor function prevents development of orientation selectivity in the primary visual cortex. [sent-351, score-0.803]
98 The role of presynaptic activity in monocular deprivation: Comparison of homosynaptic and heterosynaptic mechanisms. [sent-361, score-0.109]
99 Synaptic plasticity in visual cortex: Comparison of theory with experiment. [sent-373, score-0.217]
100 A synaptically controlled, associative signal for hebbian plasticity in hippocampal neurons. [sent-389, score-0.199]
wordName wordTfidf (topN-words)
[('nmda', 0.395), ('metaplasticity', 0.303), ('synaptic', 0.227), ('calcium', 0.226), ('gm', 0.223), ('selectivity', 0.196), ('synapses', 0.176), ('plasticity', 0.161), ('rin', 0.151), ('shouval', 0.151), ('hz', 0.135), ('receptors', 0.12), ('cai', 0.113), ('segregation', 0.112), ('gex', 0.108), ('stdp', 0.103), ('neuron', 0.102), ('postsynaptic', 0.102), ('ms', 0.094), ('potentiated', 0.094), ('cooper', 0.094), ('ucm', 0.086), ('gt', 0.08), ('ltd', 0.08), ('ltp', 0.08), ('erent', 0.076), ('vm', 0.075), ('depolarization', 0.075), ('receptor', 0.075), ('cooperativity', 0.075), ('bcm', 0.075), ('spike', 0.074), ('conductance', 0.069), ('depressed', 0.069), ('protocol', 0.069), ('correlated', 0.068), ('di', 0.068), ('channels', 0.067), ('activity', 0.066), ('blais', 0.065), ('bpap', 0.065), ('pairing', 0.065), ('uni', 0.064), ('competition', 0.064), ('voltage', 0.062), ('input', 0.062), ('group', 0.062), ('rate', 0.061), ('brown', 0.059), ('synapse', 0.058), ('visual', 0.056), ('cellular', 0.055), ('selective', 0.055), ('decays', 0.053), ('weight', 0.052), ('yeung', 0.051), ('neurons', 0.048), ('bear', 0.048), ('isi', 0.048), ('development', 0.047), ('receptive', 0.046), ('gi', 0.046), ('providence', 0.045), ('wi', 0.044), ('patterns', 0.044), ('inhibitory', 0.044), ('deprivation', 0.043), ('disrupts', 0.043), ('experiencedependent', 0.043), ('gin', 0.043), ('harel', 0.043), ('homosynaptic', 0.043), ('leon', 0.043), ('philpot', 0.043), ('vex', 0.043), ('vrest', 0.043), ('vrev', 0.043), ('regulation', 0.043), ('excitatory', 0.041), ('ri', 0.041), ('ca', 0.041), ('physiological', 0.04), ('depression', 0.038), ('dt', 0.038), ('hebbian', 0.038), ('spiking', 0.038), ('lfs', 0.038), ('elevations', 0.038), ('formation', 0.037), ('correlation', 0.036), ('brain', 0.036), ('nal', 0.036), ('translated', 0.036), ('average', 0.035), ('sliding', 0.034), ('potentiation', 0.034), ('essential', 0.034), ('uncorrelated', 0.034), ('orientation', 0.034), ('elds', 0.033)]
simIndex simValue paperId paperTitle
same-paper 1 1.0000001 180 nips-2002-Selectivity and Metaplasticity in a Unified Calcium-Dependent Model
Author: Luk Chong Yeung, Brian S. Blais, Leon N. Cooper, Harel Z. Shouval
Abstract: A unified, biophysically motivated Calcium-Dependent Learning model has been shown to account for various rate-based and spike time-dependent paradigms for inducing synaptic plasticity. Here, we investigate the properties of this model for a multi-synapse neuron that receives inputs with different spike-train statistics. In addition, we present a physiological form of metaplasticity, an activity-driven regulation mechanism, that is essential for the robustness of the model. A neuron thus implemented develops stable and selective receptive fields, given various input statistics 1
2 0.23200184 102 nips-2002-Hidden Markov Model of Cortical Synaptic Plasticity: Derivation of the Learning Rule
Author: Michael Eisele, Kenneth D. Miller
Abstract: Cortical synaptic plasticity depends on the relative timing of pre- and postsynaptic spikes and also on the temporal pattern of presynaptic spikes and of postsynaptic spikes. We study the hypothesis that cortical synaptic plasticity does not associate individual spikes, but rather whole firing episodes, and depends only on when these episodes start and how long they last, but as little as possible on the timing of individual spikes. Here we present the mathematical background for such a study. Standard methods from hidden Markov models are used to define what “firing episodes” are. Estimating the probability of being in such an episode requires not only the knowledge of past spikes, but also of future spikes. We show how to construct a causal learning rule, which depends only on past spikes, but associates pre- and postsynaptic firing episodes as if it also knew future spikes. We also show that this learning rule agrees with some features of synaptic plasticity in superficial layers of rat visual cortex (Froemke and Dan, Nature 416:433, 2002).
3 0.22612903 50 nips-2002-Circuit Model of Short-Term Synaptic Dynamics
Author: Shih-Chii Liu, Malte Boegershausen, Pascal Suter
Abstract: We describe a model of short-term synaptic depression that is derived from a silicon circuit implementation. The dynamics of this circuit model are similar to the dynamics of some present theoretical models of shortterm depression except that the recovery dynamics of the variable describing the depression is nonlinear and it also depends on the presynaptic frequency. The equations describing the steady-state and transient responses of this synaptic model fit the experimental results obtained from a fabricated silicon network consisting of leaky integrate-and-fire neurons and different types of synapses. We also show experimental data demonstrating the possible computational roles of depression. One possible role of a depressing synapse is that the input can quickly bring the neuron up to threshold when the membrane potential is close to the resting potential.
4 0.21911564 154 nips-2002-Neuromorphic Bisable VLSI Synapses with Spike-Timing-Dependent Plasticity
Author: Giacomo Indiveri
Abstract: We present analog neuromorphic circuits for implementing bistable synapses with spike-timing-dependent plasticity (STDP) properties. In these types of synapses, the short-term dynamics of the synaptic efficacies are governed by the relative timing of the pre- and post-synaptic spikes, while on long time scales the efficacies tend asymptotically to either a potentiated state or to a depressed one. We fabricated a prototype VLSI chip containing a network of integrate and fire neurons interconnected via bistable STDP synapses. Test results from this chip demonstrate the synapse’s STDP learning properties, and its long-term bistable characteristics.
5 0.2134041 186 nips-2002-Spike Timing-Dependent Plasticity in the Address Domain
Author: R. J. Vogelstein, Francesco Tenore, Ralf Philipp, Miriam S. Adlerstein, David H. Goldberg, Gert Cauwenberghs
Abstract: Address-event representation (AER), originally proposed as a means to communicate sparse neural events between neuromorphic chips, has proven efficient in implementing large-scale networks with arbitrary, configurable synaptic connectivity. In this work, we further extend the functionality of AER to implement arbitrary, configurable synaptic plasticity in the address domain. As proof of concept, we implement a biologically inspired form of spike timing-dependent plasticity (STDP) based on relative timing of events in an AER framework. Experimental results from an analog VLSI integrate-and-fire network demonstrate address domain learning in a task that requires neurons to group correlated inputs.
6 0.16552554 76 nips-2002-Dynamical Constraints on Computing with Spike Timing in the Cortex
7 0.16179168 129 nips-2002-Learning in Spiking Neural Assemblies
8 0.15175124 71 nips-2002-Dopamine Induced Bistability Enhances Signal Processing in Spiny Neurons
9 0.13270867 11 nips-2002-A Model for Real-Time Computation in Generic Neural Microcircuits
10 0.1325663 171 nips-2002-Reconstructing Stimulus-Driven Neural Networks from Spike Times
11 0.10921318 184 nips-2002-Spectro-Temporal Receptive Fields of Subthreshold Responses in Auditory Cortex
12 0.095218837 43 nips-2002-Binary Coding in Auditory Cortex
13 0.087931499 66 nips-2002-Developing Topography and Ocular Dominance Using Two aVLSI Vision Sensors and a Neurotrophic Model of Plasticity
14 0.087769717 5 nips-2002-A Digital Antennal Lobe for Pattern Equalization: Analysis and Design
15 0.085273795 116 nips-2002-Interpreting Neural Response Variability as Monte Carlo Sampling of the Posterior
16 0.079822823 200 nips-2002-Topographic Map Formation by Silicon Growth Cones
17 0.076450713 177 nips-2002-Retinal Processing Emulation in a Programmable 2-Layer Analog Array Processor CMOS Chip
18 0.074806482 187 nips-2002-Spikernels: Embedding Spiking Neurons in Inner-Product Spaces
19 0.073400266 141 nips-2002-Maximally Informative Dimensions: Analyzing Neural Responses to Natural Signals
20 0.069896683 51 nips-2002-Classifying Patterns of Visual Motion - a Neuromorphic Approach
topicId topicWeight
[(0, -0.177), (1, 0.29), (2, 0.04), (3, -0.126), (4, 0.065), (5, 0.229), (6, 0.149), (7, -0.022), (8, 0.005), (9, -0.053), (10, 0.038), (11, -0.045), (12, -0.003), (13, 0.015), (14, 0.077), (15, -0.015), (16, -0.062), (17, -0.039), (18, -0.019), (19, 0.044), (20, -0.11), (21, -0.015), (22, 0.038), (23, -0.006), (24, 0.008), (25, -0.046), (26, 0.022), (27, 0.013), (28, -0.017), (29, -0.112), (30, 0.1), (31, 0.102), (32, 0.096), (33, -0.055), (34, -0.0), (35, -0.066), (36, 0.057), (37, -0.002), (38, 0.047), (39, -0.077), (40, 0.01), (41, 0.147), (42, 0.032), (43, 0.055), (44, -0.045), (45, -0.071), (46, 0.039), (47, 0.029), (48, -0.154), (49, -0.051)]
simIndex simValue paperId paperTitle
same-paper 1 0.95536232 180 nips-2002-Selectivity and Metaplasticity in a Unified Calcium-Dependent Model
Author: Luk Chong Yeung, Brian S. Blais, Leon N. Cooper, Harel Z. Shouval
Abstract: A unified, biophysically motivated Calcium-Dependent Learning model has been shown to account for various rate-based and spike time-dependent paradigms for inducing synaptic plasticity. Here, we investigate the properties of this model for a multi-synapse neuron that receives inputs with different spike-train statistics. In addition, we present a physiological form of metaplasticity, an activity-driven regulation mechanism, that is essential for the robustness of the model. A neuron thus implemented develops stable and selective receptive fields, given various input statistics 1
2 0.82489979 186 nips-2002-Spike Timing-Dependent Plasticity in the Address Domain
Author: R. J. Vogelstein, Francesco Tenore, Ralf Philipp, Miriam S. Adlerstein, David H. Goldberg, Gert Cauwenberghs
Abstract: Address-event representation (AER), originally proposed as a means to communicate sparse neural events between neuromorphic chips, has proven efficient in implementing large-scale networks with arbitrary, configurable synaptic connectivity. In this work, we further extend the functionality of AER to implement arbitrary, configurable synaptic plasticity in the address domain. As proof of concept, we implement a biologically inspired form of spike timing-dependent plasticity (STDP) based on relative timing of events in an AER framework. Experimental results from an analog VLSI integrate-and-fire network demonstrate address domain learning in a task that requires neurons to group correlated inputs.
3 0.78767383 154 nips-2002-Neuromorphic Bisable VLSI Synapses with Spike-Timing-Dependent Plasticity
Author: Giacomo Indiveri
Abstract: We present analog neuromorphic circuits for implementing bistable synapses with spike-timing-dependent plasticity (STDP) properties. In these types of synapses, the short-term dynamics of the synaptic efficacies are governed by the relative timing of the pre- and post-synaptic spikes, while on long time scales the efficacies tend asymptotically to either a potentiated state or to a depressed one. We fabricated a prototype VLSI chip containing a network of integrate and fire neurons interconnected via bistable STDP synapses. Test results from this chip demonstrate the synapse’s STDP learning properties, and its long-term bistable characteristics.
4 0.73665273 50 nips-2002-Circuit Model of Short-Term Synaptic Dynamics
Author: Shih-Chii Liu, Malte Boegershausen, Pascal Suter
Abstract: We describe a model of short-term synaptic depression that is derived from a silicon circuit implementation. The dynamics of this circuit model are similar to the dynamics of some present theoretical models of shortterm depression except that the recovery dynamics of the variable describing the depression is nonlinear and it also depends on the presynaptic frequency. The equations describing the steady-state and transient responses of this synaptic model fit the experimental results obtained from a fabricated silicon network consisting of leaky integrate-and-fire neurons and different types of synapses. We also show experimental data demonstrating the possible computational roles of depression. One possible role of a depressing synapse is that the input can quickly bring the neuron up to threshold when the membrane potential is close to the resting potential.
5 0.7036013 102 nips-2002-Hidden Markov Model of Cortical Synaptic Plasticity: Derivation of the Learning Rule
Author: Michael Eisele, Kenneth D. Miller
Abstract: Cortical synaptic plasticity depends on the relative timing of pre- and postsynaptic spikes and also on the temporal pattern of presynaptic spikes and of postsynaptic spikes. We study the hypothesis that cortical synaptic plasticity does not associate individual spikes, but rather whole firing episodes, and depends only on when these episodes start and how long they last, but as little as possible on the timing of individual spikes. Here we present the mathematical background for such a study. Standard methods from hidden Markov models are used to define what “firing episodes” are. Estimating the probability of being in such an episode requires not only the knowledge of past spikes, but also of future spikes. We show how to construct a causal learning rule, which depends only on past spikes, but associates pre- and postsynaptic firing episodes as if it also knew future spikes. We also show that this learning rule agrees with some features of synaptic plasticity in superficial layers of rat visual cortex (Froemke and Dan, Nature 416:433, 2002).
6 0.68798739 71 nips-2002-Dopamine Induced Bistability Enhances Signal Processing in Spiny Neurons
7 0.55708981 129 nips-2002-Learning in Spiking Neural Assemblies
8 0.52971303 200 nips-2002-Topographic Map Formation by Silicon Growth Cones
9 0.48789704 11 nips-2002-A Model for Real-Time Computation in Generic Neural Microcircuits
10 0.46596828 76 nips-2002-Dynamical Constraints on Computing with Spike Timing in the Cortex
11 0.41055539 171 nips-2002-Reconstructing Stimulus-Driven Neural Networks from Spike Times
12 0.40871894 66 nips-2002-Developing Topography and Ocular Dominance Using Two aVLSI Vision Sensors and a Neurotrophic Model of Plasticity
13 0.31713784 160 nips-2002-Optoelectronic Implementation of a FitzHugh-Nagumo Neural Model
14 0.31511897 128 nips-2002-Learning a Forward Model of a Reflex
15 0.31054953 81 nips-2002-Expected and Unexpected Uncertainty: ACh and NE in the Neocortex
16 0.30118811 43 nips-2002-Binary Coding in Auditory Cortex
17 0.29031268 177 nips-2002-Retinal Processing Emulation in a Programmable 2-Layer Analog Array Processor CMOS Chip
18 0.27969113 184 nips-2002-Spectro-Temporal Receptive Fields of Subthreshold Responses in Auditory Cortex
19 0.27182031 18 nips-2002-Adaptation and Unsupervised Learning
20 0.27070025 199 nips-2002-Timing and Partial Observability in the Dopamine System
topicId topicWeight
[(3, 0.024), (11, 0.02), (18, 0.309), (23, 0.051), (42, 0.034), (54, 0.059), (55, 0.033), (64, 0.021), (67, 0.048), (68, 0.056), (74, 0.067), (92, 0.025), (95, 0.035), (98, 0.139)]
simIndex simValue paperId paperTitle
same-paper 1 0.8110078 180 nips-2002-Selectivity and Metaplasticity in a Unified Calcium-Dependent Model
Author: Luk Chong Yeung, Brian S. Blais, Leon N. Cooper, Harel Z. Shouval
Abstract: A unified, biophysically motivated Calcium-Dependent Learning model has been shown to account for various rate-based and spike time-dependent paradigms for inducing synaptic plasticity. Here, we investigate the properties of this model for a multi-synapse neuron that receives inputs with different spike-train statistics. In addition, we present a physiological form of metaplasticity, an activity-driven regulation mechanism, that is essential for the robustness of the model. A neuron thus implemented develops stable and selective receptive fields, given various input statistics 1
2 0.5038327 102 nips-2002-Hidden Markov Model of Cortical Synaptic Plasticity: Derivation of the Learning Rule
Author: Michael Eisele, Kenneth D. Miller
Abstract: Cortical synaptic plasticity depends on the relative timing of pre- and postsynaptic spikes and also on the temporal pattern of presynaptic spikes and of postsynaptic spikes. We study the hypothesis that cortical synaptic plasticity does not associate individual spikes, but rather whole firing episodes, and depends only on when these episodes start and how long they last, but as little as possible on the timing of individual spikes. Here we present the mathematical background for such a study. Standard methods from hidden Markov models are used to define what “firing episodes” are. Estimating the probability of being in such an episode requires not only the knowledge of past spikes, but also of future spikes. We show how to construct a causal learning rule, which depends only on past spikes, but associates pre- and postsynaptic firing episodes as if it also knew future spikes. We also show that this learning rule agrees with some features of synaptic plasticity in superficial layers of rat visual cortex (Froemke and Dan, Nature 416:433, 2002).
3 0.49775481 43 nips-2002-Binary Coding in Auditory Cortex
Author: Michael R. Deweese, Anthony M. Zador
Abstract: Cortical neurons have been reported to use both rate and temporal codes. Here we describe a novel mode in which each neuron generates exactly 0 or 1 action potentials, but not more, in response to a stimulus. We used cell-attached recording, which ensured single-unit isolation, to record responses in rat auditory cortex to brief tone pips. Surprisingly, the majority of neurons exhibited binary behavior with few multi-spike responses; several dramatic examples consisted of exactly one spike on 100% of trials, with no trial-to-trial variability in spike count. Many neurons were tuned to stimulus frequency. Since individual trials yielded at most one spike for most neurons, the information about stimulus frequency was encoded in the population, and would not have been accessible to later stages of processing that only had access to the activity of a single unit. These binary units allow a more efficient population code than is possible with conventional rate coding units, and are consistent with a model of cortical processing in which synchronous packets of spikes propagate stably from one neuronal population to the next. 1 Binary coding in auditory cortex We recorded responses of neurons in the auditory cortex of anesthetized rats to pure-tone pips of different frequencies [1, 2]. Each pip was presented repeatedly, allowing us to assess the variability of the neural response to multiple presentations of each stimulus. We first recorded multi-unit activity with conventional tungsten electrodes (Fig. 1a). The number of spikes in response to each pip fluctuated markedly from one trial to the next (Fig. 1e), as though governed by a random mechanism such as that generating the ticks of a Geiger counter. Highly variable responses such as these, which are at least as variable as a Poisson process, are the norm in the cortex [3-7], and have contributed to the widely held view that cortical spike trains are so noisy that only the average firing rate can be used to encode stimuli. Because we were recording the activity of an unknown number of neurons, we could not be sure whether the strong trial-to-trial fluctuations reflected the underlying variability of the single units. We therefore used an alternative technique, cell- a b Single-unit recording method 5mV Multi-unit 1sec Raw cellattached voltage 10 kHz c Single-unit . . . . .. .. ... . . .... . ... . Identified spikes Threshold e 28 kHz d Single-unit 80 120 160 200 Time (msec) N = 29 tones 3 2 1 Poisson N = 11 tones ry 40 4 na bi 38 kHz 0 Response variance/mean (spikes/trial) High-pass filtered 0 0 1 2 3 Mean response (spikes/trial) Figure 1: Multi-unit spiking activity was highly variable, but single units obeyed binomial statistics. a Multi-unit spike rasters from a conventional tungsten electrode recording showed high trial-to-trial variability in response to ten repetitions of the same 50 msec pure tone stimulus (bottom). Darker hash marks indicate spike times within the response period, which were used in the variability analysis. b Spikes recorded in cell-attached mode were easily identified from the raw voltage trace (top) by applying a high-pass filter (bottom) and thresholding (dark gray line). Spike times (black squares) were assigned to the peaks of suprathreshold segments. c Spike rasters from a cell-attached recording of single-unit responses to 25 repetitions of the same tone consisted of exactly one well-timed spike per trial (latency standard deviation = 1.0 msec), unlike the multi-unit responses (Fig. 1a). Under the Poisson assumption, this would have been highly unlikely (P ~ 10 -11). d The same neuron as in Fig. 1c responds with lower probability to repeated presentations of a different tone, but there are still no multi-spike responses. e We quantified response variability for each tone by dividing the variance in spike count by the mean spike count across all trials for that tone. Response variability for multi-unit tungsten recording (open triangles) was high for each of the 29 tones (out of 32) that elicited at least one spike on one trial. All but one point lie above one (horizontal gray line), which is the value produced by a Poisson process with any constant or time varying event rate. Single unit responses recorded in cell-attached mode were far less variable (filled circles). Ninety one percent (10/11) of the tones that elicited at least one spike from this neuron produced no multi-spike responses in 25 trials; the corresponding points fall on the diagonal line between (0,1) and (1,0), which provides a strict lower bound on the variability for any response set with a mean between 0 and 1. No point lies above one. attached recording with a patch pipette [8, 9], in order to ensure single unit isolation (Fig. 1b). This recording mode minimizes both of the main sources of error in spike detection: failure to detect a spike in the unit under observation (false negatives), and contamination by spikes from nearby neurons (false positives). It also differs from conventional extracellular recording methods in its selection bias: With cell- attached recording neurons are selected solely on the basis of the experimenter’s ability to form a seal, rather than on the basis of neuronal activity and responsiveness to stimuli as in conventional methods. Surprisingly, single unit responses were far more orderly than suggested by the multi-unit recordings; responses typically consisted of either 0 or 1 spikes per trial, and not more (Fig. 1c-e). In the most dramatic examples, each presentation of the same tone pip elicited exactly one spike (Fig. 1c). In most cases, however, some presentations failed to elicit a spike (Fig. 1d). Although low-variability responses have recently been observed in the cortex [10, 11] and elsewhere [12, 13], the binary behavior described here has not previously been reported for cortical neurons. a 1.4 N = 3055 response sets b 1.2 1 Poisson 28 kHz - 100 msec 0.8 0.6 0.4 0.2 0 0 ry na bi Response variance/mean (spikes/trial) The majority of the neurons (59%) in our study for which statistical significance could be assessed (at the p<0.001 significance level; see Fig. 2, caption) showed noisy binary behavior—“binary” because neurons produced either 0 or 1 spikes, and “noisy” because some stimuli elicited both single spikes and failures. In a substantial fraction of neurons, however, the responses showed more variability. We found no correlation between neuronal variability and cortical layer (inferred from the depth of the recording electrode), cortical area (inside vs. outside of area A1) or depth of anesthesia. Moreover, the binary mode of spiking was not due to the brevity (25 msec) of the stimuli; responses that were binary for short tones were comparably binary when longer (100 msec) tones were used (Fig. 2b). Not assessable Not significant Significant (p<0.001) 0.2 0.4 0.6 0.8 1 1.2 Mean response (spikes/trial) 28 kHz - 25 msec 1.4 0 40 80 120 160 Time (msec) 200 Figure 2: Half of the neuronal population exhibited binary firing behavior. a Of the 3055 sets of responses to 25 msec tones, 2588 (gray points) could not be assessed for significance at the p<0.001 level, 225 (open circles) were not significantly binary, and 242 were significantly binary (black points; see Identification methods for group statistics below). All points were jittered slightly so that overlying points could be seen in the figure. 2165 response sets contained no multi-spike responses; the corresponding points fell on the line from [0,1] to [1,0]. b The binary nature of single unit responses was insensitive to tone duration, even for frequencies that elicited the largest responses. Twenty additional spike rasters from the same neuron (and tone frequency) as in Fig. 1c contain no multi-spike responses whether in response to 100 msec tones (above) or 25 msec tones (below). Across the population, binary responses were as prevalent for 100 msec tones as for 25 msec tones (see Identification methods for group statistics). In many neurons, binary responses showed high temporal precision, with latencies sometimes exhibiting standard deviations as low as 1 msec (Fig. 3; see also Fig. 1c), comparable to previous observations in the auditory cortex [14], and only slightly more precise than in monkey visual area MT [5]. High temporal precision was positively correlated with high response probability (Fig. 3). a b N = (44 cells)x(32 tones) 14 N = 32 tones 12 30 Jitter (msec) Jitter (msec) 40 10 8 6 20 10 4 2 0 0 0 0.2 0.4 0.6 0.8 Mean response (spikes/trial) 1 0 0.4 0.8 1.2 1.6 Mean response (spikes/trial) 2 Figure 3: Trial-to-trial variability in latency of response to repeated presentations of the same tone decreased with increasing response probability. a Scatter plot of standard deviation of latency vs. mean response for 25 presentations each of 32 tones for a different neuron as in Figs. 1 and 2 (gray line is best linear fit). Rasters from 25 repeated presentations of a low response tone (upper left inset, which corresponds to left-most data point) display much more variable latencies than rasters from a high response tone (lower right inset; corresponds to right-most data point). b The negative correlation between latency variability and response size was present on average across the population of 44 neurons described in Identification methods for group statistics (linear fit, gray). The low trial-to-trial variability ruled out the possibility that the firing statistics could be accounted for by a simple rate-modulated Poisson process (Fig. 4a1,a2). In other systems, low variability has sometimes been modeled as a Poisson process followed by a post-spike refractory period [10, 12]. In our system, however, the range in latencies of evoked binary responses was often much greater than the refractory period, which could not have been longer than the 2 msec inter-spike intervals observed during epochs of spontaneous spiking, indicating that binary spiking did not result from any intrinsic property of the spike generating mechanism (Fig. 4a3). Moreover, a single stimulus-evoked spike could suppress subsequent spikes for as long as hundreds of milliseconds (e.g. Figs. 1d,4d), supporting the idea that binary spiking arises through a circuit-level, rather than a single-neuron, mechanism. Indeed, the fact that this suppression is observed even in the cortex of awake animals [15] suggests that binary spiking is not a special property of the anesthetized state. It seems surprising that binary spiking in the cortex has not previously been remarked upon. In the auditory cortex the explanation may be in part technical: Because firing rates in the auditory cortex tend to be low, multi-unit recording is often used to maximize the total amount of data collected. Moreover, our use of cell-attached recording minimizes the usual bias toward responsive or active neurons. Such explanations are not, however, likely to account for the failure to observe binary spiking in the visual cortex, where spike count statistics have been scrutinized more closely [3-7]. One possibility is that this reflects a fundamental difference between the auditory and visual systems. An alternative interpretation— a1 b Response probability 100 spikes/s 2 kHz Poisson simulation c 100 200 300 400 Time (msec) 500 20 Ratio of pool sizes a2 0 16 12 8 4 0 a3 Poisson with refractory period 0 40 80 120 160 200 Time (msec) d Response probability PSTH 0.2 0.4 0.6 0.8 1 Mean spike count per neuron 1 0.8 N = 32 tones 0.6 0.4 0.2 0 2.0 3.8 7.1 13.2 24.9 46.7 Tone frequency (kHz) Figure 4: a The lack of multi-spike responses elicited by the neuron shown in Fig. 3a were not due to an absolute refractory period since the range of latencies for many tones, like that shown here, was much greater than any reasonable estimate for the neuron’s refractory period. (a1) Experimentally recorded responses. (a2) Using the smoothed post stimulus time histogram (PSTH; bottom) from the set of responses in Fig. 4a, we generated rasters under the assumption of Poisson firing. In this representative example, four double-spike responses (arrows at left) were produced in 25 trials. (a3) We then generated rasters assuming that the neuron fired according to a Poisson process subject to a hard refractory period of 2 msec. Even with a refractory period, this representative example includes one triple- and three double-spike responses. The minimum interspike-interval during spontaneous firing events was less than two msec for five of our neurons, so 2 msec is a conservative upper bound for the refractory period. b. Spontaneous activity is reduced following high-probability responses. The PSTH (top; 0.25 msec bins) of the combined responses from the 25% (8/32) of tones that elicited the largest responses from the same neuron as in Figs. 3a and 4a illustrates a preclusion of spontaneous and evoked activity for over 200 msec following stimulation. The PSTHs from progressively less responsive groups of tones show progressively less preclusion following stimulation. c Fewer noisy binary neurons need to be pooled to achieve the same “signal-to-noise ratio” (SNR; see ref. [24]) as a collection of Poisson neurons. The ratio of the number of Poisson to binary neurons required to achieve the same SNR is plotted against the mean number of spikes elicited per neuron following stimulation; here we have defined the SNR to be the ratio of the mean spike count to the standard deviation of the spike count. d Spike probability tuning curve for the same neuron as in Figs. 1c-e and 2b fit to a Gaussian in tone frequency. and one that we favor—is that the difference rests not in the sensory modality, but instead in the difference between the stimuli used. In this view, the binary responses may not be limited to the auditory cortex; neurons in visual and other sensory cortices might exhibit similar responses to the appropriate stimuli. For example, the tone pips we used might be the auditory analog of a brief flash of light, rather than the oriented moving edges or gratings usually used to probe the primary visual cortex. Conversely, auditory stimuli analogous to edges or gratings [16, 17] may be more likely to elicit conventional, rate-modulated Poisson responses in the auditory cortex. Indeed, there may be a continuum between binary and Poisson modes. Thus, even in conventional rate-modulated responses, the first spike is often privileged in that it carries most of the information in the spike train [5, 14, 18]. The first spike may be particularly important as a means of rapidly signaling stimulus transients. Binary responses suggest a mode that complements conventional rate coding. In the simplest rate-coding model, a stimulus parameter (such as the frequency of a tone) governs only the rate at which a neuron generates spikes, but not the detailed positions of the spikes; the actual spike train itself is an instantiation of a random process (such as a Poisson process). By contrast, in the binomial model, the stimulus parameter (frequency) is encoded as the probability of firing (Fig. 4d). Binary coding has implications for cortical computation. In the rate coding model, stimulus encoding is “ergodic”: a stimulus parameter can be read out either by observing the activity of one neuron for a long time, or a population for a short time. By contrast, in the binary model the stimulus value can be decoded only by observing a neuronal population, so that there is no benefit to integrating over long time periods (cf. ref. [19]). One advantage of binary encoding is that it allows the population to signal quickly; the most compact message a neuron can send is one spike [20]. Binary coding is also more efficient in the context of population coding, as quantified by the signal-to-noise ratio (Fig. 4c). The precise organization of both spike number and time we have observed suggests that cortical activity consists, at least under some conditions, of packets of spikes synchronized across populations of neurons. Theoretical work [21-23] has shown how such packets can propagate stably from one population to the next, but only if neurons within each population fire at most one spike per packet; otherwise, the number of spikes per packet—and hence the width of each packet—grows at each propagation step. Interestingly, one prediction of stable propagation models is that spike probability should be related to timing precision, a prediction born out by our observations (Fig. 3). The role of these packets in computation remains an open question. 2 Identification methods for group statistics We recorded responses to 32 different 25 msec tones from each of 175 neurons from the auditory cortices of 16 Sprague-Dawley rats; each tone was repeated between 5 and 75 times (mean = 19). Thus our ensemble consisted of 32x175=5600 response sets, with between 5 and 75 samples in each set. Of these, 3055 response sets contained at least one spike on at least on trial. For each response set, we tested the hypothesis that the observed variability was significantly lower than expected from the null hypothesis of a Poisson process. The ability to assess significance depended on two parameters: the sample size (5-75) and the firing probability. Intuitively, the dependence on firing probability arises because at low firing rates most responses produce only trials with 0 or 1 spikes under both the Poisson and binary models; only at high firing rates do the two models make different predictions, since in that case the Poisson model includes many trials with 2 or even 3 spikes while the binary model generates only solitary spikes (see Fig. 4a1,a2). Using a stringent significance criterion of p<0.001, 467 response sets had a sufficient number of repeats to assess significance, given the observed firing probability. Of these, half (242/467=52%) were significantly less variable than expected by chance, five hundred-fold higher than the 467/1000=0.467 response sets expected, based on the 0.001 significance criterion, to yield a binary response set. Seventy-two neurons had at least one response set for which significance could be assessed, and of these, 49 neurons (49/72=68%) had at least one significantly sub-Poisson response set. Of this population of 49 neurons, five achieved low variability through repeatable bursty behavior (e.g., every spike count was either 0 or 3, but not 1 or 2) and were excluded from further analysis. The remaining 44 neurons formed the basis for the group statistics analyses shown in Figs. 2a and 3b. Nine of these neurons were subjected to an additional protocol consisting of at least 10 presentations each of 100 msec tones and 25 msec tones of all 32 frequencies. Of the 100 msec stimulation response sets, 44 were found to be significantly sub-Poisson at the p<0.05 level, in good agreement with the 43 found to be significant among the responses to 25 msec tones. 3 Bibliography 1. Kilgard, M.P. and M.M. Merzenich, Cortical map reorganization enabled by nucleus basalis activity. Science, 1998. 279(5357): p. 1714-8. 2. Sally, S.L. and J.B. Kelly, Organization of auditory cortex in the albino rat: sound frequency. J Neurophysiol, 1988. 59(5): p. 1627-38. 3. Softky, W.R. and C. Koch, The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs. J Neurosci, 1993. 13(1): p. 334-50. 4. Stevens, C.F. and A.M. Zador, Input synchrony and the irregular firing of cortical neurons. Nat Neurosci, 1998. 1(3): p. 210-7. 5. Buracas, G.T., A.M. Zador, M.R. DeWeese, and T.D. Albright, Efficient discrimination of temporal patterns by motion-sensitive neurons in primate visual cortex. Neuron, 1998. 20(5): p. 959-69. 6. Shadlen, M.N. and W.T. Newsome, The variable discharge of cortical neurons: implications for connectivity, computation, and information coding. J Neurosci, 1998. 18(10): p. 3870-96. 7. Tolhurst, D.J., J.A. Movshon, and A.F. Dean, The statistical reliability of signals in single neurons in cat and monkey visual cortex. Vision Res, 1983. 23(8): p. 775-85. 8. Otmakhov, N., A.M. Shirke, and R. Malinow, Measuring the impact of probabilistic transmission on neuronal output. Neuron, 1993. 10(6): p. 1101-11. 9. Friedrich, R.W. and G. Laurent, Dynamic optimization of odor representations by slow temporal patterning of mitral cell activity. Science, 2001. 291(5505): p. 889-94. 10. Kara, P., P. Reinagel, and R.C. Reid, Low response variability in simultaneously recorded retinal, thalamic, and cortical neurons. Neuron, 2000. 27(3): p. 635-46. 11. Gur, M., A. Beylin, and D.M. Snodderly, Response variability of neurons in primary visual cortex (V1) of alert monkeys. J Neurosci, 1997. 17(8): p. 2914-20. 12. Berry, M.J., D.K. Warland, and M. Meister, The structure and precision of retinal spike trains. Proc Natl Acad Sci U S A, 1997. 94(10): p. 5411-6. 13. de Ruyter van Steveninck, R.R., G.D. Lewen, S.P. Strong, R. Koberle, and W. Bialek, Reproducibility and variability in neural spike trains. Science, 1997. 275(5307): p. 1805-8. 14. Heil, P., Auditory cortical onset responses revisited. I. First-spike timing. J Neurophysiol, 1997. 77(5): p. 2616-41. 15. Lu, T., L. Liang, and X. Wang, Temporal and rate representations of timevarying signals in the auditory cortex of awake primates. Nat Neurosci, 2001. 4(11): p. 1131-8. 16. Kowalski, N., D.A. Depireux, and S.A. Shamma, Analysis of dynamic spectra in ferret primary auditory cortex. I. Characteristics of single-unit responses to moving ripple spectra. J Neurophysiol, 1996. 76(5): p. 350323. 17. deCharms, R.C., D.T. Blake, and M.M. Merzenich, Optimizing sound features for cortical neurons. Science, 1998. 280(5368): p. 1439-43. 18. Panzeri, S., R.S. Petersen, S.R. Schultz, M. Lebedev, and M.E. Diamond, The role of spike timing in the coding of stimulus location in rat somatosensory cortex. Neuron, 2001. 29(3): p. 769-77. 19. Britten, K.H., M.N. Shadlen, W.T. Newsome, and J.A. Movshon, The analysis of visual motion: a comparison of neuronal and psychophysical performance. J Neurosci, 1992. 12(12): p. 4745-65. 20. Delorme, A. and S.J. Thorpe, Face identification using one spike per neuron: resistance to image degradations. Neural Netw, 2001. 14(6-7): p. 795-803. 21. Diesmann, M., M.O. Gewaltig, and A. Aertsen, Stable propagation of synchronous spiking in cortical neural networks. Nature, 1999. 402(6761): p. 529-33. 22. Marsalek, P., C. Koch, and J. Maunsell, On the relationship between synaptic input and spike output jitter in individual neurons. Proc Natl Acad Sci U S A, 1997. 94(2): p. 735-40. 23. Kistler, W.M. and W. Gerstner, Stable propagation of activity pulses in populations of spiking neurons. Neural Comp., 2002. 14: p. 987-997. 24. Zohary, E., M.N. Shadlen, and W.T. Newsome, Correlated neuronal discharge rate and its implications for psychophysical performance. Nature, 1994. 370(6485): p. 140-3. 25. Abbott, L.F. and P. Dayan, The effect of correlated variability on the accuracy of a population code. Neural Comput, 1999. 11(1): p. 91-101.
4 0.48809445 50 nips-2002-Circuit Model of Short-Term Synaptic Dynamics
Author: Shih-Chii Liu, Malte Boegershausen, Pascal Suter
Abstract: We describe a model of short-term synaptic depression that is derived from a silicon circuit implementation. The dynamics of this circuit model are similar to the dynamics of some present theoretical models of shortterm depression except that the recovery dynamics of the variable describing the depression is nonlinear and it also depends on the presynaptic frequency. The equations describing the steady-state and transient responses of this synaptic model fit the experimental results obtained from a fabricated silicon network consisting of leaky integrate-and-fire neurons and different types of synapses. We also show experimental data demonstrating the possible computational roles of depression. One possible role of a depressing synapse is that the input can quickly bring the neuron up to threshold when the membrane potential is close to the resting potential.
5 0.48760438 148 nips-2002-Morton-Style Factorial Coding of Color in Primary Visual Cortex
Author: Javier R. Movellan, Thomas Wachtler, Thomas D. Albright, Terrence Sejnowski
Abstract: We introduce the notion of Morton-style factorial coding and illustrate how it may help understand information integration and perceptual coding in the brain. We show that by focusing on average responses one may miss the existence of factorial coding mechanisms that become only apparent when analyzing spike count histograms. We show evidence suggesting that the classical/non-classical receptive field organization in the cortex effectively enforces the development of Morton-style factorial codes. This may provide some cues to help understand perceptual coding in the brain and to develop new unsupervised learning algorithms. While methods like ICA (Bell & Sejnowski, 1997) develop independent codes, in Morton-style coding the goal is to make two or more external aspects of the world become independent when conditioning on internal representations. In this paper we introduce the notion of Morton-style factorial coding and illustrate how it may help analyze information integration and perceptual organization in the brain. In the neurosciences factorial codes are often studied in the context of mean tuning curves. A tuning curve is called separable if it can be expressed as the product of terms selectively influenced by different stimulus dimensions. Separable tuning curves are taken as evidence of factorial coding mechanisms. In this paper we show that by focusing on average responses one may miss the existence of factorial coding mechanisms that become only apparent when analyzing spike count histograms. Morton (1969) analyzed a wide variety of psychophysical experiments on word perception and showed that they could be explained using a model in which stimulus and context have separable effects on perception. More precisely, in Mortons’ model the joint effect of stimulus and context on a perceptual representation can be obtained by multiplying terms selectively controlled by stimulus and by context, i.e., £ © # #
6 0.4872328 184 nips-2002-Spectro-Temporal Receptive Fields of Subthreshold Responses in Auditory Cortex
7 0.4854736 199 nips-2002-Timing and Partial Observability in the Dopamine System
8 0.48101735 81 nips-2002-Expected and Unexpected Uncertainty: ACh and NE in the Neocortex
9 0.47951207 116 nips-2002-Interpreting Neural Response Variability as Monte Carlo Sampling of the Posterior
10 0.47817177 11 nips-2002-A Model for Real-Time Computation in Generic Neural Microcircuits
11 0.477898 44 nips-2002-Binary Tuning is Optimal for Neural Rate Coding with High Temporal Resolution
12 0.47773725 79 nips-2002-Evidence Optimization Techniques for Estimating Stimulus-Response Functions
13 0.47601467 5 nips-2002-A Digital Antennal Lobe for Pattern Equalization: Analysis and Design
14 0.47000232 41 nips-2002-Bayesian Monte Carlo
15 0.46951252 28 nips-2002-An Information Theoretic Approach to the Functional Classification of Neurons
16 0.46933728 141 nips-2002-Maximally Informative Dimensions: Analyzing Neural Responses to Natural Signals
17 0.46449238 92 nips-2002-FloatBoost Learning for Classification
18 0.4639827 73 nips-2002-Dynamic Bayesian Networks with Deterministic Latent Tables
19 0.46390718 110 nips-2002-Incremental Gaussian Processes
20 0.46196941 76 nips-2002-Dynamical Constraints on Computing with Spike Timing in the Cortex