nips nips2005 nips2005-29 knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Guido Nolte, Andreas Ziehe, Frank Meinecke, Klaus-Robert Müller
Abstract: When trying to understand the brain, it is of fundamental importance to analyse (e.g. from EEG/MEG measurements) what parts of the cortex interact with each other in order to infer more accurate models of brain activity. Common techniques like Blind Source Separation (BSS) can estimate brain sources and single out artifacts by using the underlying assumption of source signal independence. However, physiologically interesting brain sources typically interact, so BSS will—by construction— fail to characterize them properly. Noting that there are truly interacting sources and signals that only seemingly interact due to effects of volume conduction, this work aims to contribute by distinguishing these effects. For this a new BSS technique is proposed that uses anti-symmetrized cross-correlation matrices and subsequent diagonalization. The resulting decomposition consists of the truly interacting brain sources and suppresses any spurious interaction stemming from volume conduction. Our new concept of interacting source analysis (ISA) is successfully demonstrated on MEG data. 1
Reference: text
sentIndex sentText sentNum sentScore
1 de Abstract When trying to understand the brain, it is of fundamental importance to analyse (e. [sent-8, score-0.037]
2 from EEG/MEG measurements) what parts of the cortex interact with each other in order to infer more accurate models of brain activity. [sent-10, score-0.318]
3 Common techniques like Blind Source Separation (BSS) can estimate brain sources and single out artifacts by using the underlying assumption of source signal independence. [sent-11, score-0.603]
4 However, physiologically interesting brain sources typically interact, so BSS will—by construction— fail to characterize them properly. [sent-12, score-0.524]
5 Noting that there are truly interacting sources and signals that only seemingly interact due to effects of volume conduction, this work aims to contribute by distinguishing these effects. [sent-13, score-1.125]
6 For this a new BSS technique is proposed that uses anti-symmetrized cross-correlation matrices and subsequent diagonalization. [sent-14, score-0.158]
7 The resulting decomposition consists of the truly interacting brain sources and suppresses any spurious interaction stemming from volume conduction. [sent-15, score-1.317]
8 Our new concept of interacting source analysis (ISA) is successfully demonstrated on MEG data. [sent-16, score-0.599]
9 1 Introduction Interaction between brain sources, phase synchrony or coherent states of brain activity are believed to be fundamental for neural information processing (e. [sent-17, score-0.447]
10 So it is an important topic to devise new methods that can more reliably characterize interacting sources in the brain. [sent-20, score-0.779]
11 The macroscopic nature and the high temporal resolution of electroencephalography (EEG) and magnetoencephalography (MEG) in the millisecond range makes these measurement technologies ideal candidates to study brain interactions. [sent-21, score-0.278]
12 However, interpreting data from EEG/MEG channels in terms of connections between brain sources is largely hampered by artifacts of volume conduction, i. [sent-22, score-0.651]
13 the fact that activities of single sources are observable as superposition in all channels (with varying amplitude). [sent-24, score-0.435]
14 So ideally one would like to discard all—due to volume conduction—seemingly interacting signals and retain only truly linked brain source activity. [sent-25, score-0.956]
15 So far neither existing source separation methods nor typical phase synchronization anal- ysis (e. [sent-26, score-0.25]
16 [1, 5] and references therein) can adequately handle signals when the sources are both superimposed and interacting i. [sent-28, score-0.846]
17 It is here where we contribute in this paper by proposing a new algorithm to distinguish true from spurious interaction. [sent-32, score-0.157]
18 A prerequisite to achieve this goal was recently established by [4]: as a consequence of instantaneous and linear volume conduction, the cross-spectra of independent sources are real-valued, regardless of the specifics of the volume conductor, number of sources or source configuration. [sent-33, score-0.778]
19 Hence, a non-vanishing imaginary part of the cross-spectra must necessarily reflect a true interaction. [sent-34, score-0.237]
20 A recent different approach by [3] uses BSS as preprocessing step before phase synchronization is measured. [sent-36, score-0.112]
21 The drawback of this method is the assumption that there are not more sources than sensors, which is often heavily violated because, e. [sent-37, score-0.282]
22 , channel noise trivially consists of as many sources as channels, and, furthermore, brain noise can be very well modelled by assuming thousands of randomly distributed and independent dipoles. [sent-39, score-0.504]
23 To avoid the drawbacks of either method we will formulate an algorithm called interacting source analysis (ISA) which is technically based on BSS using second order statistics but is only sensitive to interacting sources and, thus, can be applied to systems with arbitrary noise structure. [sent-40, score-1.422]
24 In the next section, after giving a short introduction to BSS as used for this paper, we will derive some fundamental properties of our new method. [sent-41, score-0.037]
25 In section 3 we will show in simulated data and real MEG examples that the ISA procedure finds the interacting components and separates interacting subsystems which are independent of each other. [sent-42, score-1.29]
26 2 Theory The fundamental assumption of ICA is that a data matrix X, without loss of generality assumed to be zero mean, originates from a superposition of independent sources S such that X = AS (1) where A is called the mixing matrix which is assumed to be invertible. [sent-43, score-0.597]
27 The task is to find A and hence S (apart from meaningless ordering and scale transformations of the columns of A and the rows of S) by merely exploiting statistical independence of the sources. [sent-44, score-0.099]
28 Since independence implies that the sources are uncorrelated we may choose W , the estimated inverse mixing matrix, such that the covariance matrix of ˆ S ≡ WX (2) is equal to the identity matrix. [sent-45, score-0.466]
29 This, however, does not uniquely determine W because for any such W also U W , where U is an arbitrary orthogonal matrix, leads to a unit covariance ˆ matrix of S. [sent-46, score-0.067]
30 Uniqueness can be restored if we require that W not only diagonalizes the covariance matrix but also cross-correlation matrices for various delays τ , i. [sent-47, score-0.268]
31 In doing so we exploit that neuronal interactions necessarily take some time which is well above the typical time resolution of EEG/MEG measurements. [sent-57, score-0.07]
32 It is now our goal to identify one or many interacting systems from a suitable spatial transformation which corresponds to a demixing of the systems rather than individual sources. [sent-58, score-0.837]
33 Although we concentrate on those components which explicitly violate the independence assumption we will use the technique of simultaneous diagonalization to achieve this goal. [sent-59, score-0.263]
34 We first note that a diagonalization of D(τ ) using a real-valued W is meaningless since with D(τ ) also W D(τ )W † is anti-symmetric and always has vanishing diagonal elements. [sent-60, score-0.309]
35 Hence D(τ ) can only be diagonalized with a complex-valued W with subsequent interpretation of it in terms of a real-valued transformation. [sent-61, score-0.161]
36 We will here discuss the case where all interacting systems consist of pairs of neuronal sources. [sent-62, score-0.497]
37 Properties of systems with more than two interacting systems will be discussed below. [sent-63, score-0.497]
38 Then a realvalued spatial transformation W1 exists such that the set of D(τ ) becomes decomposed into K = N/2 blocks of size 2 × 2 0 1 0 0 α1 (τ ) −1 0 † . [sent-65, score-0.088]
39 0 0 0 1 0 0 αK (τ ) −1 0 Each block can be diagonalized e. [sent-68, score-0.142]
40 with ˜ W2 = and with 1 −i 1 i ˜ W2 = idK×K ⊗ W2 (9) (10) we get † † W2 W1 D(τ )W1 W2 = diag (11) From a simultaneous diagonalization of D(τ ) we obtain an estimate of the demixing matrix −1 ˆ W of the true demixing matrix W = W2 W1 . [sent-70, score-0.899]
41 We are interested in the columns of W1 which correspond to the spatial patterns of the interacting sources. [sent-71, score-0.638]
42 Let us denote the N × 2 submatrix of a matrix B consisting of the (2k − 1). [sent-72, score-0.067]
43 Then we can write −1 ˜ (W1 )k ∼ (W −1 )k W2 (12) and hence the desired spatial patterns of the k. [sent-75, score-0.141]
44 th system are a complex linear superposition of the (2k − 1). [sent-76, score-0.059]
45 The latter would indeed be impossible because all we analyze are anti-symmetric matrices which are, for each system, constructed as anti-symmetric outer products of the two respective field patterns. [sent-80, score-0.203]
46 These anti-symmetric matrices are, apart from an irrelevant global scale, invariant with respect to a linear and real-valued mixing of the sources within each system. [sent-81, score-0.475]
47 From the data construct anti-symmetric cross-correlation matrices as defined in Eq. [sent-84, score-0.108]
48 Find a complex matrix W such that W D(τ )W † is approximately diagonal for all τ. [sent-87, score-0.114]
49 If the system consists of subsystems of paired interactions (and indeed, according to our own experience, very much in practice) the diagonal elements in W D(τ )W † come in pairs in the form ±iλ. [sent-89, score-0.313]
50 The corresponding two columns in W −1 , with separated real and imaginary parts, form an N × 4 matrix V with rank 2. [sent-91, score-0.276]
51 The span of V coincides with the space spanned by the respective system. [sent-92, score-0.159]
52 Instead of analyzing V in the above way it is also possible to simply take the real and imaginary part of either one of the two columns. [sent-95, score-0.282]
53 Similar to the spatial analysis, it is not possible to separate the time-courses of two interacting sources within one subsystem. [sent-97, score-0.867]
54 In general, two estimated time-courses, say s1 (t) and s2 (t), are an unknown linear combination of the true source activaˆ ˆ tions s1 (t) and s2 (t). [sent-98, score-0.132]
55 To understand the type of interaction it is still recommended to look at the power and autocorrelation functions. [sent-99, score-0.188]
56 Invariant with respect to linear mixing with one subsystem is the anti-symmetrized cross-correlation between s1 (t) and s2 (t) and, equivalently, the imaginary part of the cross-spectral density. [sent-100, score-0.359]
57 th diagonal λk (τ ) and their respective Fourier transforms. [sent-103, score-0.11]
58 While (approximate) simultaneous diagonalization of D(τ ) using complex demixing matrices is always possible with pairwise interactions we can expect only block-diagonal structure if a larger number of sources are interacting within one or more subsystems. [sent-104, score-1.44]
59 We will show below for simulated data that the algorithm still finds these blocks although the actual goal, i. [sent-105, score-0.036]
60 1 Results Simulated data Matrices were approximately simultaneously diagonalized with the DOMUNG-algorithm [7], which was generalized to the complex domain. [sent-109, score-0.111]
61 Here, an initial guess for the demixing matrix W is successively optimized using a natural gradient approach combined with line search according to the requirement that the off-diagonals are minimal under the constraint det(W ) = 1. [sent-110, score-0.352]
62 , W ∗ diagonalizes as well as W ) the initial guess may not be set to a real-valued matrix because then the component of the gradient in imaginary direction will be zero and W will converge to a real-valued saddle point. [sent-114, score-0.333]
63 We simulated two random interacting subsystems of dimensions NA and NB which were assumed to be mutually independent. [sent-115, score-0.729]
64 The two subsystems were mapped into N = NA + NB channels with a random mixture matrix. [sent-116, score-0.29]
65 The anti-symmetrized cross-correlation matrices read DA (τ ) 0 D(τ ) = A 0 DB (τ ) A† (14) where A is a random real-valued N × N matrix, and DA (τ ) (DB (τ )), with τ = 1. [sent-117, score-0.108]
66 As expected, we have found that if one of the subsystems is two-dimensional the respective block can always be diagonalized exactly for any number of τ s. [sent-122, score-0.401]
67 We have also seen, that the diagonalization procedure always perfectly separates the two subsystems even if a diagonalization within a subsystem is not possible. [sent-123, score-0.685]
68 In the left panel we show the average of the absolute value of correlation matrices before spatial mixing. [sent-126, score-0.259]
69 In the middle panel we show the respective result after random spatial mixture and subsequent demixing, and in the right panel we show W1 A where W1 is the estimated real version of the demixing matrix as explained in the preceding section. [sent-127, score-0.616]
70 We note again, that also for the two-dimensional block, which can always be diagonalized exactly, one can only recover the corresponding two-dimensional subspace and not the source components themselves. [sent-128, score-0.258]
71 2 Real MEG data We applied our method to real data gathered in 93 MEG channels during triggered finger movements of the right or left hand. [sent-132, score-0.126]
72 We recall that for each interacting component we get two results: a) the 2D subspace spanned by the two components and b) the diagonals of the demixed system, say ±iλk (τ ). [sent-133, score-0.692]
73 To visualize the 2D subspace in a unique way we construct from the two patterns of the k. [sent-134, score-0.098]
74 th system, say x1 and x2 , the anti-symmetric outer product D k ≡ x 1 xT − x 2 xT 2 1 (15) Indeed, the k. [sent-135, score-0.032]
75 th subsystem contributes this matrix to the anti-symmetrized crosscorrelations D(τ ) with varying amplitude for all τ . [sent-136, score-0.134]
76 The matrix Dk is now visualized as shown in Figs. [sent-137, score-0.067]
77 th row of Dk corresponds to the interaction of the i. [sent-140, score-0.156]
78 th channel to all others and this interaction is represented by the contour-plot within the i. [sent-141, score-0.192]
79 In this example, the observed structure clearly corresponds to the interaction between eye-blinks and visual cortex since occipital channels interact with channels close to the eyes and vice versa. [sent-143, score-0.549]
80 2 we show the corresponding temporal and spectral structures of this interaction, represented by λk (τ ), and its Fourier transform, respectively. [sent-145, score-0.03]
81 We observe in the temporal domain a peak at a delay around 120 ms (indicated by the arrow) which corresponds well to the response time of the primary visual cortex to visual input. [sent-146, score-0.238]
82 2 we show the temporal and spectral pattern of another interacting component with a clear peak in the alpha range (10 Hz). [sent-148, score-0.643]
83 4 0 200 400 600 time in msec 800 0 0 1000 10 20 30 frequency in Hz 40 50 10 20 30 frequency in Hz 40 50 1 1 power in a. [sent-165, score-0.131]
84 5 0 200 400 600 time in msec 800 0 0 Figure 2: Diagonals of demixed antisymmetric correlation matrices as a function of delay τ (left panels) and, after Fourier transformation, as a function of frequency (right panels). [sent-175, score-0.349]
85 Top: interaction of eye-blinks and visual cortex; bottom: interaction of alpha generators. [sent-176, score-0.425]
86 Figure 3: Spatial pattern corresponding to the interaction between eye-blinks and visual cortex. [sent-177, score-0.196]
87 4 Conclusion When analyzing interaction between brain sources from macroscopic measurements like EEG/MEG it is important to distinguish physiologically reasonable patterns of interaction and spurious ones. [sent-178, score-1.083]
88 In particular, volume conduction effects make large parts of the cortex seemingly interact although in reality such contributions are purely artifactual. [sent-179, score-0.355]
89 Existing BSS methods that have been used with success for artifact removal and for estimation of brain sources will by construction fail when attempting to separate interacting i. [sent-180, score-0.965]
90 In this work we have proposed a new BSS algorithm that uses anti-symmetrized cross-correlation matrices and subsequent diagonalization and can thus reliably extract meaningful interaction while ignoring all spurious effects. [sent-183, score-0.598]
91 Experiments using our interacting source analysis (ISA) reveal interesting relationships that are found blindly, e. [sent-184, score-0.599]
92 inferring a component that links both eyes with visual cortex activity in a self-paced finger movement experiment. [sent-186, score-0.13]
93 A more detailed look at the spectrum exhibits a peak at the typing frequency, and, in fact going back to the original MEG traces, eye-blinks were strongly coupled with the typing speed. [sent-187, score-0.155]
94 This simple finding exemplifies that ISA is a powerful new technique for analyzing dynamical correlations in macroscopic brain measurements. [sent-188, score-0.291]
95 Future studies will therefore apply ISA to other neurophysiological paradigms in order to gain insights into the coherence and synchronicity patterns of cortical dynamics. [sent-189, score-0.053]
96 It is especially of high interest to explore the possibilities of using true brain interactions as revealed by the imaginary part of cross-spectra as complementing information to improve the performance of brain computer interfaces. [sent-190, score-0.679]
97 This work was supported in part by the IST Programme of the European Community, under PASCAL Network Figure 4: Spatial pattern corresponding to the interaction between alpha generators. [sent-194, score-0.259]
98 Identifying true brain interaction from eeg data using the imaginary part of coherency. [sent-218, score-0.618]
99 Puntonet and Alberto Prieto, editors, Lecture Notes in Computer Science, volume 3195, pages 89–96, Granada, 2004. [sent-237, score-0.056]
100 TDSEP – an efficient algorithm for blind separation using u time structure. [sent-245, score-0.07]
wordName wordTfidf (topN-words)
[('interacting', 0.497), ('sources', 0.282), ('demixing', 0.252), ('subsystems', 0.196), ('bss', 0.195), ('diagonalization', 0.195), ('brain', 0.186), ('imaginary', 0.177), ('isa', 0.168), ('interaction', 0.156), ('meg', 0.146), ('conduction', 0.111), ('diagonalized', 0.111), ('matrices', 0.108), ('source', 0.102), ('nb', 0.098), ('channels', 0.094), ('spurious', 0.089), ('spatial', 0.088), ('mixing', 0.085), ('interact', 0.075), ('synchronization', 0.074), ('alpha', 0.073), ('ziehe', 0.073), ('na', 0.072), ('interactions', 0.07), ('matrix', 0.067), ('subsystem', 0.067), ('meaningless', 0.067), ('respective', 0.063), ('macroscopic', 0.062), ('superposition', 0.059), ('cortex', 0.057), ('volume', 0.056), ('antisymmetric', 0.056), ('demixed', 0.056), ('diagonalizes', 0.056), ('nger', 0.056), ('nolte', 0.056), ('physiologically', 0.056), ('tdsep', 0.056), ('typing', 0.056), ('seemingly', 0.056), ('panels', 0.055), ('berlin', 0.054), ('patterns', 0.053), ('truly', 0.051), ('subsequent', 0.05), ('spanned', 0.05), ('diagonal', 0.047), ('ica', 0.046), ('fourier', 0.046), ('span', 0.046), ('subspace', 0.045), ('diagonals', 0.044), ('andreas', 0.044), ('drawbacks', 0.044), ('peak', 0.043), ('analyzing', 0.043), ('potsdam', 0.041), ('ac', 0.041), ('msec', 0.041), ('visual', 0.04), ('germany', 0.04), ('hz', 0.04), ('eeg', 0.039), ('contribute', 0.038), ('phase', 0.038), ('delays', 0.037), ('distinguishing', 0.037), ('da', 0.037), ('frank', 0.037), ('fundamental', 0.037), ('simulated', 0.036), ('separation', 0.036), ('channel', 0.036), ('simultaneous', 0.036), ('blind', 0.034), ('dk', 0.034), ('superimposed', 0.034), ('artifacts', 0.033), ('eyes', 0.033), ('guess', 0.033), ('signals', 0.033), ('real', 0.032), ('power', 0.032), ('panel', 0.032), ('independence', 0.032), ('outer', 0.032), ('separates', 0.032), ('correlation', 0.031), ('block', 0.031), ('ideally', 0.031), ('part', 0.03), ('true', 0.03), ('temporal', 0.03), ('cs', 0.03), ('frequency', 0.029), ('db', 0.029), ('delay', 0.028)]
simIndex simValue paperId paperTitle
same-paper 1 0.99999923 29 nips-2005-Analyzing Coupled Brain Sources: Distinguishing True from Spurious Interaction
Author: Guido Nolte, Andreas Ziehe, Frank Meinecke, Klaus-Robert Müller
Abstract: When trying to understand the brain, it is of fundamental importance to analyse (e.g. from EEG/MEG measurements) what parts of the cortex interact with each other in order to infer more accurate models of brain activity. Common techniques like Blind Source Separation (BSS) can estimate brain sources and single out artifacts by using the underlying assumption of source signal independence. However, physiologically interesting brain sources typically interact, so BSS will—by construction— fail to characterize them properly. Noting that there are truly interacting sources and signals that only seemingly interact due to effects of volume conduction, this work aims to contribute by distinguishing these effects. For this a new BSS technique is proposed that uses anti-symmetrized cross-correlation matrices and subsequent diagonalization. The resulting decomposition consists of the truly interacting brain sources and suppresses any spurious interaction stemming from volume conduction. Our new concept of interacting source analysis (ISA) is successfully demonstrated on MEG data. 1
2 0.12904045 88 nips-2005-Gradient Flow Independent Component Analysis in Micropower VLSI
Author: Abdullah Celik, Milutin Stanacevic, Gert Cauwenberghs
Abstract: We present micropower mixed-signal VLSI hardware for real-time blind separation and localization of acoustic sources. Gradient flow representation of the traveling wave signals acquired over a miniature (1cm diameter) array of four microphones yields linearly mixed instantaneous observations of the time-differentiated sources, separated and localized by independent component analysis (ICA). The gradient flow and ICA processors each measure 3mm × 3mm in 0.5 µm CMOS, and consume 54 µW and 180 µW power, respectively, from a 3 V supply at 16 ks/s sampling rate. Experiments demonstrate perceptually clear (12dB) separation and precise localization of two speech sources presented through speakers positioned at 1.5m from the array on a conference room table. Analysis of the multipath residuals shows that they are spectrally diffuse, and void of the direct path.
3 0.12353242 183 nips-2005-Stimulus Evoked Independent Factor Analysis of MEG Data with Large Background Activity
Author: Kenneth Hild, Kensuke Sekihara, Hagai T. Attias, Srikantan S. Nagarajan
Abstract: This paper presents a novel technique for analyzing electromagnetic imaging data obtained using the stimulus evoked experimental paradigm. The technique is based on a probabilistic graphical model, which describes the data in terms of underlying evoked and interference sources, and explicitly models the stimulus evoked paradigm. A variational Bayesian EM algorithm infers the model from data, suppresses interference sources, and reconstructs the activity of separated individual brain sources. The new algorithm outperforms existing techniques on two real datasets, as well as on simulated data. 1
4 0.12060732 150 nips-2005-Optimizing spatio-temporal filters for improving Brain-Computer Interfacing
Author: Guido Dornhege, Benjamin Blankertz, Matthias Krauledat, Florian Losch, Gabriel Curio, Klaus-Robert Müller
Abstract: Brain-Computer Interface (BCI) systems create a novel communication channel from the brain to an output device by bypassing conventional motor output pathways of nerves and muscles. Therefore they could provide a new communication and control option for paralyzed patients. Modern BCI technology is essentially based on techniques for the classification of single-trial brain signals. Here we present a novel technique that allows the simultaneous optimization of a spatial and a spectral filter enhancing discriminability of multi-channel EEG single-trials. The evaluation of 60 experiments involving 22 different subjects demonstrates the superiority of the proposed algorithm. Apart from the enhanced classification, the spatial and/or the spectral filter that are determined by the algorithm can also be used for further analysis of the data, e.g., for source localization of the respective brain rhythms.
5 0.10770849 113 nips-2005-Learning Multiple Related Tasks using Latent Independent Component Analysis
Author: Jian Zhang, Zoubin Ghahramani, Yiming Yang
Abstract: We propose a probabilistic model based on Independent Component Analysis for learning multiple related tasks. In our model the task parameters are assumed to be generated from independent sources which account for the relatedness of the tasks. We use Laplace distributions to model hidden sources which makes it possible to identify the hidden, independent components instead of just modeling correlations. Furthermore, our model enjoys a sparsity property which makes it both parsimonious and robust. We also propose efficient algorithms for both empirical Bayes method and point estimation. Our experimental results on two multi-label text classification data sets show that the proposed approach is promising.
6 0.085748799 130 nips-2005-Modeling Neuronal Interactivity using Dynamic Bayesian Networks
7 0.083295859 106 nips-2005-Large-scale biophysical parameter estimation in single neurons via constrained linear regression
8 0.072476789 79 nips-2005-Fusion of Similarity Data in Clustering
9 0.070735551 170 nips-2005-Scaling Laws in Natural Scenes and the Inference of 3D Shape
10 0.066162042 152 nips-2005-Phase Synchrony Rate for the Recognition of Motor Imagery in Brain-Computer Interface
11 0.058345854 124 nips-2005-Measuring Shared Information and Coordinated Activity in Neuronal Networks
12 0.056675937 7 nips-2005-A Cortically-Plausible Inverse Problem Solving Method Applied to Recognizing Static and Kinematic 3D Objects
13 0.05105105 101 nips-2005-Is Early Vision Optimized for Extracting Higher-order Dependencies?
14 0.05000617 39 nips-2005-Beyond Pair-Based STDP: a Phenomenological Rule for Spike Triplet and Frequency Effects
15 0.049652584 203 nips-2005-Visual Encoding with Jittering Eyes
16 0.048954654 163 nips-2005-Recovery of Jointly Sparse Signals from Few Random Projections
17 0.0476555 2 nips-2005-A Bayes Rule for Density Matrices
18 0.044261497 67 nips-2005-Extracting Dynamical Structure Embedded in Neural Activity
19 0.043067884 136 nips-2005-Noise and the two-thirds power Law
20 0.041800216 139 nips-2005-Non-iterative Estimation with Perturbed Gaussian Markov Processes
topicId topicWeight
[(0, 0.154), (1, -0.06), (2, -0.015), (3, 0.086), (4, -0.032), (5, -0.01), (6, -0.111), (7, -0.081), (8, 0.083), (9, -0.01), (10, -0.144), (11, -0.123), (12, 0.023), (13, -0.138), (14, 0.09), (15, 0.057), (16, -0.114), (17, -0.066), (18, 0.106), (19, 0.032), (20, -0.081), (21, -0.071), (22, 0.095), (23, 0.034), (24, 0.032), (25, -0.123), (26, 0.036), (27, -0.116), (28, -0.075), (29, -0.013), (30, 0.184), (31, 0.132), (32, -0.01), (33, -0.202), (34, 0.019), (35, 0.068), (36, 0.055), (37, -0.051), (38, 0.027), (39, -0.04), (40, -0.01), (41, -0.014), (42, -0.014), (43, 0.066), (44, 0.032), (45, -0.01), (46, -0.002), (47, 0.158), (48, -0.058), (49, -0.016)]
simIndex simValue paperId paperTitle
same-paper 1 0.97184801 29 nips-2005-Analyzing Coupled Brain Sources: Distinguishing True from Spurious Interaction
Author: Guido Nolte, Andreas Ziehe, Frank Meinecke, Klaus-Robert Müller
Abstract: When trying to understand the brain, it is of fundamental importance to analyse (e.g. from EEG/MEG measurements) what parts of the cortex interact with each other in order to infer more accurate models of brain activity. Common techniques like Blind Source Separation (BSS) can estimate brain sources and single out artifacts by using the underlying assumption of source signal independence. However, physiologically interesting brain sources typically interact, so BSS will—by construction— fail to characterize them properly. Noting that there are truly interacting sources and signals that only seemingly interact due to effects of volume conduction, this work aims to contribute by distinguishing these effects. For this a new BSS technique is proposed that uses anti-symmetrized cross-correlation matrices and subsequent diagonalization. The resulting decomposition consists of the truly interacting brain sources and suppresses any spurious interaction stemming from volume conduction. Our new concept of interacting source analysis (ISA) is successfully demonstrated on MEG data. 1
2 0.75906199 183 nips-2005-Stimulus Evoked Independent Factor Analysis of MEG Data with Large Background Activity
Author: Kenneth Hild, Kensuke Sekihara, Hagai T. Attias, Srikantan S. Nagarajan
Abstract: This paper presents a novel technique for analyzing electromagnetic imaging data obtained using the stimulus evoked experimental paradigm. The technique is based on a probabilistic graphical model, which describes the data in terms of underlying evoked and interference sources, and explicitly models the stimulus evoked paradigm. A variational Bayesian EM algorithm infers the model from data, suppresses interference sources, and reconstructs the activity of separated individual brain sources. The new algorithm outperforms existing techniques on two real datasets, as well as on simulated data. 1
3 0.59747314 88 nips-2005-Gradient Flow Independent Component Analysis in Micropower VLSI
Author: Abdullah Celik, Milutin Stanacevic, Gert Cauwenberghs
Abstract: We present micropower mixed-signal VLSI hardware for real-time blind separation and localization of acoustic sources. Gradient flow representation of the traveling wave signals acquired over a miniature (1cm diameter) array of four microphones yields linearly mixed instantaneous observations of the time-differentiated sources, separated and localized by independent component analysis (ICA). The gradient flow and ICA processors each measure 3mm × 3mm in 0.5 µm CMOS, and consume 54 µW and 180 µW power, respectively, from a 3 V supply at 16 ks/s sampling rate. Experiments demonstrate perceptually clear (12dB) separation and precise localization of two speech sources presented through speakers positioned at 1.5m from the array on a conference room table. Analysis of the multipath residuals shows that they are spectrally diffuse, and void of the direct path.
4 0.55100793 150 nips-2005-Optimizing spatio-temporal filters for improving Brain-Computer Interfacing
Author: Guido Dornhege, Benjamin Blankertz, Matthias Krauledat, Florian Losch, Gabriel Curio, Klaus-Robert Müller
Abstract: Brain-Computer Interface (BCI) systems create a novel communication channel from the brain to an output device by bypassing conventional motor output pathways of nerves and muscles. Therefore they could provide a new communication and control option for paralyzed patients. Modern BCI technology is essentially based on techniques for the classification of single-trial brain signals. Here we present a novel technique that allows the simultaneous optimization of a spatial and a spectral filter enhancing discriminability of multi-channel EEG single-trials. The evaluation of 60 experiments involving 22 different subjects demonstrates the superiority of the proposed algorithm. Apart from the enhanced classification, the spatial and/or the spectral filter that are determined by the algorithm can also be used for further analysis of the data, e.g., for source localization of the respective brain rhythms.
5 0.48649427 174 nips-2005-Separation of Music Signals by Harmonic Structure Modeling
Author: Yun-gang Zhang, Chang-shui Zhang
Abstract: Separation of music signals is an interesting but difficult problem. It is helpful for many other music researches such as audio content analysis. In this paper, a new music signal separation method is proposed, which is based on harmonic structure modeling. The main idea of harmonic structure modeling is that the harmonic structure of a music signal is stable, so a music signal can be represented by a harmonic structure model. Accordingly, a corresponding separation algorithm is proposed. The main idea is to learn a harmonic structure model for each music signal in the mixture, and then separate signals by using these models to distinguish harmonic structures of different signals. Experimental results show that the algorithm can separate signals and obtain not only a very high Signalto-Noise Ratio (SNR) but also a rather good subjective audio quality. 1
6 0.46733558 113 nips-2005-Learning Multiple Related Tasks using Latent Independent Component Analysis
7 0.45337525 130 nips-2005-Modeling Neuronal Interactivity using Dynamic Bayesian Networks
8 0.4092885 152 nips-2005-Phase Synchrony Rate for the Recognition of Motor Imagery in Brain-Computer Interface
9 0.34627426 203 nips-2005-Visual Encoding with Jittering Eyes
10 0.33057958 2 nips-2005-A Bayes Rule for Density Matrices
11 0.32761297 7 nips-2005-A Cortically-Plausible Inverse Problem Solving Method Applied to Recognizing Static and Kinematic 3D Objects
12 0.32613039 106 nips-2005-Large-scale biophysical parameter estimation in single neurons via constrained linear regression
13 0.32134104 137 nips-2005-Non-Gaussian Component Analysis: a Semi-parametric Framework for Linear Dimension Reduction
14 0.3203707 163 nips-2005-Recovery of Jointly Sparse Signals from Few Random Projections
15 0.2788952 192 nips-2005-The Information-Form Data Association Filter
16 0.26886126 20 nips-2005-Affine Structure From Sound
17 0.2598041 139 nips-2005-Non-iterative Estimation with Perturbed Gaussian Markov Processes
18 0.25170261 68 nips-2005-Factorial Switching Kalman Filters for Condition Monitoring in Neonatal Intensive Care
19 0.24612394 122 nips-2005-Logic and MRF Circuitry for Labeling Occluding and Thinline Visual Contours
20 0.24564271 124 nips-2005-Measuring Shared Information and Coordinated Activity in Neuronal Networks
topicId topicWeight
[(3, 0.039), (10, 0.03), (27, 0.051), (31, 0.038), (34, 0.095), (39, 0.024), (41, 0.013), (50, 0.011), (55, 0.021), (57, 0.033), (60, 0.369), (69, 0.047), (73, 0.028), (88, 0.083), (91, 0.029), (92, 0.011)]
simIndex simValue paperId paperTitle
1 0.92113167 134 nips-2005-Neural mechanisms of contrast dependent receptive field size in V1
Author: Jim Wielaard, Paul Sajda
Abstract: Based on a large scale spiking neuron model of the input layers 4Cα and β of macaque, we identify neural mechanisms for the observed contrast dependent receptive field size of V1 cells. We observe a rich variety of mechanisms for the phenomenon and analyze them based on the relative gain of excitatory and inhibitory synaptic inputs. We observe an average growth in the spatial extent of excitation and inhibition for low contrast, as predicted from phenomenological models. However, contrary to phenomenological models, our simulation results suggest this is neither sufficient nor necessary to explain the phenomenon.
2 0.85574752 26 nips-2005-An exploration-exploitation model based on norepinepherine and dopamine activity
Author: Samuel M. McClure, Mark S. Gilzenrat, Jonathan D. Cohen
Abstract: We propose a model by which dopamine (DA) and norepinepherine (NE) combine to alternate behavior between relatively exploratory and exploitative modes. The model is developed for a target detection task for which there is extant single neuron recording data available from locus coeruleus (LC) NE neurons. An exploration-exploitation trade-off is elicited by regularly switching which of the two stimuli are rewarded. DA functions within the model to change synaptic weights according to a reinforcement learning algorithm. Exploration is mediated by the state of LC firing, with higher tonic and lower phasic activity producing greater response variability. The opposite state of LC function, with lower baseline firing rate and greater phasic responses, favors exploitative behavior. Changes in LC firing mode result from combined measures of response conflict and reward rate, where response conflict is monitored using models of anterior cingulate cortex (ACC). Increased long-term response conflict and decreased reward rate, which occurs following reward contingency switch, favors the higher tonic state of LC function and NE release. This increases exploration, and facilitates discovery of the new target. 1 In t rod u ct i on A central problem in reinforcement learning is determining how to adaptively move between exploitative and exploratory behaviors in changing environments. We propose a set of neurophysiologic mechanisms whose interaction may mediate this behavioral shift. Empirical work on the midbrain dopamine (DA) system has suggested that this system is particularly well suited for guiding exploitative behaviors. This hypothesis has been reified by a number of studies showing that a temporal difference (TD) learning algorithm accounts for activity in these neurons in a wide variety of behavioral tasks [1,2]. DA release is believed to encode a reward prediction error signal that acts to change synaptic weights relevant for producing behaviors [3]. Through learning, this allows neural pathways to predict future expected reward through the relative strength of their synaptic connections [1]. Decision-making procedures based on these value estimates are necessarily greedy. Including reward bonuses for exploratory choices supports non-greedy actions [4] and accounts for additional data derived from DA neurons [5]. We show that combining a DA learning algorithm with models of response conflict detection [6] and NE function [7] produces an effective annealing procedure for alternating between exploration and exploitation. NE neurons within the LC alternate between two firing modes [8]. In the first mode, known as the phasic mode, NE neurons fire at a low baseline rate but have relatively robust phasic responses to behaviorally salient stimuli. The second mode, called the tonic mode, is associated with a higher baseline firing and absent or attenuated phasic responses. The effects of NE on efferent areas are modulatory in nature, and are well captured as a change in the gain of efferent inputs so that neuronal responses are potentiated in the presence of NE [9]. Thus, in phasic mode, the LC provides transient facilitation in processing, time-locked to the presence of behaviorally salient information in motor or decision areas. Conversely, in tonic mode, higher overall LC discharge rate increases gain generally and hence increases the probability of arbitrary responding. Consistent with this account, for periods when NE neurons are in the phasic mode, monkey performance is nearly perfect. However, when NE neurons are in the tonic mode, performance is more erratic, with increased response times and error rate [8]. These findings have led to a recent characterization of the LC as a dynamic temporal filter, adjusting the system's relative responsivity to salient and irrelevant information [8]. In this way, the LC is ideally positioned to mediate the shift between exploitative and exploratory behavior. The parameters that underlie changes in LC firing mode remain largely unexplored. Based on data from a target detection task by Aston-Jones and colleagues [10], we propose that LC firing mode is determined in part by measures of response conflict and reward rate as calculated by the ACC and OFC, respectively [8]. Together, the ACC and OFC are the principle sources of cortical input to the LC [8]. Activity in the ACC is known, largely through human neuroimaging experiments, to change in accord with response conflict [6]. In brief, relatively equal activity in competing behavioral responses (reflecting uncertainty) produces high conflict. Low conflict results when one behavioral response predominates. We propose that increased long-term response conflict biases the LC towards a tonic firing mode. Increased conflict necessarily follows changes in reward contingency. As the previously rewarded target no longer produces reward, there will be a relative increase in response ambiguity and hence conflict. This relationship between conflict and LC firing is analogous to other modeling work [11], which proposes that increased tonic firing reflects increased environmental uncertainty. As a final component to our model, we hypothesize that the OFC maintains an ongoing estimate in reward rate, and that this estimate of reward rate also influences LC firing mode. As reward rate increases, we assume that the OFC tends to bias the LC in favor of phasic firing to target stimuli. We have aimed to fix model parameters based on previous work using simpler networks. We use parameters derived primarily from a previous model of the LC by Gilzenrat and colleagues [7]. Integration of response conflict by the ACC and its influence on LC firing was borrowed from unpublished work by Gilzenrat and colleagues in which they fit human behavioral data in a diminishing utilities task. Given this approach, we interpret our observed improvement in model performance with combined NE and DA function as validation of a mechanism for automatically switching between exploitative and exploratory action selection. 2 G o- No- G o Task and Core Mod el We have modeled an experiment in which monkeys performed a target detection task [10]. In the task, monkeys were shown either a vertical bar or a horizontal bar and were required to make or omit a motor response appropriately. Initially, the vertical bar was the target stimulus and correctly responding was rewarded with a squirt of fruit juice (r=1 in the model). Responding to the non-target horizontal stimulus resulted in time out punishment (r=-.1; Figure 1A). No responses to either the target or non-target gave zero reward. After the monkeys had fully acquired the task, the experimenters periodically switched the reward contingency such that the previously rewarded stimulus (target) became the distractor, and vice versa. Following such reversals, LC neurons were observed to change from emitting phasic bursts of firing to the target, to tonic firing following the switch, and slowly back to phasic firing for the new target as the new response criteria was obtained [10]. Figure 1: Task and model design. (A) Responses were required for targets in order to obtain reward. Responses to distractors resulted in a minor punishment. No responses gave zero reward. (B) In the model, vertical and horizontal bar inputs (I1 and I 2 ) fed to integrator neurons (X1 and X2 ) which then drove response units (Y1 and Y2 ). Responses were made if Y 1 or Y2 crossed a threshold while input units were active. We have previously modeled this task [7,12] with a three-layer connectionist network in which two input units, I1 and I 2 , corresponding to the vertical and horizontal bars, drive two mutually inhibitory integrator units, X1 and X2 . The integrator units subsequently feed two response units, Y1 and Y2 (Figure 1B). Responses are made whenever output from Y1 or Y2 crosses a threshold level of activity, θ. Relatively weak cross connections from each input unit to the opposite integrator unit (I1 to X2 and I 2 to X1 ) are intended to model stimulus similarity. Both the integrator and response units were modeled as noisy, leaky accumulators: ˙ X i =
same-paper 3 0.8460179 29 nips-2005-Analyzing Coupled Brain Sources: Distinguishing True from Spurious Interaction
Author: Guido Nolte, Andreas Ziehe, Frank Meinecke, Klaus-Robert Müller
Abstract: When trying to understand the brain, it is of fundamental importance to analyse (e.g. from EEG/MEG measurements) what parts of the cortex interact with each other in order to infer more accurate models of brain activity. Common techniques like Blind Source Separation (BSS) can estimate brain sources and single out artifacts by using the underlying assumption of source signal independence. However, physiologically interesting brain sources typically interact, so BSS will—by construction— fail to characterize them properly. Noting that there are truly interacting sources and signals that only seemingly interact due to effects of volume conduction, this work aims to contribute by distinguishing these effects. For this a new BSS technique is proposed that uses anti-symmetrized cross-correlation matrices and subsequent diagonalization. The resulting decomposition consists of the truly interacting brain sources and suppresses any spurious interaction stemming from volume conduction. Our new concept of interacting source analysis (ISA) is successfully demonstrated on MEG data. 1
4 0.67997193 138 nips-2005-Non-Local Manifold Parzen Windows
Author: Yoshua Bengio, Hugo Larochelle, Pascal Vincent
Abstract: To escape from the curse of dimensionality, we claim that one can learn non-local functions, in the sense that the value and shape of the learned function at x must be inferred using examples that may be far from x. With this objective, we present a non-local non-parametric density estimator. It builds upon previously proposed Gaussian mixture models with regularized covariance matrices to take into account the local shape of the manifold. It also builds upon recent work on non-local estimators of the tangent plane of a manifold, which are able to generalize in places with little training data, unlike traditional, local, non-parametric models.
5 0.50883883 94 nips-2005-Identifying Distributed Object Representations in Human Extrastriate Visual Cortex
Author: Rory Sayres, David Ress, Kalanit Grill-spector
Abstract: The category of visual stimuli has been reliably decoded from patterns of neural activity in extrastriate visual cortex [1]. It has yet to be seen whether object identity can be inferred from this activity. We present fMRI data measuring responses in human extrastriate cortex to a set of 12 distinct object images. We use a simple winner-take-all classifier, using half the data from each recording session as a training set, to evaluate encoding of object identity across fMRI voxels. Since this approach is sensitive to the inclusion of noisy voxels, we describe two methods for identifying subsets of voxels in the data which optimally distinguish object identity. One method characterizes the reliability of each voxel within subsets of the data, while another estimates the mutual information of each voxel with the stimulus set. We find that both metrics can identify subsets of the data which reliably encode object identity, even when noisy measurements are artificially added to the data. The mutual information metric is less efficient at this task, likely due to constraints in fMRI data. 1
6 0.50736767 28 nips-2005-Analyzing Auditory Neurons by Learning Distance Functions
7 0.50078082 109 nips-2005-Learning Cue-Invariant Visual Responses
8 0.469154 181 nips-2005-Spiking Inputs to a Winner-take-all Network
9 0.45493317 150 nips-2005-Optimizing spatio-temporal filters for improving Brain-Computer Interfacing
10 0.44411409 183 nips-2005-Stimulus Evoked Independent Factor Analysis of MEG Data with Large Background Activity
11 0.43900126 157 nips-2005-Principles of real-time computing with feedback applied to cortical microcircuit models
12 0.42903262 190 nips-2005-The Curse of Highly Variable Functions for Local Kernel Machines
13 0.42731541 203 nips-2005-Visual Encoding with Jittering Eyes
14 0.42288771 129 nips-2005-Modeling Neural Population Spiking Activity with Gibbs Distributions
15 0.41651365 67 nips-2005-Extracting Dynamical Structure Embedded in Neural Activity
16 0.4122771 50 nips-2005-Convex Neural Networks
17 0.41201052 173 nips-2005-Sensory Adaptation within a Bayesian Framework for Perception
18 0.41086614 130 nips-2005-Modeling Neuronal Interactivity using Dynamic Bayesian Networks
19 0.41023687 124 nips-2005-Measuring Shared Information and Coordinated Activity in Neuronal Networks
20 0.40941659 99 nips-2005-Integrate-and-Fire models with adaptation are good enough