nips nips2012 nips2012-273 nips2012-273-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Uri Maoz, Shengxuan Ye, Ian Ross, Adam Mamelak, Christof Koch
Abstract: The ability to predict action content from neural signals in real time before the action occurs has been long sought in the neuroscientific study of decision-making, agency and volition. On-line real-time (ORT) prediction is important for understanding the relation between neural correlates of decision-making and conscious, voluntary action as well as for brain-machine interfaces. Here, epilepsy patients, implanted with intracranial depth microelectrodes or subdural grid electrodes for clinical purposes, participated in a “matching-pennies” game against an opponent. In each trial, subjects were given a 5 s countdown, after which they had to raise their left or right hand immediately as the “go” signal appeared on a computer screen. They won a fixed amount of money if they raised a different hand than their opponent and lost that amount otherwise. The question we here studied was the extent to which neural precursors of the subjects’ decisions can be detected in intracranial local field potentials (LFP) prior to the onset of the action. We found that combined low-frequency (0.1–5 Hz) LFP signals from 10 electrodes were predictive of the intended left-/right-hand movements before the onset of the go signal. Our ORT system predicted which hand the patient would raise 0.5 s before the go signal with 68±3% accuracy in two patients. Based on these results, we constructed an ORT system that tracked up to 30 electrodes simultaneously, and tested it on retrospective data from 7 patients. On average, we could predict the correct hand choice in 83% of the trials, which rose to 92% if we let the system drop 3/10 of the trials on which it was less confident. Our system demonstrates— for the first time—the feasibility of accurately predicting a binary action on single trials in real time for patients with intracranial recordings, well before the action occurs. 1 1
[1] B. Libet, C. Gleason, E. Wright, and D. Pearl. Time of conscious intention to act in relation to onset of cerebral activity (readiness-potential): The unconscious initiation of a freely voluntary act. Brain, 106:623, 1983.
[2] B. Libet. Unconscious cerebral initiative and the role of conscious will in voluntary action. Behavioral and brain sciences, 8:529–539, 1985.
[3] P. Haggard and M. Eimer. On the relation between brain potentials and the awareness of voluntary movements. Experimental Brain Research, 126:128–133, 1999.
[4] A. Sirigu, E. Daprati, S. Ciancia, P. Giraux, N. Nighoghossian, A. Posada, and P. Haggard. Altered awareness of voluntary action after damage to the parietal cortex. Nature Neuroscience, 7:80–84, 2003.
[5] H. Kornhuber and L. Deecke. Hirnpotenti¨ landerungen bei Willk¨ rbewegungen und passiven a u Bewegungen des Menschen: Bereitschaftspotential und reafferente Potentiale. Pfl¨ gers Archiv u European Journal of Physiology, 284:1–17, 1965.
[6] H. Shibasaki and M. Hallett. What is the Bereitschaftspotential? Clinical Neurophysiology, 117:2341–2356, 2006.
[7] C. Soon, M. Brass, H. Heinze, and J. Haynes. Unconscious determinants of free decisions in the human brain. Nature Neuroscience, 11:543–545, 2008.
[8] I. Fried, R. Mukamel, and G. Kreiman. Internally generated preactivation of single neurons in human medial frontal cortex predicts volition. Neuron, 69:548–562, 2011.
[9] M. Cerf, N. Thiruvengadam, F. Mormann, A. Kraskov, R. Quian Quiorga, C. Koch, and I. Fried. On-line, voluntary control of human temporal lobe neurons. Nature, 467:1104–1108, 2010.
[10] T. Ball, M. Kern, I. Mutschler, A. Aertsen, and A. Schulze-Bonhage. Signal quality of simultaneously recorded invasive and non-invasive EEG. Neuroimage, 46:708–716, 2009.
[11] G. Schalk, J. Kubanek, K. Miller, N. Anderson, E. Leuthardt, J. Ojemann, D. Limbrick, D. Moran, L. Gerhardt, and J. Wolpaw. Decoding two-dimensional movement trajectories using electrocorticographic signals in humans. Journal of Neural engineering, 4:264, 2007.
[12] O. Bai, V. Rathi, P. Lin, D. Huang, H. Battapady, D. Y. Fei, L. Schneider, E. Houdayer, X. Chen, and M. Hallett. Prediction of human voluntary movement before it occurs. Clinical Neurophysiology, 122:364–372, 2011.
[13] O. Bai, P. Lin, S. Vorbach, J. Li, S. Furlani, and M. Hallett. Exploration of computational methods for classification of movement intention during human voluntary movement from single trial EEG. Clinical Neurophysiology, 118:2637–2655, 2007.
[14] U. Maoz, A. Arieli, S. Ullman, and C. Koch. Using single-trial EEG data to predict laterality of voluntary motor decisions. Society for Neuroscience, 38:289.6, 2008.
[15] C. Camerer. Behavioral game theory: Experiments in strategic interaction. Princeton University Press, 2003.
[16] J. D. Haynes. Decoding and predicting intentions. Annals of the New York Academy of Sciences, 1224:9–21, 2011.
[17] P. Haggard. Decision time for free will. Neuron, 69:404–406, 2011.
[18] J. D. Haynes. Beyond libet. In W. Sinnott-Armstrong and L. Nadel, editors, Conscious will and responsibility, pages 85–96. Oxford University Press, 2011.
[19] A. Muralidharan, J. Chae, and D. M. Taylor. Extracting attempted hand movements from EEGs in people with complete hand paralysis following stroke. Frontiers in neuroscience, 5, 2011.
[20] E. Lew, R. Chavarriaga, S. Silvoni, and J. R. Milln. Detection of self-paced reaching movement intention from EEG signals. Frontiers in Neuroengineering, 5:13, 2012. 9