nips nips2001 nips2001-12 nips2001-12-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Randall C. O'Reilly, R. Soto
Abstract: We present a neural network model that shows how the prefrontal cortex, interacting with the basal ganglia, can maintain a sequence of phonological information in activation-based working memory (i.e., the phonological loop). The primary function of this phonological loop may be to transiently encode arbitrary bindings of information necessary for tasks - the combinatorial expressive power of language enables very flexible binding of essentially arbitrary pieces of information. Our model takes advantage of the closed-class nature of phonemes, which allows different neural representations of all possible phonemes at each sequential position to be encoded. To make this work, we suggest that the basal ganglia provide a region-specific update signal that allocates phonemes to the appropriate sequential coding slot. To demonstrate that flexible, arbitrary binding of novel sequences can be supported by this mechanism, we show that the model can generalize to novel sequences after moderate amounts of training. 1
Baddeley, A. , Gathercole, S. , & Papagno, C. (1998). The phonological loop as a language learning device. Psychological Review, 105, 158. Baddeley, A. D. (1986). Working memory. New York: Oxford University Press. Burgess, N. , & Hitch, G. J . (1999). Memory for serial order: A network model of the phonological loop and its timing. Psychological Review, 106, 551- 581. Cohen, J. D., Braver, T. S., & O'Reilly, R. C. (1996). A computational approach to prefrontal cortex, cognitive control, and schizophrenia: Recent developments and current challenges. Philosophical Transactions of the Royal Society (London) B, 351, 1515- 1527. Cohen, J. D. , & O'Reilly, R. C. (1996). A preliminary theory of the interactions between prefrontal cortex and hippocampus that contribute to planning and prospective memory. In M. Brandimonte, G. O. Einstein, & M. A. McDaniel (Eds.) , Prospective memory: Theory and applications (pp. 267- 296). Mahwah, New Jersey: Erlbaum. Frank, M. J. , Loughry, B., & O 'Reilly, R . C. (2001). Interactions between the frontal cortex and basal ganglia in working memory: A computational model. Cognitive, Affective, and Behavioral Neurosci ence, 1 , 137- 160. Henson, R. N. A., Norris, D. G ., Page, M. P . A., & Baddeley, A. D . (1996) . Unclaimed memory: Error patterns rule out chaining models of immediate serial recall. Quarterly Journal of Experimental Psychology: Human Experim ental Psychology, 49(A) , 80- 115. Ivry, R. (1996). The representation of temporal information in perception and motor control. Current Opinion in N eurobiology, 6,851-857. Lee, C. L. , & Estes, W. K. (1977). Order and position in primary memory for letter strings. Journal of Verbal Learning and Verbal B ehavior, 16, 395- 418. Levitt , J . B. , Lewis, D. A. , Yoshioka, T. , & Lund, J. S. (1993). Topography of pyramidal neuron intrinsic connections in macaque monkey prefrontal cortex (areas 9 & 46). Journal of Comparativ e N eurology, 338, 360- 376. Lewandowsky, S. , & Murdock, B. B. (1989). Memory for serial order. Psychological R eview, 96, 25- 57. Mel, B. A., & Fiser, J. (2000). Minimizing binding errors using learned conjunctive features. Neural Computation, 12, 731- 762. Miller, E. K. , & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience , 24, 167- 202. Miyake, A., & Soto , R. (in preparation). The role of the phonological loop in executive control. O'Reilly, R. C. (1998). Six principles for biologically-based computational models of cortical cognition. Trends in Cognitive Sci ences, 2(11), 455- 462. O 'Reilly, R . C ., Braver, T . S., & Cohen, J . D . (1999) . A biologically based computational model of working memory. In A. Miyake, & P. Shah (Eds.) , Mod els of working m emory: M echanisms of active maintenance and executiv e control. (pp. 375- 411) . New York: Cambridge University Press. O 'Reilly, R. C. , & Busby, R. S. (2002). Generalizable relational binding from coarsecoded distributed representations. Advances in N eural Information Processing Systems (NIPS), 2001. O 'Reilly, R . C. , Busby, R. S., & Soto, R. (in press). Three forms of binding and their neural substrates: Alternatives to temporal synchrony. In A. Cleeremans (Ed.) , Th e unity of consciousness: Binding, integration, and dissociation. Oxford: Oxford University Press. O 'Reilly, R. C ., & Munakata, Y . (2000) . Computational explorations in cognitive n euroscience: Understanding th e mind by simulating th e brain. Cambridge, MA: MIT Press. O 'Reilly, R. C. , & Rudy, J. W . (2001). Conjunctive representations in learning and memory: Principles of cortical and hippocampal function . Psychological Review, 108, 311345. Paulesu, E. , Frith, C. D. , & Frackowiak, R. S. J. (1993). The neural correlates of the verbal component of working memory. Nature, 362,342- 345. Wickelgren, W. A. (1969). Context-sensitive coding, associative memory, and serial order in (speech) behavior. Psychological R eview, 76 , 1- 15 .