nips nips2007 nips2007-169 nips2007-169-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Vinayak Rao, Marc Howard
Abstract: Semantic memory refers to our knowledge of facts and relationships between concepts. A successful semantic memory depends on inferring relationships between items that are not explicitly taught. Recent mathematical modeling of episodic memory argues that episodic recall relies on retrieval of a gradually-changing representation of temporal context. We show that retrieved context enables the development of a global memory space that reflects relationships between all items that have been previously learned. When newly-learned information is integrated into this structure, it is placed in some relationship to all other items, even if that relationship has not been explicitly learned. We demonstrate this effect for global semantic structures shaped topologically as a ring, and as a two-dimensional sheet. We also examined the utility of this learning algorithm for learning a more realistic semantic space by training it on a large pool of synonym pairs. Retrieved context enabled the model to “infer” relationships between synonym pairs that had not yet been presented. 1
[1] D. Blei, A. Ng, and M. Jordan. Latent Dirichlet allocation. Journal of Machine Learning Research, 3:993–1022, 2003.
[2] M. Bunsey and H. B. Eichenbaum. Conservation of hippocampal memory function in rats and humans. Nature, 379(6562):255–257, 1996.
[3] P. Byrne, S. Becker, and N. Burgess. Remembering the past and imagining the future: a neural model of spatial memory and imagery. Psychological Review, 114(2):340–75, 2007.
[4] S. Dennis. A memory-based theory of verbal cognition. Cognitive Science, 29:145–193, 2005.
[5] H. Eichenbaum. The hippocampus and declarative memory: cognitive mechanisms and neural codes. Behavioural Brain Research, 127(1-2):199–207, 2001.
[6] M. A. Gluck, C. E. Myers, and M. Meeter. Cortico-hippocampal interaction and adaptive stimulus representation: A neurocomputational theory of associative learning and memory. Neural Networks, 18:1265–1279, 2005.
[7] T. L. Griffiths, M. Steyvers, and J. B. Tenenbaum. Topics in semantic representation. Psychological Review, 114(2):211–44, 2007.
[8] M. W. Howard, M. S. Fotedar, A. V. Datey, and M. E. Hasselmo. The temporal context model in spatial navigation and relational learning: Toward a common explanation of medial temporal lobe function across domains. Psychological Review, 112(1):75–116, 2005.
[9] M. W. Howard and M. J. Kahana. A distributed representation of temporal context. Journal of Mathematical Psychology, 46(3):269–299, 2002.
[10] M. N. Jones and D. J. K. Mewhort. Representing word meaning and order information composite holographic lexicon. Psychological Review, 114:1–32, 2007.
[11] M. J. Kahana, M.W. Howard, and S.M. Polyn. Associative processes in episodic memory. In H. L. Roediger, editor, Learning and Memory - A Comprehensive Reference. Elsevier, in press.
[12] T. K. Landauer and S. T. Dumais. Solution to Plato’s problem : The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104:211–240, 1997.
[13] J. L. McClelland, B. L. McNaughton, and R. C. O’Reilly. Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102(3):419–57, 1995.
[14] B. B. Murdock. Context and mediators in a theory of distributed associative memory (TODAM2). Psychological Review, 1997:839–862, 1997.
[15] N. J. Slamecka. An analysis of double-function lists. Memory & Cognition, 4:581–585, 1976.
[16] M. Steyvers and J. Tenenbaum. The large scale structure of semantic networks: statistical analyses and a model of semantic growth. Cognitive Science, 29:41–78, 2005.
[17] T. J. Teyler and P. DiScenna. The hippocampal memory indexing theory. Behavioral Neuroscience, 100(2):147–54, 1986.
[18] E. Tulving. Elements of Episodic Memory. Oxford, New York, 1983.
[19] R. Westmacott and M. Moscovitch. Names and words without meaning: incidental postmorbid semantic learning in a person with extensive bilateral medial temporal damage. Neuropsychology, 15(4):586–96, 2001. 8