nips nips2001 nips2001-78 nips2001-78-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: David Jacobs, Bas Rokers, Archisman Rudra, Zili Liu
Abstract: Partial information can trigger a complete memory. At the same time, human memory is not perfect. A cue can contain enough information to specify an item in memory, but fail to trigger that item. In the context of word memory, we present experiments that demonstrate some basic patterns in human memory errors. We use cues that consist of word fragments. We show that short and long cues are completed more accurately than medium length ones and study some of the factors that lead to this behavior. We then present a novel computational model that shows some of the flexibility and patterns of errors that occur in human memory. This model iterates between bottom-up and top-down computations. These are tied together using a Markov model of words that allows memory to be accessed with a simple feature set, and enables a bottom-up process to compute a probability distribution of possible completions of word fragments, in a manner similar to models of visual perceptual completion.
[1] J. Anderson. An Introduction to Neural Networks, MIT Press, Cambridge MA. 1995.
[2] E. Baum, J. Moody and F. Wilczek. “Internal Representations for Associative Memory,” Biological Cybernetics, 59:217-228, 1988.
[3] G. Carpenter, and S. Grossberg. “ART 2: Self-Organization of Stable Category Recognition Codes for Analog Input Patterns,” Applied Optics, 26:4919-4930, 1987.
[4] D. Grimes and M. Mozer. “The interplay of symbolic and subsymbolic processes in anagram problem solving,” NIPS, 2001.
[5] G. Hinton, P. Dayan, B. Frey, and R. Neal. “The ‘Wake-Sleep’ Algorithm for Unsupervised Neural Networks,” Science, 268:1158-1161, 1995.
[6] D.L. Hintzman and A.L. Hartry. Item effects in recognition and fragment completion: Contingency relations vary for different sets of words. JEP: Learning, Memory and Cognition, 17: 341-345, 1990.
[7] J. Hopfield. “Neural networks and Physical Systems with Emergent Collective Computational Abilities.” Proc. of the Nat. Acad. of Science, 79:2554-2558, 1982.
[8] D. Jacobs and A. Rudra. “An Iterative Projection Model of Memory,” NEC Research Institute Technical Report, 2000.
[9] G.V. Jones. Fragment and schema models for recall. Memory and Cognition, 12(3):250-63, 1984.
[10] B. Kosko. “Adaptive Bidirectional Associative Memory”, Applied Optics, 26(23):4947-60, 1987.
[11] D. Mumford. “Elastica and Computer Vision.” C. Bajaj (Ed), Algebraic Geometry and its Applications New York: Springer-Verlag. 1994.
[12] U. Olofsson and L. Nyberg. Swedish norms for completion of word stems and unique word fragments. Scandinavian Journal of Psychology, 33(2):108-16, 1992.
[13] U. Olofsson and L. Nyberg. Determinants of word fragment completion. Scandinavian Journal of Psychology, 36(1):59-64, 1995.
[14] R. Rao and D. Ballard. “Dynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex,” Neural Computation, 9(4):721-763, 1997.
[15] R.H. Ross and G.H. Bower. Comparisons of models of associative recall. Memory and Cognition, 9(1):1-16, 1981.
[16] D. Rumelhart and J. McClelland. “An interactive activation model of context effects in letter perception: part 2. The contextual enhancement effect and some tests and extensions of the model”, Psychological Review, 89:60-94, 1982.
[17] M.S. Seidenberg. Sublexical structures in visual word recognition: Access units or orthographic redundancy? In M. Coltheart (Ed.), Attention and performance XII, 245-263. Hillsdale, NJ: Erlbaum. 1987.
[18] D.L. Shacter and E. Tulving. Memory systems. Cambridge, MA: MIT Press. 1994.
[19] C. Shannon. “Prediction and Entropy of Printed English,” Bell Systems Technical Journal, 30:50-64, 1951.
[20] Sommer, F., and Palm, G., 1997, NIPS:676-681.
[21] K. Srinivas, H.L. Roediger 3d and S. Rajaram. The role of syllabic and orthographic properties of letter cues in solving word fragments. Memory and Cognition, 20(3):219-30, 1992.
[22] N. Tishby, F. Pereira and W. Bialek. “The Information Bottleneck Method,” 37th Allerton Conference on Communication, Control, and Computing. 1999.
[23] S. Ullman. High-level Vision, MIT Press, Cambridge, MA. 1996.
[24] L. Williams & D. Jacobs. “Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience”. Neural Computation, 9:837–858, 1997. Acknowledgements The authors would like to thank Nancy Johal for her assistance in conducting the psychological experiments presented in this paper.