nips nips2006 nips2006-49 nips2006-49-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Konrad P. Körding, Joshua B. Tenenbaum
Abstract: Many recent studies analyze how data from different modalities can be combined. Often this is modeled as a system that optimally combines several sources of information about the same variable. However, it has long been realized that this information combining depends on the interpretation of the data. Two cues that are perceived by different modalities can have different causal relationships: (1) They can both have the same cause, in this case we should fully integrate both cues into a joint estimate. (2) They can have distinct causes, in which case information should be processed independently. In many cases we will not know if there is one joint cause or two independent causes that are responsible for the cues. Here we model this situation as a Bayesian estimation problem. We are thus able to explain some experiments on visual auditory cue combination as well as some experiments on visual proprioceptive cue integration. Our analysis shows that the problem solved by people when they combine cues to produce a movement is much more complicated than is usually assumed, because they need to infer the causal structure that is underlying their sensory experience.
[1] Q. Haijiang, J. A. Saunders, R. W. Stone, and B. T. Backus. Demonstration of cue recruitment: change in visual appearance by means of pavlovian conditioning. Proc Natl Acad Sci U S A, 103(2):483–8, 2006. 0027-8424 (Print) Journal Article.
[2] J. W. Krakauer, M. F. Ghilardi, and C. Ghez. Independent learning of internal models for kinematic and dynamic control of reaching. Nat Neurosci, 2(11):1026–31, 1999.
[3] R. Shadmehr and F. A. Mussa-Ivaldi. Adaptive representation of dynamics during learning of a motor task. J Neurosci, 14(5 Pt 2):3208–24, 1994.
[4] M. O. Ernst and M. S. Banks. Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415(6870):429–33, 2002.
[5] S. J. Sober and P. N. Sabes. Multisensory integration during motor planning. J Neurosci, 23(18):6982–92, 2003.
[6] S. J. Sober and P. N. Sabes. Flexible strategies for sensory integration during motor planning. Nat Neurosci, 8(4):490–7, 2005.
[7] K. P. Koerding and D. M. Wolpert. Bayesian integration in sensorimotor learning. Nature, 427(6971):244– 7, 2004.
[8] L. Shams, W. J. Ma, and U. Beierholm. Sound-induced flash illusion as an optimal percept. Neuroreport, 16(17):1923–7, 2005.
[9] E Hirsch. The concept of Identity. Oxford University Press, Oxford, 1982.
[10] A. Leslie, F. Xu, P. Tremoulet, and B. Scholl. Indexing and the object concept: ”what” and ”where” in infancy. Trends in Cognitive Sciences, 2:10–18, 1998.
[11] A. Gopnik, C. Glymour, D. M. Sobel, L. E. Schulz, T. Kushnir, and D. Danks. A theory of causal learning in children: causal maps and bayes nets. Psychol Rev, 111(1):3–32, 2004.
[12] T. L. Griffiths and J. B. Tenenbaum. From mere coincidences to meaningful discoveries. Cognition, 2006. 0010-0277 (Print) Journal article.
[13] Z. Ghahramani. Computational and psychophysics of sensorimotor integration. PhD thesis, Massachusetts Institute of Technology, 1995.
[14] R. A. Jacobs. Optimal integration of texture and motion cues to depth. Vision Res, 39(21):3621–9, 1999.
[15] R. J. van Beers, A. C. Sittig, and J. J. Gon. Integration of proprioceptive and visual position-information: An experimentally supported model. J Neurophysiol, 81(3):1355–64, 1999.
[16] D. Alais and D. Burr. The ventriloquist effect results from near-optimal bimodal integration. Curr Biol, 14(3):257–62, 2004.
[17] W. D. Hairston, M. T. Wallace, J. W. Vaughan, B. E. Stein, J. L. Norris, and J. A. Schirillo. Visual localization ability influences cross-modal bias. J Cogn Neurosci, 15(1):20–9, 2003.
[18] M. T. Wallace, G. E. Roberson, W. D. Hairston, B. E. Stein, J. W. Vaughan, and J. A. Schirillo. Unifying multisensory signals across time and space. Exp Brain Res, 158(2):252–8, 2004.
[19] Shams L Beierholm U, Quartz S. Bayesian inference as a unifying model of auditory-visual integration and segregation. In Proceedings of the society of neuroscience, 2005.
[20] M. A. Goodale, G. Kroliczak, and D. A. Westwood. Dual routes to action: contributions of the dorsal and ventral streams to adaptive behavior. Prog Brain Res, 149:269–83, 2005.
[21] R. Saxe, J. B. Tenenbaum, and S. Carey. Secret agents: inferences about hidden causes by 10- and 12-month-old infants. Psychol Sci, 16(12):995–1001, 2005.
[22] T. L. Griffiths and J. B. Tenenbaum. Structure and strength in causal induction. Cognit Psychol, 51(4):334–84, 2005. 0010-0285 (Print) Journal Article.