nips nips2001 nips2001-11 nips2001-11-reference knowledge-graph by maker-knowledge-mining

11 nips-2001-A Maximum-Likelihood Approach to Modeling Multisensory Enhancement


Source: pdf

Author: H. Colonius, A. Diederich

Abstract: Multisensory response enhancement (MRE) is the augmentation of the response of a neuron to sensory input of one modality by simultaneous input from another modality. The maximum likelihood (ML) model presented here modifies the Bayesian model for MRE (Anastasio et al.) by incorporating a decision strategy to maximize the number of correct decisions. Thus the ML model can also deal with the important tasks of stimulus discrimination and identification in the presence of incongruent visual and auditory cues. It accounts for the inverse effectiveness observed in neurophysiological recording data, and it predicts a functional relation between uni- and bimodal levels of discriminability that is testable both in neurophysiological and behavioral experiments. 1


reference text

[1] McGurk, H. & MacDonald, J . (1976). Hearing lips and seeing voices. Nature, 264, 746-748.

[2] Wallace, M. T ., Meredith, M. A., & Stein, B. E. (1993) . Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus. Journal of N europhysiology, 69 , 1797-1809.

[3] Stein, B. E., & Meredith, M. A. (1996). The merging of the senses. Cambridge, MA: MIT Press.

[4] Meredith, M. A. & Stein, B. E. (1986a). Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain R esearch, 365(2), 350-354.

[5] Frens, van Opstal , & van der Willigen (1995) . Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements. Perception fj Psychophysics, 57, 802-816.

[6] Colonius, H. & Arndt , P. A. (2001). A two stage-model for visual-auditory interaction in saccadic latencies. Perception fj Psychophysics, 63, 126-147.

[7] Stein, B. E. , Meredith, M. A., Huneycutt , W. S. , & McDade, L. (1989). Behavioral indices of multisensory integration: Orientation to visual cues is affected by auditory stimuli. Journal of Cognitive N eurosciences, 1, 12-24.

[8] Welch, R. B., & Warren, D. H. (1986). Intersensory interactions. In K R. Boff, L. Kaufman , & J. P. Thomas (eds.), Handbook of perception and human performance, Volum e I : Sensory process and perception (pp . 25-1-25-36) New York: Wiley

[9] Anastasio

[10] Meredith, M. A. & Stein, B. E. (1986b). Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. Journal of Neurophysiology, 56(3), 640-662.

[11] Green, D. M., & Swets, J. A. (1974). Signal detection th eory and psychophysics. New York: Krieger Pub!. Co.

[12] Egan, J . P. (1975) . Signal detection theory and ROC analysis. New York: Academic Press.

[13] Craig, A., & Colquhoun, W. P. (1976). Combining evidence presented simultaneously to the eye and the ear: A comparison of some predictive models. Perception fj Psychophysics, 19, 473-484.

[14] Stein, B. E., London , N. , Wilkinson, L. K , & Price, D. D. (1996). Enhancement of perceived visual intensity by auditory stimuli: A psychophysical analysis. Journal of Cognitive Neurosci ence, 8, 497-506.

[15] Kadunce, D . C., Vaughan, J . W ., Wallace, M. T ., & Stein, B. E. (2001) . The influence of visual and auditory receptive field organization on multisensory integration in the superior colliculus. Experimental Brain Research, 139, 303-310.

[16] King, A. J., & Calvert , G. A. (2001). Multisensory integration: Perceptual grouping by eye and ear. Current Biology, 11 , 322-325 .