emnlp emnlp2011 emnlp2011-8 emnlp2011-8-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Amit Dubey ; Frank Keller ; Patrick Sturt
Abstract: This paper introduces a psycholinguistic model of sentence processing which combines a Hidden Markov Model noun phrase chunker with a co-reference classifier. Both models are fully incremental and generative, giving probabilities of lexical elements conditional upon linguistic structure. This allows us to compute the information theoretic measure of surprisal, which is known to correlate with human processing effort. We evaluate our surprisal predictions on the Dundee corpus of eye-movement data show that our model achieve a better fit with human reading times than a syntax-only model which does not have access to co-reference information.
Gerry Altmann and Mark Steedman. Interaction with context during human sentence processing. Cognition, 30: 191–238, 1988. Gerry T. M. Altmann and Yuki Kamide. Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition, 73:247–264, 1999. Marisa Ferrara Boston, John T. Hale, Reinhold Kliegl, and Shravan Vasisht. Surprising parser actions and reading difficulty. In Proceedings of ACL-08:HLT, Short Papers, pages 5–8, 2008. Charles Clifton, Adrian Staub, and Keith Rayner. Eye movement in reading words and sentences. In R V Gompel, M Fisher, W Murray, and R L Hill, editors, Eye Movements: A Window in Mind and Brain, pages 341–372. Elsevier, 2007. Vera Demberg and Frank Keller. Data from eyetracking corpora as evidence for theories of syntactic processing complexity. Cognition, 109: 192–210, 2008. Vera Demberg and Frank Keller. A computational model of prediction in human parsing: Unifying locality and surprisal effects. In Proceedings of the 29th meeting of the Cognitive Science Society (CogSci-09), 2009. Amit Dubey. The influence of discourse on syntax: A psycholinguistic model of sentence processing. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics (ACL 2010), Uppsala, Sweden, 2010. Stefan Frank. Surprisal-based comparison between a symbolic and a connectionist model of sentence processing. In 31st Annual Conference of the 311 Cognitive Science Society (COGSCI 2009), Amsterdam, The Netherlands, 2009. Lyn Frazier, Alan Munn, and Charles Clifton. Processing coordinate structure. Journal of Psycholinguistic Research, 29:343–368, 2000. Daniel J. Grodner, Edward A. F. Gibson, and Duane Watson. The influence of contextual constrast on syntactic processing: Evidence for stronginteraction in sentence comprehension. Cognition, 95(3):275–296, 2005. John T. Hale. A probabilistic earley parser as a psycholinguistic model. In In Proceedings of the Second Meeting of the North American Chapter of the Asssociation for Computational Linguistics, 2001. A. Kennedy, R. Hill, and J. Pynte. The dundee corpus. In Proceedings of the 12th European conference on eye movement, 2003. Jeff Mitchell, Mirella Lapata, Vera Demberg, and Frank Keller. Syntactic and semantic factors in processing difficulty: An integrated measure. In Proceedings ofthe 48thAnnual Meeting ofthe Associationfor Computational Linguistics, Uppsala, Sweden, 2010. M. Niv. A psycholinguistically motivated parser for CCG. In Proceedings of the 32nd Annual Meeting of the Association for Computational Linguistics (ACL-94), pages 125–132, Las Cruces, NM, 1994. W. M. Soon, H. T. Ng, and D. C. Y. Lim. A ma- chine learning approach to coreference resolution of noun phrases. (4):521–544, Computational Linguistics, 27 2001. M. J. Spivey and M. K. Tanenhaus. biguity resolution in discourse: Syntactic am- Modeling the ef- fects of referential context and lexical frequency. Journal of Experimental Psychology: Memory and Cognition, 24(6): Learning, 1521–1543, 1998. Kieth E. Stanovich and Richard F. West. The effect of sentence context on ongoing word recognition: Tests of a two-pricess imental Psychology: formance, theory. Journal of Exper- Human Perception and Per- 7:658–672, 1981. Adrian Staub and Charles Clifton. Syntactic prediction in language comprehension: Evidence from either . . .or. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32:425–436, 2006. Mark Steedman. The Syntactic Process. Bradford Books, 2001 . Erik F. Tjong Kim Sang and Sabine Buchholz. Introduction to the conll-2000 shared task: Chunking. In Proceedings of CoNLL-2000 and LLL2000, pages 127–132. Lisbon, Portugal, 2000. Jos J. A. van Berkum, Colin M. Brown, Pienie Zwitserlood, Valesca Kooijman, and Peter Hagoort. Anticipating upcoming words in discourse: Evidence from erps and reading times. Journal of Experimental Psychology: Learning, Memory and Cognition, 31(3):443–467, 2005. Barton Wright and Merrill F. Garrett. Lexical decision in sentences: Effects of syntactic structure. Memory and Cognition, 12:3 1–45, 1984. 312