emnlp emnlp2012 emnlp2012-53 emnlp2012-53-reference knowledge-graph by maker-knowledge-mining

53 emnlp-2012-First Order vs. Higher Order Modification in Distributional Semantics


Source: pdf

Author: Gemma Boleda ; Eva Maria Vecchi ; Miquel Cornudella ; Louise McNally

Abstract: Adjectival modification, particularly by expressions that have been treated as higherorder modifiers in the formal semantics tradition, raises interesting challenges for semantic composition in distributional semantic models. We contrast three types of adjectival modifiers intersectively used color terms (as in white towel, clearly first-order), subsectively used color terms (white wine, which have been modeled as both first- and higher-order), and intensional adjectives (former bassist, clearly higher-order) and test the ability of different composition strategies to model their behavior. In addition to opening up a new empirical domain for research on distributional semantics, our observations concerning the attested vectors for the different types of adjectives, the nouns they modify, and the resulting – – noun phrases yield insights into modification that have been little evident in the formal semantics literature to date.


reference text

Mark Andrews, Gabriella Vigliocco, and David Vinson. 2009. Integrating experiential and distributional data to learn semantic represenations. Psychological Review, 116(3):463–498. Marco Baroni and Alessandro Lenci. 2010. Distributional Memory: A general framework for corpus-based semantics. Computational Linguistics, 36(4):673–721. Marco Baroni and Roberto Zamparelli. 2010. Nouns are vectors, adjectives are matrices: Representing adjective-noun constructions in semantic space. In Proceedings of EMNLP, pages 1183–1 193, Boston, MA. Brent Berlin and Paul Kay. 1969. Basic Color Terms: Their Universality an Evolution. University of California Press, Berkeley and Los Angeles, CA. E. Bruni, G. Boleda, M. Baroni, and N. K. Tran. to appear. Distributional semantics in technicolor. In Proceedings of ACL 2012. Stephen Clark, Bob Coecke, and Mehrnoosh Sadrzadeh. 2008. A compositional distributional model of meaning. In Proceedings of the AAAI Spring Symposium on Quantum Interaction, pages 52–55, Stanford, CA. Katrin Erk and Sebastian Pad o´. 2008. A structured vector space model for word meaning in context. In Proceedings of EMNLP, pages 897–906, Honolulu, HI, USA. Stefan Evert. 2005. The Statistics of Word Cooccurrences. Dissertation, Stuttgart University. Joseph L. Fleiss, Jacob Cohen, and B. S. Everitt. 1969. Large sample standard errors of kappa and weighted kappa. Psychological Bulletin, 72(5):323–327. Peter G ¨ardenfors. 2000. Conceptual Spaces: The Geometry of Thought. MIT Press, Cambridge, MA. Dan Garrette, Katrin Erk, and Raymond Mooney. 2011. Integrating logical representations with probabilistic information using markov logic. In Proceedings of IWCS 2011. G.H. Golub, M. Heath, and G. Wahba. 1979. Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics, pages 215–223. Edward Grefenstette and Mehrnoosh Sadrzadeh. 2011. Experimenting with transitive verbs in a discocat. In Proceedings of the GEMS 2011 Workshop on GEometrical Models of Natural Language Semantics. Emiliano Guevara. 2010. A regression model of adjective-noun compositionality in distributional semantics. In Proceedings of the ACL GEMS Workshop, pages 33–37, Uppsala, Sweden. H. Kamp. 1975. Two theories about adjectives. Formal semantics of natural language, pages 123–155. 1233 Christopher Kennedy and Louise McNally. 2010. Color, context, and compositionality. Synthese, 174:79–98. Thomas Landauer and Susan Dumais. 1997. A solu- tion to Plato’s problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104(2):21 1–240. Bj ¨orn-Helge Mevik and Ron Wehrens. 2007. The pls package: Principal component and partial least squares regression in R. Journal of Statistical Software, 18(2). Published online: http : / /www . j st at s o ft . org/v1 8 / i 2 / . 0 Jeff Mitchell and Mirella Lapata. 2010. Composition in distributional models of semantics. Cognitive Science, 34(8): 1388–1429. Richard Montague. 1974. Formal philosophy: Selected Papers of Richard Montague. Yale University Press, New Haven. Terence Parsons. 1970. Some problems concerning the logic of grammatical modifiers. Synthese, 21:320– 334. Reinhard Rapp. 2003. Word sense discovery based on sense descriptor dissimilarity. In Proceedings of the 9th MT Summit, pages 315–322, New Orleans, LA, USA. Herbert Rubenstein and John Goodenough. 1965. Contextual correlates of synonymy. Communications of the ACM, 8(10):627–633. Helmut Schmid. 1995. Improvements in part-of-speech tagging with an application to German. In Proceedings of the EACL-SIGDAT Workshop, Dublin, Ireland. Hinrich Sch u¨tze. 1997. Ambiguity Resolution in Natural Language Learning. CSLI, Stanford, CA. R. Socher, J. Pennington, E.H. Huang, A.Y. Ng, and C.D. Manning. 2011. Semi-supervised recursive autoencoders for predicting sentiment distributions. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 15 1–161, Edinburgh, UK. Peter Turney and Patrick Pantel. 2010. From frequency to meaning: Vector space models of semantics. Journal of Artificial Intelligence Research, 37: 141–188. Dominic Widdows. 2004. The Geometry of Meaning. CSLI Publications, Stanford, CA.