acl acl2010 acl2010-66 acl2010-66-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Sebastian Rudolph ; Eugenie Giesbrecht
Abstract: We propose CMSMs, a novel type of generic compositional models for syntactic and semantic aspects of natural language, based on matrix multiplication. We argue for the structural and cognitive plausibility of this model and show that it is able to cover and combine various common compositional NLP approaches ranging from statistical word space models to symbolic grammar formalisms.
[Antonellis and Gallopoulos2006] Ioannis Antonellis and Efstratios Gallopoulos. 2006. Exploring term-document matrices from matrix models in text mining. CoRR, abs/cs/0602076. [Baddeley2003] Alan D. Baddeley. 2003. Working memory and language: An overview. Journal of Communication Disorder, 36: 198–208. [Cayley1854] Arthur Cayley. 1854. On the theory of groups as depending on the symbolic equation θn = 1. Philos. Magazine, 7:40–47. [Clark and Pulman2007] Stephen Clark and Stephen Pulman. 2007. Combining symbolic and distributional models of meaning. In Proceedings of the AAAI Spring Symposium on Quantum Interaction, Stanford, CA, 2007, pages 52–55. [Clark et al.2008] Stephen Clark, Bob Coecke, and Mehrnoosh Sadrzadeh. 2008. A compositional distributional model of meaning. In Proceedings of the Second Symposium on Quantum Interaction (QI2008), pages 133–140. [Deerwester et al. 1990] Scott Deerwester, Susan T. Dumais, George W. Furnas, Thomas K. Landauer, and Richard Harshman. 1990. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41:391–407. [Dymetman1998] Marc Dymetman. 1998. Group theory and computational linguistics. J. of Logic, Lang. and Inf., 7(4):461–497. [Firth1957] John R. Firth. 1957. A synopsis of linguistic theory 1930-55. Studies in linguistic analysis, pages 1–32. [Gao et al.2004] Kai Gao, Yongcheng Wang, and Zhiqi Wang. 2004. An efficient relevant evaluation model in information retrieval and its application. In CIT ’04: Proceedings of the The Fourth International Conference on Computer and Information Technology, pages 845–850. IEEE Computer Society. [Gärdenfors2000] Peter Gärdenfors. 2000. Conceptual Spaces: The Geometry of Thought. MIT Press, Cambridge, MA, USA. [Giesbrecht2009] Eugenie Giesbrecht. 2009. In search of semantic compositionality in vector spaces. In Sebastian Rudolph, Frithjof Dau, and Sergei O. Kuznetsov, editors, ICCS, volume 5662 of Lecture Notes in Computer Science, pages 173–184. Springer. [Giesbrecht2010] Eugenie Giesbrecht. 2010. Towards a matrix-based distributional model of meaning. In Proceedings of Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Student Research Workshop. ACL. [Golan1992] Jonathan S. Golan. 1992. The theory of semirings with applications in mathematics and theoretical computer science. Addison-Wesley Long- man Ltd. [Grefenstette1994] Gregory Grefenstette. plorations in Automatic Thesaurus Springer. 1994. ExDiscovery. 915 [Hopcroft and Ullman1979] John E. Hopcroft and Jeffrey D. Ullman. 1979. Introduction to Automata Theory, Languages and Computation. AddisonWesley. [Kintsch2001] Walter Kintsch. 2001. Cognitive Science, 25: 173–202. Predication. [Lambek1958] Joachim Lambek. 1958. The mathematics of sentence structure. The American Mathematical Monthly, 65(3): 154–170. [Landauer and Dumais1997] Thomas K. Landauer and Susan T. Dumais. 1997. Solution to Plato’s problem: The latent semantic analysis theory of acquisition, induction and representation of knowledge. Psychological Review, (104). [Lund and Burgess1996] Kevin Lund and Curt Burgess. 1996. Producing high-dimensional semantic spaces from lexical co-occurrence. Behavior Research Methods, Instrumentation, and Computers, 28:203– 208. [Mitchell and Lapata2008] Jeff Mitchell and Mirella Lapata. 2008. Vector-based models of semantic composition. In Proceedings of ACL-08: HLT, pages 236–244. ACL. [Padó and Lapata2007] Sebastian Padó and Mirella Lapata. 2007. Dependency-based construction of semantic space models. Computational Linguistics, 33(2): 161–199. [Plate1995] Tony Plate. 1995. Holographic reduced representations. IEEE Transactions on Neural Networks, 6(3):623–641. [Post1946] Emil L. Post. 1946. A variant of a recursively unsolvable problem. Bulletin of the American Mathematical Society, 52:264–268. [Rendle et al.2009] Steffen Rendle, Leandro Balby Marinho, Alexandros Nanopoulos, and Lars Schmidt-Thieme. 2009. Learning optimal ranking with tensor factorization for tag recommendation. In John F. Elder IV, Françoise Fogelman-Soulié, Peter A. Flach, and Mohammed Javeed Zaki, editors, KDD, pages 727–736. ACM. [Sahlgren et al.2008] Magnus Sahlgren, Anders Holst, and Pentti Kanerva. 2008. Permutations as a means to encode order in word space. In Proc. CogSci’08, pages 1300–1305. [Salton et al. 1975] Gerard Salton, Anita Wong, and Chung-Shu Yang. 1975. A vector space model for automatic indexing. Commun. ACM, 18(1 1):613– 620. [Schütze1993] Hinrich Schütze. 1993. Word space. In Lee C. Giles, Stephen J. Hanson, and Jack D. Cowan, editors, Advances in Neural Information Processing Systems 5, pages 895–902. MorganKaufmann. [Strang1993] Gilbert Strang. 1993. Introduction to Linear Algebra. Wellesley-Cambridge Press. [Tucker1966] Ledyard R. Tucker. 1966. Some mathematical notes on three-mode factor analysis. Psychometrika, 3 1(3). [Widdows2008] Dominic Widdows. 2008. Semantic vector products: some initial investigations. In Proceedings of the Second AAAI Symposium on Quantum Interaction. 916