emnlp emnlp2013 emnlp2013-185 emnlp2013-185-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Rui Fang ; Changsong Liu ; Lanbo She ; Joyce Y. Chai
Abstract: In situated dialogue, humans and agents have mismatched capabilities of perceiving the shared environment. Their representations of the shared world are misaligned. Thus referring expression generation (REG) will need to take this discrepancy into consideration. To address this issue, we developed a hypergraph-based approach to account for group-based spatial relations and uncertainties in perceiving the environment. Our empirical results have shown that this approach outperforms a previous graph-based approach with an absolute gain of 9%. However, while these graph-based approaches perform effectively when the agent has perfect knowledge or perception of the environment (e.g., 84%), they perform rather poorly when the agent has imperfect perception of the environment (e.g., 45%). This big performance gap calls for new solutions to REG that can mediate a shared perceptual basis in situated dialogue.
Anja Arts, Alfons Maes, Leo Noordman, and Carel Jansen. 2011. Overspecification facilitates object identification. Journal of Pragmatics, 43(1):361–374. E. Belke and A. S. Meyer. 2002. Tracking the time course of multidimensional stimulus discrimination: Analyses of viewing patterns and processing times during ”same”-”different” decisions. European Journal of Cognitive Psychology, 14(2):237–266. H.H. Clark and S.E. Brennan. 1991 . Grounding in communication. Perspectives on socially shared cognition, 13: 127–149. H. H Clark and D Wilkes-Gibbs. 1986. Referring as a collaborative process. Cognition, 22: 1–39. Madalina Croitoru and Kees Van Deemter. 2007. A conceptual graph approach to the generation of referring expressions. In Proceedings of the 20th international joint conference on Artifical intelligence, IJCAI’07, pages 2456–2461. Robert Dale. 1989. Cooking up referring expressions. In Proceedings of the 27th annual meeting on Association for Computational Linguistics, ACL ’89, pages 68–75, Stroudsburg, PA, USA. Association for Computational Linguistics. Robert Dale. 1992. Generating Referring Expressions: Constructing Descriptions in a Domain of Objects and Processes. The MIT Press,Cambridge, Massachusetts. Robert Dale. 1995. Computational interpretations of the gricean maxims in the generation of referring expressions. Cognitive Science, 19:233–263. Sheel Sanjay Dhande. 2003. A computational model to connect gestalt perception and natural language. In Masters thesis, Massachusetts Institure of Technology. Philip G. Edmonds. 1994. Collaboration on reference to objects that are not mutually known. In Proceedings of the 15th conference on Computational linguistics Volume 2, COLING ’94, pages 1118–1 122, Stroudsburg, PA, USA. Association for Computational Linguistics. Kotaro Funakoshi, Satoru Watanabe, Naoko Kuriyama, and Takenobu Tokunaga. 2004. Generation of relative referring expressions based on perceptual grouping. In COLING. Kotaro Funakoshi, Satoru Watanabe, and Takenobu Tokunaga. 2006. Group-based generation of referring expressions. In INLG, pages 73–80. Giorgio Gallo, Giustino Longo, Stefano Pallottino, and Sang Nguyen. 1993. Directed hypergraphs and applications. Discrete applied mathematics, 42(2): 177– 201. Albert Gatt and Anja Belz. 2008. Attribute selection for referring expression generation: new algorithms and evaluation methods. In Proceedings of the Fifth InternationalNatural Language Generation Conference, INLG ’08, pages 50–58, Stroudsburg, PA, USA. Association for Computational Linguistics. Albert Gatt, Ielka van der Sluis, and Kees van Deemter. 2007. Evaluating algorithms for the generation of referring expressions using a balanced corpus. In Proceedings of the Eleventh European Workshop on Natural Language Generation, ENLG ’07, pages 49–56, Stroudsburg, PA, USA. Association for Computational Linguistics. Albert Gatt, Anja Belz, and Eric Kow. 2009. The tunareg challenge 2009: overview and evaluation results. In Proceedings of the 12th European Workshop on 401 Natural Language Generation, ENLG ’09, pages 174– 182, Stroudsburg, PA, USA. Association for Computational Linguistics. Albert Gatt. 2006. Structuring knowledge for reference generation: A clustering algorithm. In Proceedings of the 11th Conference of the European Chapter of the Association for Computational Linguistics, Association for Computational Linguistics, pages 321–328. Dave Golland, Percy Liang, and Dan Klein. 2010. A game-theoretic approach to generating spatial descriptions. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, EMNLP ’ 10, pages 410–419, Stroudsburg, PA, USA. Association for Computational Linguistics. Peter Gorniak and Deb Roy. 2004. Grounded semantic composition for visual scenes. Journal of Artificial Intelligence Research, 21:429–470. Stevan Harnad. 1990. The symbol grounding problem. Physica D, 42:335–346. Peter A. Heeman and Graeme Hirst. 1995. Collaborating on referring expressions. Computational Linguistics, 21:351–382. Helmut Horacek. 2005. Generating referential descriptions under conditions of uncertainty. In Proceedings of the 10th European Workshop on Natural Language Generation (ENLG) pages 58-67, Aberdeen, UK. Pamela W Jordan and Marilyn Walker. 2000. Learning attribute selections for non-pronominal expressions. In Proceedings of the 38th Annual Meeting on Association for Computational Linguistics, pages 181-190. John D. Kelleher and Geert-Jan M. Kruijff. 2006. Incremental generation of spatial referring expressions in situated dialog. In Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics, ACL-44, pages 1041–1048, Stroudsburg, PA, USA. Association for Computational Linguistics. Emiel Krahmer and Kees Van Deemter. 2012. Computational generation of referring expressions: A survey. computational linguistics, 38(1): 173–218. Emiel Krahmer Krahmer, Sebastiaan van Erk, and Andr e´ Verleg. 2003. Graph-based generation of referring expressions. Computational Linguistics, 29(1):53–72, March. Emiel Krahmer, Mariet Theune, Jette Viethen, and Iris Hendrickx. 2008. Graph: The costs of redundancy in referring expressions. In In Proceedings of the 5th International Conference on Natural Language Generation, Salt Fork OH, USA. Changsong Liu, Rui Fang, and Joyce Y. Chai. 2012. Towards mediating shared perceptual basis in situated dialogue. In Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL ’ 12, pages 140–149, Stroudsburg, PA, USA. Association for Computational Linguistics. Changsong Liu, Rui Fang, Lanbo She, and Joyce Y. Chai. 2013. Modeling collaborative referring for situated referential grounding. In The 14th Annual SIGdial Meeting on Discourse and Dialogue. Margaret Mitchell, Kees van Deemter, and Ehud Reiter. 2011. Two approaches for generating size modifiers. In Proceedings of the 13th European Workshop on Natural Language Generation, ENLG ’ 11, pages 63– 70, Stroudsburg, PA, USA. Association for Computational Linguistics. Margaret Mitchell, Kees van Deemter, and Ehud Reiter. 2013. Generating expressions that refer to visible objects. In Proceedings of NAACL-HLT 2013, pages 1174-1184. Aleksandra Mojsilovic. 2005. A computational model for color naming and describing color composition of images. IEEE Transactions on Image Processing, 14:690 699. Terry Regier. 1996. The human semantic potential. The MIT Press,Cambridge, Massachusetts. Deb Roy. 2002. Learning visually grounded words and syntax of natural spoken language. Evolution of Communication, 4. Alexander Siebert and David Schlangen. 2008. A simple method for resolution of definite reference in a shared visual context. In Proceedings of the 9th SIG– dial Workshop on Discourse and Dialogue, SIGdial ’08, pages 84–87, Stroudsburg, PA, USA. Association for Computational Linguistics. Robert Sternberg. 2003. Cognitive Psychology,Third Edition. Thomson Wadsworth. Kristina Striegnitz, Hendrik Buschmeier, and Stefan Kopp. 2012. Referring in installments: a corpus study of spoken object references in an interactive virtual environment. In Proceedings of the Seventh International Natural Language Generation Conference, INLG ’ 12, pages 12–16, Stroudsburg, PA, USA. Association for Computational Linguistics. Thora Tenbrink and Reinhard Moratz. 2003. Groupbased spatial reference in linguistic human-robot interaction. Spatial Cognition and Computation, 6:63– 106. Mari e¨t Theune, Pascal Touset, Jette Viethen, and Emiel Krahmer. 2007. Cost-based attribute selection for gre (graph-sc/graph-fp). In Proceedings of the MT Summit XI Workshop on Using Corpora for NLG: Language Generation and Machine Translation (UCNLG+MT). Mari e¨t Theune, Ruud Koolen, Emiel Krahmer, and Sander Wubben. 2011. Does size matter – how much 402 data is required to train a reg algorithm? In Proceedings of the 49th Annual Meeting of the Associa- tion for Computational Linguistics: Human Language Technologies, pages 660–664, Portland, Oregon, USA, June. Association for Computational Linguistics. Kristinn R. Thrisson. 1994. Simulated perceptual grouping: An application to human-computer interaction. In Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society, pages 876–881. Jette Viethen and Robert Dale. 2008. The use of spatial relations in referring expression generation. In Proceedings of the Fifth International Natural Language Generation Conference, INLG ’08, pages 59– 67, Stroudsburg, PA, USA. Association for Computational Linguistics. S. Weijers. 2011. Referring expressions with groups as landmarks. volume 15. University of Twente. Max Wertheimer. 1938. Laws of organization in perceptual forms. A Source Book of Gestalt Psychology. Routledge and Kegan Paul, London. Dengsheng Zhang and Guojun Lu. 2002. An integrated approach to shape based image retrieval. In Proc. of 5th Asian Conference on Computer Vision (ACCV, pages 652–657.