acl acl2010 acl2010-227 acl2010-227-reference knowledge-graph by maker-knowledge-mining

227 acl-2010-The Impact of Interpretation Problems on Tutorial Dialogue


Source: pdf

Author: Myroslava O. Dzikovska ; Johanna D. Moore ; Natalie Steinhauser ; Gwendolyn Campbell

Abstract: Supporting natural language input may improve learning in intelligent tutoring systems. However, interpretation errors are unavoidable and require an effective recovery policy. We describe an evaluation of an error recovery policy in the BEETLE II tutorial dialogue system and discuss how different types of interpretation problems affect learning gain and user satisfaction. In particular, the problems arising from student use of non-standard terminology appear to have negative consequences. We argue that existing strategies for dealing with terminology problems are insufficient and that improving such strategies is important in future ITS research.


reference text

V. Aleven, O. Popescu, and K. R. Koedinger. 2001. Towards tutorial dialog to support self-explanation: Adding natural language understanding to a cognitive tutor. In Proceedings of the 10th International Conference on Artificial Intelligence in Education (AIED ’01) ”. Dan Bohus and Alexander Rudnicky. 2005. Sorry, Ididn’t catch that! - An investigation of nonunderstanding errors and recovery strategies. In Proceedings of SIGdial-2005, Lisbon, Portugal. Michelene T. H. Chi, Nicholas de Leeuw, Mei-Hung Chiu, and Christian LaVancher. 1994. Eliciting self-explanations improves understanding. Cognitive Science, 18(3):439–477. Myroslava O. Dzikovska, Gwendolyn E. Campbell, Charles B. Callaway, Natalie B. Steinhauser, Elaine Farrow, Johanna D. Moore, Leslie A. Butler, and Colin Matheson. 2008. Diagnosing natural language answers to support adaptive tutoring. In Proceedings 21st International FLAIRS Conference, Coconut Grove, Florida, May. Myroslava O. Dzikovska, Charles B. Callaway, Elaine Farrow, Johanna D. Moore, Natalie B. Steinhauser, and Gwendolyn C. Campbell. 2009. Dealing with interpretation errors in tutorial dialogue. In Pro- ceedings of SIGDIAL-09, London, UK, Sep. Myroslava O. Dzikovska, Johanna D. Moore, Natalie Steinhauser, Gwendolyn Campbell, Elaine Farrow, and Charles B. Callaway. 2010. Beetle II: a system for tutoring and computational linguistics experimentation. In Proceedings of ACL-2010 demo session. A. C. Graesser, P. Wiemer-Hastings, P. WiemerHastings, and R. Kreuz. 1999. Autotutor: A simulation of a human tutor. Cognitive Systems Research, 1:35–51. Beth Ann Hockey, Oliver Lemon, Ellen Campana, Laura Hiatt, Gregory Aist, James Hieronymus, Alexander Gruenstein, and John Dowding. 2003. Targeted help for spoken dialogue systems: intelligent feedback improves naive users’ performance. In Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics, pages 147–154, Morristown, NJ, USA. Pamela W. Jordan, Maxim Makatchev, and Kurt VanLehn. 2004. Combining competing language understanding approaches in an intelligent tutoring system. In James C. Lester, Rosa Maria Vicari, and F a´bio Paragua ¸cu, editors, Intelligent Tutoring Systems, volume 3220 of Lecture Notes in Computer Science, pages 346–357. Springer. Pamela Jordan, Maxim Makatchev, Umarani Pappuswamy, Kurt VanLehn, and Patricia Albacete. 2006. A natural language tutorial dialogue system for physics. In Proceedings ofthe 19th International FLAIRS conference. Pamela Jordan, Diane Litman, Michael Lipschultz, and Joanna Drummond. 2009. Evidence of misunderstandings in tutorial dialogue and their impact on learning. In Proceedings of the 14th International Conference on Artificial Intelligence in Education (AIED), Brighton, UK, July. Diane Litman and Kate Forbes-Riley. 2005. Speech recognition performance and learning in spoken dialogue tutoring. In Proceedings of EUROSPEECH2005, page 1427. Diane Litman, Johanna Moore, Myroslava Dzikovska, and Elaine Farrow. 2009. Generalizing tutorial dialogue results. In Proceedings of 14th International Conference on Artificial Intelligence in Education (AIED), Brighton, UK, July. Philip M. McCarthy, Vasile Rus, Scott Crossley, Arthur C. Graesser, and Danielle S. McNamara. 2008. Assessing forward-, reverse-, and averageentailment indeces on natural language input from the intelligent tutoring system, iSTART. In Proceed- ings of the 21st International FLAIRS conference, pages 165–170. Rodney D. Nielsen, Wayne Ward, and James H. Martin. 2008. Learning to assess low-level conceptual understanding. In Proceedings 21st International FLAIRS Conference, Coconut Grove, Florida, May. Heather Pon-Barry, Brady Clark, Elizabeth Owen Bratt, Karl Schultz, and Stanley Peters. 2004. Evaluating the effectiveness of SCoT: A spoken conversational tutor. In J. Mostow and P. Tedesco, editors, Proceedings of the ITS 2004 Workshop on Dialogbased Intelligent Tutoring Systems, pages 23–32. Amruta Purandare and Diane Litman. 2008. Contentlearning correlations in spoken tutoring dialogs at word, turn and discourse levels. In Proceedings 21st International FLAIRS Conference, Coconut Grove, Florida, May. 48