acl acl2011 acl2011-21 acl2011-21-reference knowledge-graph by maker-knowledge-mining

21 acl-2011-A Pilot Study of Opinion Summarization in Conversations


Source: pdf

Author: Dong Wang ; Yang Liu

Abstract: This paper presents a pilot study of opinion summarization on conversations. We create a corpus containing extractive and abstractive summaries of speaker’s opinion towards a given topic using 88 telephone conversations. We adopt two methods to perform extractive summarization. The first one is a sentence-ranking method that linearly combines scores measured from different aspects including topic relevance, subjectivity, and sentence importance. The second one is a graph-based method, which incorporates topic and sentiment information, as well as additional information about sentence-to-sentence relations extracted based on dialogue structure. Our evaluation results show that both methods significantly outperform the baseline approach that extracts the longest utterances. In particular, we find that incorporating dialogue structure in the graph-based method contributes to the improved system performance.


reference text

Alexandra Balahur, Ester Boldrini, Andr e´s Montoyo, and Patricio Mart ı´nez-Barco. 2010. Going beyond traditional QA systems: challenges and keys in opinion question answering. In Proceedings of COLING. G u¨nes Erkan and Dragomir R. Radev. 2004. LexRank: graph-based lexical centrality as salience in text summarization. Journal of Artificial Intelligence Research. Sadaoki Furui, Tomonori Kikuchi, Yousuke Shinnaka, and Chior iHori. 2004. Speech-to-text and speech-tospeech summarization of spontaneous speech. IEEE Transactions on Audio, Speech & Language Processing, 12(4):401–408. Nikhil Garg, Benoit Favre, Korbinian Reidhammer, and Dilek Hakkani T u¨r. 2009. ClusterRank: a graph based method for meeting summarization. In Proceedings of Interspeech. Dan Gillick, Korbinian Riedhammer, Benoit Favre, and Dilek Hakkani-Tur. 2009. A global optimization framework for meeting summarization. In Proceedings of ICASSP. John J. Godfrey and Edward Holliman. 1997. Switchboard-1 Release 2. In Linguistic Data Consortium, Philadelphia. Andrew Hayes and Klaus Krippendorff. 2007. Answering the call for a standard reliability measure for coding data. Journal of Communication Methods and Measures, 1:77–89. Minqing Hu and Bing Liu. 2004. Mining and summarizing customer reviews. In Proceedings of ACM SIGKDD. Konstantinos Koumpis and Steve Renals. 2005. Auto- matic summarization of voicemail messages using lexical and prosodic features. ACM - Transactions on Speech and Language Processing. Shih Hsiang Lin, Berlin Chen, and Hsin min Wang. 2009. A comparative study of probabilistic ranking models for chinese spoken document summarization. ACM Transactions on Asian Language Information Processing, 8(1). Chin-Yew Lin. 2004. ROUGE: a package for automatic evaluation ofsummaries. In Proceedings ofACL workshop on Text Summarization Branches Out. Fei Liu and Yang Liu. 2008. What are meeting summaries? An analysis of human extractive summaries in meeting corpus. In Proceedings of SIGDial. Sameer Maskey and Julia Hirschberg. 2005. Comparing lexical, acoustic/prosodic, structural and discourse features for speech summarization. In Proceedings of Interspeech. Kathleen Mckeown, Julia Hirschberg, Michel Galley, and Sameer Maskey. 2005. From text to speech summarization. In Proceedings of ICASSP. Gabriel Murray and Giuseppe Carenini. 2009. Detecting subjectivity in multiparty speech. In Proceedings of Interspeech. Gabriel Murray, Steve Renals, and Jean Carletta. 2005. Extractive summarization of meeting recordings. In Proceedings of EUROSPEECH. Vincent Ng, Sajib Dasgupta, and S.M.Niaz Arifin. 2006. Examining the role of linguistic knowledge sources in 339 the automatic identification and classification of reviews. In Proceedings of the COLING/ACL. Hitoshi Nishikawa, Takaaki Hasegawa, Yoshihiro Matsuo, and Genichiro Kikui. 2010. Opinion summarization with integer linear programming formulation for sentence extraction and ordering. In Proceedings of COLING. Bo Pang and Lilian Lee. 2004. A sentiment education: sentiment analysis using subjectivity summarization based on minimum cuts. In Proceedings of ACL. Michael Paul, ChengXiang Zhai, and Roxana Girju. 2010. Summarizing contrastive viewpoints in opinionated text. In Proceedings of EMNLP. Ana-Maria Popescu and Oren Etzioni. 2005. Extracting product features and opinions from reviews. In Proceedings of HLT-EMNLP. Stephan Raaijmakers, Khiet Truong, and Theresa Wilson. 2008. Multimodal subjectivity analysis of multiparty conversation. In Proceedings of EMNLP. Veselin Stoyanov, Claire Cardie, and Janyce Wiebe. 2005. Multi-perspective question answering using the OpQA corpus. In Proceedings of EMNLP/HLT. Janyce Wiebe and Ellen Riloff. 2005. Creating subjective and objective sentence classifiers from unan- notated texts. In Proceedings of CICLing. Theresa Wilson and Janyce Wiebe. 2003. Annotating opinions in the world press. In Proceedings of SIGDial. Theresa Wilson. 2008a. Annotating subjective content in meetings. In Proceedings of LREC. Theresa Wilson. 2008b. Fine-grained subjectivity and sentiment analysis: recognizing the intensity, polarity, and attitudes of private states. Ph.D. thesis, University of Pittsburgh. Shasha Xie and Yang Liu. 2010. Improving supervised learning for meeting summarization using sampling and regression. Computer Speech and Language, 24:495–514. Klaus Zechner. 2002. Automatic summarization of open-domain multiparty dialogues in dive rse genres. Computational Linguistics, 28:447–485. Justin Jian Zhang, Ho Yin Chan, and Pascale Fung. 2007. Improving lecture speech summarization using rhetorical information. In Proceedings of Biannual IEEE Workshop on ASRU. Lin Zhao, Lide Wu, and Xuanjing Huang. 2009. Using query expansion in graph-based approach for queryfocused multi-document summarization. Journal of Information Processing and Management. Xiaodan Zhu and Gerald Penn. 2006. Summarization of spontaneous conversations. In Proceedings of Interspeech.