acl acl2011 acl2011-54 acl2011-54-reference knowledge-graph by maker-knowledge-mining

54 acl-2011-Automatically Extracting Polarity-Bearing Topics for Cross-Domain Sentiment Classification


Source: pdf

Author: Yulan He ; Chenghua Lin ; Harith Alani

Abstract: Joint sentiment-topic (JST) model was previously proposed to detect sentiment and topic simultaneously from text. The only supervision required by JST model learning is domain-independent polarity word priors. In this paper, we modify the JST model by incorporating word polarity priors through modifying the topic-word Dirichlet priors. We study the polarity-bearing topics extracted by JST and show that by augmenting the original feature space with polarity-bearing topics, the in-domain supervised classifiers learned from augmented feature representation achieve the state-of-the-art performance of 95% on the movie review data and an average of 90% on the multi-domain sentiment dataset. Furthermore, using feature augmentation and selection according to the information gain criteria for cross-domain sentiment classification, our proposed approach performs either better or comparably compared to previous approaches. Nevertheless, our approach is much simpler and does not require difficult parameter tuning.


reference text

R.K. Ando and T. Zhang. 2005. A framework for learning predictive structures from multiple tasks and unlabeled data. The Journal of Machine Learning Research, 6: 1817–1853. A. Aue and M. Gamon. 2005. Customizing sentiment classifiers to new domains: a case study. In Proceedings ofRecentAdvances in Natural Language Processing (RANLP). David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet allocation. J. Mach. Learn. Res., 3:993–1022. J. Blitzer, M. Dredze, and F. Pereira. 2007. Biographies, bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification. In ACL, page 440– 447. C. Chelba and A. Acero. 2004. Adaptation of maximum entropy classifier: Little data can help a lot. In EMNLP. W. Dai, Y. Chen, G.R. Xue, Q. Yang, and Y. Yu. 2008. Translated learning: Transfer learning across different feature spaces. In NIPS, pages 353–360. W. Dai, O. Jin, G.R. Xue, Q. Yang, and Y. Yu. 2009. Eigentransfer: a unified framework for transfer learning. In ICML, pages 193–200. H. Daum e´ III and D. Marcu. 2006. Domain adaptation for statistical classifiers. Journal of Artificial Intelligence Research, 26(1): 101–126. H. Daum e´. 2007. Frustratingly easy domain adaptation. In ACL, pages 256–263. J. Jiang and C.X. Zhai. 2007. Instance weighting for domain adaptation in NLP. In ACL, pages 264–271. A. Kennedy and D. Inkpen. 2006. Sentiment clas- sification of movie reviews using contextual valence shifters. Computational Intelligence, 22(2): 110–125. S. Li, C.R. Huang, G. Zhou, and S.Y.M. Lee. 2010. Employing personal/impersonal views in supervised and semi-supervised sentiment classification. In ACL, pages 414–423. C. Lin and Y. He. 2009. Joint sentiment/topic model for sentiment analysis. In Proceedings of the 18th ACM international conference on Information and knowledge management (CIKM), pages 375–384. C. Lin, Y. He, and R. Everson. 2010. A Comparative Study of Bayesian Models for Unsupervised Sentiment Detection. In Proceedings of the 14th Conference on Computational Natural Language Learning (CoNLL), pages 144–152. Ryan McDonald, Kerry Hannan, Tyler Neylon, Mike Wells, and Jeff Reynar. 2007. Structured models for fine-to-coarse sentiment analysis. In ACL, pages 432– 439. T. Minka. 2003. Estimating a Dirichlet distribution. Technical report. S.J. Pan, X. Ni, J.T. Sun, Q. Yang, and Z. Chen. 2010. Cross-domain sentiment classification via spectral feature alignment. In Proceedings of the 19th international conference on World Wide Web (WWW), pages 751–760. Bo Pang and Lillian Lee. 2004. A sentimental education: sentiment analysis using subjectivity summariza- tion based on minimum cuts. In ACL, page 271–278. 131 Bo Pang, Lillian Lee, and Shivakumar Vaithyanathan. 2002. Thumbs up?: sentiment classification using machine learning techniques. In EMNLP, pages 79–86. B. Roark and M. Bacchiani. 2003. Supervised and unsupervised PCFG adaptation to novel domains. In NAACL-HLT, pages 126–133. C.W. Seah, I. Tsang, Y.S. Ong, and K.K. Lee. 2010. Predictive Distribution Matching SVM for Multi-domain Learning. In ECML-PKDD, pages 231–247. Casey Whitelaw, Navendu Garg, and Shlomo Argamon. 2005. Using appraisal groups for sentiment analysis. In Proceedings of the ACM international conference on Information and Knowledge Management (CIKM), pages 625–63 1. Q. Wu, S. Tan, and X. Cheng. 2009. Graph ranking for sentiment transfer. In ACL-IJCNLP, pages 3 17–320. Q. Wu, S. Tan, X. Cheng, and M. Duan. 2010. MIEA: a Mutual Iterative Enhancement Approach for CrossDomain Sentiment Classification. In COLING, page 1327-1335. A. Yessenalina, Y. Choi, and C. Cardie. 2010a. Automatically generating annotator rationales to improve sentiment classification. In ACL, pages 336–341. A. Yessenalina, Y. Yue, and C. Cardie. 2010b. MultiLevel Structured Models for Document-Level Senti- ment Classification. In EMNLP, pages 1046–1056. Jun Zhao, Kang Liu, and Gen Wang. 2008. Adding redundant features for CRFs-based sentence sentiment classification. In EMNLP, pages 117–126.