acl acl2011 acl2011-55 acl2011-55-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Wenting Xiong ; Diane Litman
Abstract: Identifying peer-review helpfulness is an important task for improving the quality of feedback that students receive from their peers. As a first step towards enhancing existing peerreview systems with new functionality based on helpfulness detection, we examine whether standard product review analysis techniques also apply to our new context of peer reviews. In addition, we investigate the utility of incorporating additional specialized features tailored to peer review. Our preliminary results show that the structural features, review unigrams and meta-data combined are useful in modeling the helpfulness of both peer reviews and product reviews, while peer-review specific auxiliary features can further improve helpfulness prediction.
Yigal Attali and Jill Burstein. 2006. Automated essay scoring with e-rater v.2. In Michael Russell, editor, The Journal of Technology, Learning and Assessment (JTLA), volume 4, February. Kwangsu Cho and Christian D. Schunn. 2007. Scaffolded writing and rewriting in the discipline: A webbased reciprocal peer review system. In Computers and Education, volume 48, pages 409–426. Kwangsu Cho. 2008. Machine classification of peer comments in physics. In Proceedings of the First International Conference on Educational Data Mining (EDM2008), pages 192–196. Cristian Danescu-Niculescu-Mizil, Gueorgi Kossinets, Jon Kleinber g, and Lillian Lee. 2009. How opinions are received by online communities: A case study on Amazon .com helpfulness votes. In Proceedings of WWW, pages 141–150. Raquel M. Crespo Garcia. 2010. Exploring document clustering techniques for personalized peer assessment in exploratory courses. In Proceedings of ComputerSupported Peer Review in Education (CSPRED) Workshop in the Tenth International Conference on Intelligent Tutoring Systems (ITS 2010). Anindya Ghose and Panagiotis G. Ipeirotis. 2010. Estimating the helpfulness and economic impact of prod- uct reviews: Mining text and reviewer characteristics. In IEEE Transactions on Knowledge and Data Engineering, volume 99, Los Alamitos, CA, USA. IEEE Computer Society. Thorsten Joachims. 1999. Making large-scale SVM learning practical. In B. Sch o¨lkopf, C. Burges, and A. Smola, editors, Advances in Kernel Methods - Support Vector Learning. MIT Press, Cambridge, MA, USA. Soo-Min Kim, Patrick Pantel, Tim Chklovski, and Marco Pennacchiotti. 2006. Automatically assessing review helpfulness. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing (EMNLP2006), pages 423–430, Sydney, Australia, July. Chin-Yew Lin and Eduard Hovy. 2000. The automated acquisition of topic signatures for text summarization. In Proceedings of the 18th conference on Computational linguistics, volume 1 of COLING ’00, pages 495–501, Stroudsburg, PA, USA. Association for Computational Linguistics. Yang Liu, Xiangji Guang, Aijun An, and Xiaohui Yu. 2008. Modeling and predicting the helpfulness of online reviews. In Proceedings of the Eighth IEEE International Conference on Data Mining, pages 443–452, Los Alamitos, CA, USA. 507 Ryan McDonald, Koby Crammer, and Fernando Pereira. 2005. Online large-margin training of dependency parsers. In Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, ACL ’05, pages 91–98, Stroudsburg, PA, USA. Association for Computational Linguistics. Melissa M. Nelson and Christian D. Schunn. 2009. The nature of feedback: how different types of peer feedback affect writing performance. In Instructional Science, volume 37, pages 375–401. Melissa M. Patchan, Davida Charney, and Christian D. Schunn. 2009. A validation study of students’ end comments: Comparing comments by students, a writing instructor, and a content instructor. In Journal of Writing Research, volume 1, pages 124–152. University of Antwerp. Agnes Sandor and Angela Vorndran. 2009. Detecting key sentences for automatic assistance in peerreviewing research articles in educational sciences. In Proceedings of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing (ACL-IJCNLP), pages 36–44. Oren Tsur and Ari Rappoport. 2009. Revrank: A fully unsupervised algorithm for selecting the most helpful book reviews. In Proceedings of the Third Interna- tional AAAI Conference on Weblogs and Social Media (ICWSM2009), pages 36–44. Wenting Xiong and Diane J. Litman. 2010. Identifying problem localization in peer-review feedback. In Proceedings of Tenth International Conference on Intelligent Tutoring Systems (ITS2010), volume 6095, pages 429–431. Wenting Xiong, Diane J. Litman, and Christian D. Schunn. 2010. Assessing reviewers performance based on mining problem localization in peer-review data. In Proceedings of the Third International Conference on Educational Data Mining (EDM2010), pages 211–220.