acl acl2012 acl2012-77 acl2012-77-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Marco Guerini ; Carlo Strapparava ; Oliviero Stock
Abstract: In recent years there has been a growing interest in crowdsourcing methodologies to be used in experimental research for NLP tasks. In particular, evaluation of systems and theories about persuasion is difficult to accommodate within existing frameworks. In this paper we present a new cheap and fast methodology that allows fast experiment building and evaluation with fully-automated analysis at a low cost. The central idea is exploiting existing commercial tools for advertising on the web, such as Google AdWords, to measure message impact in an ecological setting. The paper includes a description of the approach, tips for how to use AdWords for scientific research, and results of pilot experiments on the impact of affective text variations which confirm the effectiveness of the approach.
methods in natural language generation, pages 242– PS.Atspghoeunrcmadspilenotgwhsfiadlu,DvenSo.rsaclhIWeMCnupoialPmrsknedopurtca.wnhe2dot0imrD,k1enpsa0gui.ltIodeCnLr:gMifPuAeta.ho,Dlipcnrseag9tiuBdheson.Sfcmg1Ii3aGrsz8l2eod–cfu0i1atnl4h8We7rm.ia3goAlt1erskdhn-fS.oWtTA2ie6phx3nt.,rmfeSophaNnrcCAgitdeofsman8rtLpd-9Vu–HAceanL.or7tCliT,vgy2Le.sa0oril1d AtnWo.g2uGare0ikls1tnhg,co.erpCGatAin,eIJCruoafPtmiEn.pguAcsoeahtidfnga-sl Annual International Conference on Information Systems. T. Brants and A. Franz. 2006. Web 1t 5-gram corpus version 1.1. Linguistic Data Consortium. BJ Fogg. 2009. Creating persuasive technologies: An eight-step design process. Proceedings of the 4th International Conference on Persuasive Technology. M. Guerini, O. Stock, and C. Strapparava. 2008. Valentino: A tool for valence shifting of natural language texts. In Proceedings of LREC 2008, Marrakech, Morocco. M. Guerini, C. Strapparava, and O. Stock. 2010. Evaluation metrics for persuasive nlp with google adwords. In Proceedings of LREC-2010. M. Guerini, O. Stock, M. Zancanaro, D.J. O’Keefe, I. Mazzotta, F. Rosis, I. Poggi, M.Y. Lim, and R. Aylett. 2011a. Approaches to verbal persuasion in intelligent user interfaces. Emotion-Oriented Systems, pages 559–584. M. Guerini, C. Strapparava, and O. Stock. 2011b. Slanting existing text with Valentino. In Proceedings of the 16th international conference on Intelligent user interfaces, pages 439–440. ACM. S.C. Levinson. 1983. Pragmatics. Cambridge University Press. W. Mason and S. Suri. 2010. Conducting behavioral research on amazon’s mechanical turk. Behavior Research Methods, pages 1–23. M. Negri, L. Bentivogli, Y. Mehdad, D. Giampiccolo, and A. Marchetti. 2010. Divide and conquer: Crowdsourcing the creation of cross-lingual textual entailment corpora. Proc. of EMNLP 2011. E. Reiter, R. Robertson, and L. Osman. 2003. Lesson from a failure: Generating tailored smoking cessation letters. Artificial Intelligence, 144:41–58. R. Snow, B. O’Connor, D. Jurafsky, and A.Y. Ng. 2008. Cheap and fast—but is it good?: evaluating non-expert annotations for natural language tasks. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 254–263. Association for Computational Linguistics. I. Van Der Sluis and C. Mellish. 2010. Towards empirical evaluation of affective tactical nlg. In Empirical 996