andrew_gelman_stats andrew_gelman_stats-2010 andrew_gelman_stats-2010-108 knowledge-graph by maker-knowledge-mining

108 andrew gelman stats-2010-06-24-Sometimes the raw numbers are better than a percentage


meta infos for this blog

Source: html

Introduction: A NY Times Environment blog entry summarizes an article in Proceedings of the National Academy of Sciences that looks into whether there really is a “scientific consensus” that humans are substantially changing the climate. There is. That’s pretty much “dog bites man” as far as news is concerned. But although the results of the study don’t seem noteworthy, I was struck by this paragraph in the blog writeup, which is pretty much a quote of the PNAS article: For example, of the top 50 climate researchers identified by the study (as ranked by the number of papers they had published), only 2 percent fell into the camp of climate dissenters. Of the top 200 researchers, only 2.5 percent fell into the dissenter camp. That is consistent with past work, including opinion polls, suggesting that 97 to 98 percent of working climate scientists accept the evidence for human-induced climate change. Two percent of the top 50, that’s one person. And 2.5 percent of the top 200, that’s five


Summary: the most important sentenses genereted by tfidf model

sentIndex sentText sentNum sentScore

1 A NY Times Environment blog entry summarizes an article in Proceedings of the National Academy of Sciences that looks into whether there really is a “scientific consensus” that humans are substantially changing the climate. [sent-1, score-0.388]

2 That’s pretty much “dog bites man” as far as news is concerned. [sent-3, score-0.21]

3 That is consistent with past work, including opinion polls, suggesting that 97 to 98 percent of working climate scientists accept the evidence for human-induced climate change. [sent-7, score-1.095]

4 As a general rule, when the numerator in count data is very small, or when the denominator is fairly small, I prefer to see the numerator and denominator separately rather than a percentage. [sent-11, score-0.986]

5 If someone says “this guy has been making more than 80% of his free throws this post season,” I want to know if that is 6/7 or 17/20. [sent-12, score-0.253]

6 So I think they should say 1/50 and 5/200, rather than 2% of the top 50 and 2. [sent-13, score-0.374]

7 Yes, I understand these are mathematically identical, but I betcha a lot of people see “2% of 50″ and don’t realize that’s one person, even though they’d realize it if they thought about it for just a second. [sent-15, score-0.379]

8 By the way, one guy (I assume it’s a guy, most of them are guys) has over 850 climate-related publications. [sent-16, score-0.214]

9 Fourteen people have over 500 publications each (one of these is the “dissenter” among the top 50). [sent-17, score-0.447]

10 Andrew might attain this sort of level if he keeps up as his current rate, but for most of the rest of us this is ridiculous. [sent-19, score-0.194]

11 Quite a selection effect, too: it’d be pretty much impossible to be considered as one of their “top 50″ climate experts if you are under 45 years old. [sent-20, score-0.594]


similar blogs computed by tfidf model

tfidf for this blog:

wordName wordTfidf (topN-words)

[('top', 0.374), ('climate', 0.369), ('percent', 0.286), ('dissenter', 0.276), ('numerator', 0.207), ('fell', 0.177), ('denominator', 0.175), ('guy', 0.152), ('attain', 0.118), ('bites', 0.118), ('realize', 0.118), ('fourteen', 0.113), ('noteworthy', 0.113), ('writeup', 0.113), ('camp', 0.106), ('dog', 0.101), ('summarizes', 0.101), ('throws', 0.101), ('ranked', 0.099), ('proceedings', 0.097), ('academy', 0.094), ('pnas', 0.092), ('pretty', 0.092), ('ny', 0.091), ('season', 0.089), ('mathematically', 0.081), ('substantially', 0.079), ('separately', 0.079), ('struck', 0.079), ('consensus', 0.078), ('humans', 0.078), ('keeps', 0.076), ('researchers', 0.076), ('identical', 0.075), ('small', 0.075), ('publications', 0.073), ('fairly', 0.073), ('impossible', 0.071), ('suggesting', 0.071), ('study', 0.07), ('polls', 0.07), ('count', 0.07), ('identified', 0.068), ('changing', 0.067), ('environment', 0.066), ('man', 0.065), ('guys', 0.064), ('entry', 0.063), ('paragraph', 0.062), ('one', 0.062)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 1.0000001 108 andrew gelman stats-2010-06-24-Sometimes the raw numbers are better than a percentage

Introduction: A NY Times Environment blog entry summarizes an article in Proceedings of the National Academy of Sciences that looks into whether there really is a “scientific consensus” that humans are substantially changing the climate. There is. That’s pretty much “dog bites man” as far as news is concerned. But although the results of the study don’t seem noteworthy, I was struck by this paragraph in the blog writeup, which is pretty much a quote of the PNAS article: For example, of the top 50 climate researchers identified by the study (as ranked by the number of papers they had published), only 2 percent fell into the camp of climate dissenters. Of the top 200 researchers, only 2.5 percent fell into the dissenter camp. That is consistent with past work, including opinion polls, suggesting that 97 to 98 percent of working climate scientists accept the evidence for human-induced climate change. Two percent of the top 50, that’s one person. And 2.5 percent of the top 200, that’s five

2 0.18075822 1295 andrew gelman stats-2012-05-02-Selection bias, or, How you can think the experts don’t check their models, if you simply don’t look at what the experts actually are doing

Introduction: My friend Seth, whom I know from Berkeley (we taught a course together on left-handedness), has a blog on topics ranging from thoughtful discussions of scientific evidence, to experiences with his unconventional weight-loss scheme, offbeat self-experimentation, and advocacy of fringe scientific theories, leavened with occasional dollops of cynicism and political extremism . I agree with Seth on some things but not others. ( Here’s Seth’s reason for not attempting a clinical trial of his diet.) Recently I was disturbed (but, I’m sorry to say, not surprised) to see Seth post the following: Predictions of climate models versus reality . I [Seth] have only seen careful prediction-vs-reality comparisons made by AGW [anthropogenic global warming] skeptics. Those who believe humans are dangerously warming the planet appear to be silent on this subject. In response, Phil commented : Funny, on the day you [Seth] made your post saying that you haven’t seen comparis

3 0.13095619 2350 andrew gelman stats-2014-05-27-A whole fleet of gremlins: Looking more carefully at Richard Tol’s twice-corrected paper, “The Economic Effects of Climate Change”

Introduction: We had a discussion the other day of a paper, “The Economic Effects of Climate Change,” by economist Richard Tol. The paper came to my attention after I saw a notice from Adam Marcus that it was recently revised because of data errors. But after looking at the paper more carefully, I see a bunch of other problems that, to me, make the whole analysis close to useless as it stands. I think this is worth discussing because the paper has been somewhat influential (so far cited 328 times, according to Google Scholar) and has even been cited in the popular press as evidence that “Climate change has done more good than harm so far and is likely to continue doing so for most of this century . . . There are many likely effects of climate change: positive and negative, economic and ecological, humanitarian and financial. And if you aggregate them all, the overall effect is positive today — and likely to stay positive until around 2080. That was the conclusion of Professor Richard Tol

4 0.12648273 1865 andrew gelman stats-2013-05-20-What happened that the journal Psychological Science published a paper with no identifiable strengths?

Introduction: The other day we discussed that paper on ovulation and voting (you may recall that the authors reported a scattered bunch of comparisons, significance tests, and p-values, and I recommended that they would’ve done better to simply report complete summaries of their data, so that readers could see the comparisons of interest in full context), and I was thinking a bit more about why I was so bothered that it was published in Psychological Science, which I’d thought of as a serious research journal. My concern isn’t just that that the paper is bad—after all, lots of bad papers get published—but rather that it had nothing really going for it, except that it was headline bait. It was a survey done on Mechanical Turk, that’s it. No clever design, no clever questions, no care in dealing with nonresponse problems, no innovative data analysis, no nothing. The paper had nothing to offer, except that it had no obvious flaws. Psychology is a huge field full of brilliant researchers.

5 0.12524617 371 andrew gelman stats-2010-10-26-Musical chairs in econ journals

Introduction: Tyler Cowen links to a paper by Bruno Frey on the lack of space for articles in economics journals. Frey writes: To further their careers, [academic economists] are required to publish in A-journals, but for the vast majority this is impossible because there are few slots open in such journals. Such academic competition maybe useful to generate hard work, however, there may be serious negative consequences: the wrong output may be produced in an inefficient way, the wrong people may be selected, and losers may react in a harmful way. According to Frey, the consensus is that there are only five top economics journals–and one of those five is Econometrica, which is so specialized that I’d say that, for most academic economists, there are only four top places they can publish. The difficulty is that demand for these slots outpaces supply: for example, in 2007 there were only 275 articles in all these journals combined (or 224 if you exclude Econometrica), while “a rough estim

6 0.12416469 1201 andrew gelman stats-2012-03-07-Inference = data + model

7 0.12347852 529 andrew gelman stats-2011-01-21-“City Opens Inquiry on Grading Practices at a Top-Scoring Bronx School”

8 0.11910621 983 andrew gelman stats-2011-10-31-Skepticism about skepticism of global warming skepticism skepticism

9 0.11302499 2335 andrew gelman stats-2014-05-15-Bill Easterly vs. Jeff Sachs: What percentage of the recipients didn’t use the free malaria bed nets in Zambia?

10 0.11033277 673 andrew gelman stats-2011-04-20-Upper-income people still don’t realize they’re upper-income

11 0.10660879 2212 andrew gelman stats-2014-02-15-Mary, Mary, why ya buggin

12 0.10148679 2148 andrew gelman stats-2013-12-25-Spam!

13 0.10004374 549 andrew gelman stats-2011-02-01-“Roughly 90% of the increase in . . .” Hey, wait a minute!

14 0.0989592 1115 andrew gelman stats-2012-01-12-Where are the larger-than-life athletes?

15 0.09797553 1145 andrew gelman stats-2012-01-30-A tax on inequality, or a tax to keep inequality at the current level?

16 0.096691914 1503 andrew gelman stats-2012-09-19-“Poor Smokers in New York State Spend 25% of Income on Cigarettes, Study Finds”

17 0.096666299 513 andrew gelman stats-2011-01-12-“Tied for Warmest Year On Record”

18 0.096249677 2245 andrew gelman stats-2014-03-12-More on publishing in journals

19 0.095189646 1730 andrew gelman stats-2013-02-20-Unz on Unz

20 0.094801851 1683 andrew gelman stats-2013-01-19-“Confirmation, on the other hand, is not sexy”


similar blogs computed by lsi model

lsi for this blog:

topicId topicWeight

[(0, 0.161), (1, -0.086), (2, 0.013), (3, -0.054), (4, -0.037), (5, -0.033), (6, 0.036), (7, -0.022), (8, -0.018), (9, -0.003), (10, -0.008), (11, 0.001), (12, -0.016), (13, 0.026), (14, -0.013), (15, 0.061), (16, 0.041), (17, 0.023), (18, 0.029), (19, 0.013), (20, -0.017), (21, 0.067), (22, -0.056), (23, -0.008), (24, 0.021), (25, -0.062), (26, -0.072), (27, 0.005), (28, 0.004), (29, -0.009), (30, 0.024), (31, 0.017), (32, -0.004), (33, -0.038), (34, -0.041), (35, 0.036), (36, 0.068), (37, 0.001), (38, 0.0), (39, 0.026), (40, -0.019), (41, 0.033), (42, -0.011), (43, 0.019), (44, -0.036), (45, 0.014), (46, -0.047), (47, 0.002), (48, -0.051), (49, -0.022)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 0.9582482 108 andrew gelman stats-2010-06-24-Sometimes the raw numbers are better than a percentage

Introduction: A NY Times Environment blog entry summarizes an article in Proceedings of the National Academy of Sciences that looks into whether there really is a “scientific consensus” that humans are substantially changing the climate. There is. That’s pretty much “dog bites man” as far as news is concerned. But although the results of the study don’t seem noteworthy, I was struck by this paragraph in the blog writeup, which is pretty much a quote of the PNAS article: For example, of the top 50 climate researchers identified by the study (as ranked by the number of papers they had published), only 2 percent fell into the camp of climate dissenters. Of the top 200 researchers, only 2.5 percent fell into the dissenter camp. That is consistent with past work, including opinion polls, suggesting that 97 to 98 percent of working climate scientists accept the evidence for human-induced climate change. Two percent of the top 50, that’s one person. And 2.5 percent of the top 200, that’s five

2 0.77108335 1295 andrew gelman stats-2012-05-02-Selection bias, or, How you can think the experts don’t check their models, if you simply don’t look at what the experts actually are doing

Introduction: My friend Seth, whom I know from Berkeley (we taught a course together on left-handedness), has a blog on topics ranging from thoughtful discussions of scientific evidence, to experiences with his unconventional weight-loss scheme, offbeat self-experimentation, and advocacy of fringe scientific theories, leavened with occasional dollops of cynicism and political extremism . I agree with Seth on some things but not others. ( Here’s Seth’s reason for not attempting a clinical trial of his diet.) Recently I was disturbed (but, I’m sorry to say, not surprised) to see Seth post the following: Predictions of climate models versus reality . I [Seth] have only seen careful prediction-vs-reality comparisons made by AGW [anthropogenic global warming] skeptics. Those who believe humans are dangerously warming the planet appear to be silent on this subject. In response, Phil commented : Funny, on the day you [Seth] made your post saying that you haven’t seen comparis

3 0.71517891 1623 andrew gelman stats-2012-12-14-GiveWell charity recommendations

Introduction: In a rare Christmas-themed post here, I pass along this note from Alexander Berger at GiveWell : We just published a  blog post  following up on the *other* famous piece of evidence for deworming, the Miguel and Kremer experiment from Kenya. They shared data and code from their working paper (!) follow-up finding that deworming increases incomes ten years later, and we came out of the re-analysis feeling more confident in, though not wholly convinced by, the results. We’ve also just released  our new list of top charities  for giving season this year, which I think might be a good fit for your audience. We wrote a  blog post explaining our choices , and have also published extensive reviews of the top charities and the interventions on which they work. Perhaps the most interesting change since last year is the addition of GiveDirectly in the #2 spot; they do direct unconditional cash transfers to people living on less than a dollar a day in Kenya. We think it’s a remarkable mode

4 0.69610596 333 andrew gelman stats-2010-10-10-Psychiatric drugs and the reduction in crime

Introduction: Cameron McKenzie writes: I ran into the attached paper [by Dave Marcotte and Sara Markowitz] on the social benefits of prescription of psychotropic drugs, relating a drop in crime rate to an increase in psychiatric drug prescriptions. It’s not my area (which is psychophysics) but I do find this kind of thing interesting. Either people know much more than I think they do, or they are pretending to, and either is interesting. My feeling is that it doesn’t pass the sniff test, but I wondered if you might (i) find the paper interesting and/or (ii) perhaps be interested in commenting on it on the blog. It seems to me that if we cumulated all econometric studies of crime rate we would be able to explain well over 100% of the variation therein, but perhaps my skepticism is unwarranted. My reply: I know what you mean. The story seems plausible but the statistical analysis seems like a stretch. I appreciate that the authors included scatterplots of their data, but the patterns they

5 0.6866343 1500 andrew gelman stats-2012-09-17-“2% per degree Celsius . . . the magic number for how worker productivity responds to warm-hot temperatures”

Introduction: Solomon Hsiang shares some bad news: Persistently reduced labor productivity may be one of the largest economic impacts of anthropogenic climate change. . . . Two percent per degree Celsius . . . That’s the magic number for how worker productivity responds to warm/hot temperatures. In  my 2010 PNAS paper , I [Hsiang] found that labor-intensive sectors of national economies decreased output by roughly 2.4% per degree C and argued that this looked suspiously like it came from reductions in worker output. Using a totally different method and dataset, Matt Neidell and Josh Graff Zivin found that labor supply in micro data fell by 1.8% per degree C. Both responses kicked in at around 26C. Chris Sheehan just sent me  this NYT article on air conditioning , where they mention this neat natural experiment: [I]n the past year, [Japan] became an unwitting laboratory to study even more extreme air-conditioning abstinence, and the results have not been encouraging. After th

6 0.68566471 983 andrew gelman stats-2011-10-31-Skepticism about skepticism of global warming skepticism skepticism

7 0.68282729 180 andrew gelman stats-2010-08-03-Climate Change News

8 0.68027294 1187 andrew gelman stats-2012-02-27-“Apple confronts the law of large numbers” . . . huh?

9 0.67269063 942 andrew gelman stats-2011-10-04-45% hitting, 25% fielding, 25% pitching, and 100% not telling us how they did it

10 0.66942298 1558 andrew gelman stats-2012-11-02-Not so fast on levees and seawalls for NY harbor?

11 0.66874892 2177 andrew gelman stats-2014-01-19-“The British amateur who debunked the mathematics of happiness”

12 0.66804409 2112 andrew gelman stats-2013-11-25-An interesting but flawed attempt to apply general forecasting principles to contextualize attitudes toward risks of global warming

13 0.65812778 722 andrew gelman stats-2011-05-20-Why no Wegmania?

14 0.65802443 69 andrew gelman stats-2010-06-04-A Wikipedia whitewash

15 0.6528123 1906 andrew gelman stats-2013-06-19-“Behind a cancer-treatment firm’s rosy survival claims”

16 0.65242827 1312 andrew gelman stats-2012-05-11-Are our referencing errors undermining our scholarship and credibility? The case of expatriate failure rates

17 0.65066361 873 andrew gelman stats-2011-08-26-Luck or knowledge?

18 0.64657539 1115 andrew gelman stats-2012-01-12-Where are the larger-than-life athletes?

19 0.64609218 66 andrew gelman stats-2010-06-03-How can news reporters avoid making mistakes when reporting on technical issues? Or, Data used to justify “Data Used to Justify Health Savings Can Be Shaky” can be shaky

20 0.64493078 1522 andrew gelman stats-2012-10-05-High temperatures cause violent crime and implications for climate change, also some suggestions about how to better summarize these claims


similar blogs computed by lda model

lda for this blog:

topicId topicWeight

[(2, 0.018), (5, 0.013), (10, 0.012), (15, 0.024), (16, 0.085), (24, 0.08), (27, 0.01), (29, 0.012), (41, 0.013), (53, 0.229), (63, 0.014), (86, 0.031), (94, 0.024), (99, 0.33)]

similar blogs list:

simIndex simValue blogId blogTitle

1 0.98222446 298 andrew gelman stats-2010-09-27-Who is that masked person: The use of face masks on Mexico City public transportation during the Influenza A (H1N1) outbreak

Introduction: Tapen Sinha writes: Living in Mexico, I have been witness to many strange (and beautiful) things. Perhaps the strangest happened during the first outbreak of A(H1N1) in Mexico City. We had our university closed, football (soccer) was played in empty stadiums (or should it be stadia) because the government feared a spread of the virus. The Metro was operating and so were the private/public buses and taxis. Since the university was closed, we took the opportunity to collect data on facemask use in the public transport systems. It was a simple (but potentially deadly!) exercise in first hand statistical data collection that we teach our students (Although I must admit that I did not dare sending my research assistant to collect data – what if she contracted the virus?). I believe it was a unique experiment never to be repeated. The paper appeared in the journal Health Policy. From the abstract: At the height of the influenza epidemic in Mexico City in the spring of 2009, the f

2 0.98199129 46 andrew gelman stats-2010-05-21-Careers, one-hit wonders, and an offer of a free book

Introduction: J. Robert Lennon writes : At the moment I [Lennon] am simultaneously working on two magazine articles, each requiring me to assess not just a book, but (briefly) a writer’s entire career. The writers in question are both prominent, both widely published, read, and appreciated. And yet neither, I think, enjoys a full appreciation of their career–its real scope, with all its twists and turns, its eccentricities intact. In one case, the writer had one smash hit, and one notorious book everyone hates. In the other, the writer has somehow become known as the author of one really serious book that gets taught a lot in college classes, and a bunch of other stuff generally thought to be a little bit frivolous. But close readings of each (hell, not even that close) reveals these reputations to be woefully inadequate. Both writers are much more interesting than their hits and bombs would suggest. This naturally got me thinking about statisticians. Some statisticians are famous (within

3 0.97375023 1856 andrew gelman stats-2013-05-14-GPstuff: Bayesian Modeling with Gaussian Processes

Introduction: I think it’s part of my duty as a blogger to intersperse, along with the steady flow of jokes, rants, and literary criticism, some material that will actually be useful to you. So here goes. Jarno Vanhatalo, Jaakko Riihimäki, Jouni Hartikainen, Pasi Jylänki, Ville Tolvanen, and Aki Vehtari write : The GPstuff toolbox is a versatile collection of Gaussian process models and computational tools required for Bayesian inference. The tools include, among others, various inference methods, sparse approximations and model assessment methods. We can actually now fit Gaussian processes in Stan . But for big problems (or even moderately-sized problems), full Bayes can be slow. GPstuff uses EP, which is faster. At some point we’d like to implement EP in Stan. (Right now we’re working with Dave Blei to implement VB.) GPstuff really works. I saw Aki use it to fit a nonparametric version of the Bangladesh well-switching example in ARM. He was sitting in his office and just whip

4 0.971892 1468 andrew gelman stats-2012-08-24-Multilevel modeling and instrumental variables

Introduction: Terence Teo writes: I was wondering if multilevel models can be used as an alternative to 2SLS or IV models to deal with (i) endogeneity and (ii) selection problems. More concretely, I am trying to assess the impact of investment treaties on foreign investment. Aside from the fact that foreign investment is correlated over time, it may be the case that countries that already receive sufficient amounts of foreign investment need not sign treaties, and countries that sign treaties are those that need foreign investment in the first place. Countries thus “select” into treatment; treaty signing is non-random. As such, I argue that to properly estimate the impact of treaties on investment, we must model the determinants of treaty signing. I [Teo] am currently modeling this as two separate models: (1) regress predictors on likelihood of treaty signing, (2) regress treaty (with interactions, etc) on investment (I’ve thought of using propensity score matching for this part of the model)

5 0.96903467 1802 andrew gelman stats-2013-04-14-Detecting predictability in complex ecosystems

Introduction: A couple people pointed me to a recent article , “Detecting Causality in Complex Ecosystems,” by fisheries researchers George Sugihara, Robert May, Hao Ye, Chih-hao Hsieh, Ethan Deyle, Michael Fogarty, and Stephan Munch. I don’t know anything about ecology research but I could imagine this method being useful in that field. I can’t see the approach doing much in political science, where I think their stated goal of “identifying causal networks” is typically irrelevant. That said, if you replace the word “causality” by “predictability” everywhere in the paper, it starts to make a lot more sense. As they write, they are working within “a framework that uses predictability as opposed to correlation to identify causation between time-series variables.” Setting causation aside, predictability is an important topic in itself. The search for patterns of predictability in complex structures may motivate causal hypotheses that can be studied more directly, using more traditional statis

6 0.96611333 1589 andrew gelman stats-2012-11-25-Life as a blogger: the emails just get weirder and weirder

7 0.96223623 1677 andrew gelman stats-2013-01-16-Greenland is one tough town

8 0.96113861 1902 andrew gelman stats-2013-06-17-Job opening at new “big data” consulting firm!

9 0.96091664 1905 andrew gelman stats-2013-06-18-There are no fat sprinters

10 0.95963991 733 andrew gelman stats-2011-05-27-Another silly graph

11 0.94815981 991 andrew gelman stats-2011-11-04-Insecure researchers aren’t sharing their data

12 0.94674271 2022 andrew gelman stats-2013-09-13-You heard it here first: Intense exercise can suppress appetite

13 0.93858063 1555 andrew gelman stats-2012-10-31-Social scientists who use medical analogies to explain causal inference are, I think, implicitly trying to borrow some of the scientific and cultural authority of that field for our own purposes

14 0.93590623 880 andrew gelman stats-2011-08-30-Annals of spam

15 0.93554056 495 andrew gelman stats-2010-12-31-“Threshold earners” and economic inequality

same-blog 16 0.93372387 108 andrew gelman stats-2010-06-24-Sometimes the raw numbers are better than a percentage

17 0.93097568 1861 andrew gelman stats-2013-05-17-Where do theories come from?

18 0.92882299 1047 andrew gelman stats-2011-12-08-I Am Too Absolutely Heteroskedastic for This Probit Model

19 0.92007256 237 andrew gelman stats-2010-08-27-Bafumi-Erikson-Wlezien predict a 50-seat loss for Democrats in November

20 0.91512656 2067 andrew gelman stats-2013-10-18-EP and ABC