andrew_gelman_stats andrew_gelman_stats-2013 andrew_gelman_stats-2013-1662 knowledge-graph by maker-knowledge-mining

1662 andrew gelman stats-2013-01-09-The difference between “significant” and “non-significant” is not itself statistically significant


meta infos for this blog

Source: html

Introduction: Commenter Rahul asked what I thought of this note by Scott Firestone ( link from Tyler Cowen) criticizing a recent discussion by Kevin Drum suggesting that lead exposure causes violent crime. Firestone writes: It turns out there was in fact a prospective study done—but its implications for Drum’s argument are mixed. The study was a cohort study done by researchers at the University of Cincinnati. Between 1979 and 1984, 376 infants were recruited. Their parents consented to have lead levels in their blood tested over time; this was matched with records over subsequent decades of the individuals’ arrest records, and specifically arrest for violent crime. Ultimately, some of these individuals were dropped from the study; by the end, 250 were selected for the results. The researchers found that for each increase of 5 micrograms of lead per deciliter of blood, there was a higher risk for being arrested for a violent crime, but a further look at the numbers shows a more mixe


Summary: the most important sentenses genereted by tfidf model

sentIndex sentText sentNum sentScore

1 Commenter Rahul asked what I thought of this note by Scott Firestone ( link from Tyler Cowen) criticizing a recent discussion by Kevin Drum suggesting that lead exposure causes violent crime. [sent-1, score-0.635]

2 Firestone writes: It turns out there was in fact a prospective study done—but its implications for Drum’s argument are mixed. [sent-2, score-0.205]

3 The study was a cohort study done by researchers at the University of Cincinnati. [sent-3, score-0.525]

4 Their parents consented to have lead levels in their blood tested over time; this was matched with records over subsequent decades of the individuals’ arrest records, and specifically arrest for violent crime. [sent-5, score-1.374]

5 Ultimately, some of these individuals were dropped from the study; by the end, 250 were selected for the results. [sent-6, score-0.159]

6 The researchers found that for each increase of 5 micrograms of lead per deciliter of blood, there was a higher risk for being arrested for a violent crime, but a further look at the numbers shows a more mixed picture than they let on. [sent-7, score-1.029]

7 In prenatal blood lead, this effect was not significant. [sent-8, score-0.399]

8 If these infants were to have no additional risk over the median exposure level among all prenatal infants, the ratio would be 1. [sent-9, score-1.08]

9 They found that for their cohort, the risk ratio was 1. [sent-11, score-0.294]

10 However, the sample size was small enough that the confidence interval dipped as low as 0. [sent-13, score-0.415]

11 88 (paradoxically indicating that additional 5 µg/dl during this period of development would actually be protective), and rose as high as 2. [sent-14, score-0.228]

12 30, but the sample size was higher, leading to a tighter confidence interval of 1. [sent-18, score-0.511]

13 This range indicates it’s possible that the effect is as little as a 3% increase in violent crime arrests, but this is still statistically significant. [sent-21, score-0.6]

14 I have not followed this at all and have no comments on the substance of the matter. [sent-22, score-0.122]

15 But based on Firestone’s piece linked above, I am not impressed by his statistical criticisms. [sent-23, score-0.058]

16 He seemed to just be going around looking for subsets of the data with statistically insignificant results. [sent-24, score-0.272]

17 With a small sample size, not every comparison is going to be statistically significant. [sent-25, score-0.216]

18 Firestone comments , explaining that his goal is not to shoot down the claim but rather to point out areas of uncertainty which should motivate further study. [sent-29, score-0.188]


similar blogs computed by tfidf model

tfidf for this blog:

wordName wordTfidf (topN-words)

[('firestone', 0.421), ('violent', 0.282), ('infants', 0.271), ('blood', 0.218), ('arrest', 0.192), ('prenatal', 0.181), ('drum', 0.181), ('risk', 0.179), ('exposure', 0.179), ('lead', 0.174), ('cohort', 0.141), ('study', 0.134), ('records', 0.12), ('statistically', 0.119), ('size', 0.117), ('crime', 0.117), ('ratio', 0.115), ('interval', 0.109), ('sample', 0.097), ('micrograms', 0.096), ('tighter', 0.096), ('confidence', 0.092), ('individuals', 0.091), ('additional', 0.091), ('rahul', 0.087), ('arrested', 0.083), ('arrests', 0.083), ('increase', 0.082), ('protective', 0.081), ('subsets', 0.077), ('insignificant', 0.076), ('higher', 0.075), ('rose', 0.072), ('prospective', 0.071), ('paradoxically', 0.069), ('childhood', 0.069), ('dropped', 0.068), ('matched', 0.068), ('subsequent', 0.068), ('kevin', 0.067), ('shoot', 0.066), ('indicating', 0.065), ('median', 0.064), ('motivate', 0.061), ('comments', 0.061), ('substance', 0.061), ('tested', 0.06), ('impressed', 0.058), ('researchers', 0.058), ('done', 0.058)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 0.99999988 1662 andrew gelman stats-2013-01-09-The difference between “significant” and “non-significant” is not itself statistically significant

Introduction: Commenter Rahul asked what I thought of this note by Scott Firestone ( link from Tyler Cowen) criticizing a recent discussion by Kevin Drum suggesting that lead exposure causes violent crime. Firestone writes: It turns out there was in fact a prospective study done—but its implications for Drum’s argument are mixed. The study was a cohort study done by researchers at the University of Cincinnati. Between 1979 and 1984, 376 infants were recruited. Their parents consented to have lead levels in their blood tested over time; this was matched with records over subsequent decades of the individuals’ arrest records, and specifically arrest for violent crime. Ultimately, some of these individuals were dropped from the study; by the end, 250 were selected for the results. The researchers found that for each increase of 5 micrograms of lead per deciliter of blood, there was a higher risk for being arrested for a violent crime, but a further look at the numbers shows a more mixe

2 0.15919514 1522 andrew gelman stats-2012-10-05-High temperatures cause violent crime and implications for climate change, also some suggestions about how to better summarize these claims

Introduction: Solomon Hsiang writes : I [Hsiang] have posted about high temperature inducing individuals to exhibit more violent behavior when driving, playing baseball and prowling bars. These cases are neat anecdotes that let us see the “pure aggression” response in lab-like conditions. But they don’t affect most of us too much. But violent crime in the real world affects everyone. Earlier, I posted a paper by Jacob et al. that looked at assault in the USA for about a decade – they found that higher temperatures lead to more assault and that the rise in violent crimes rose more quickly than the analogous rise in non-violent property-crime, an indicator that there is a “pure aggression” component to the rise in violent crime. A new working paper “Crime, Weather, and Climate Change” by recent Harvard grad Matthew Ranson puts together an impressive data set of all types of crime in USA counties for 50 years. The results tell the aggression story using street-level data very clearly [click to

3 0.14349714 2328 andrew gelman stats-2014-05-10-What property is important in a risk prediction model? Discrimination or calibration?

Introduction: Sanjay Kaul writes: I am sure you must be aware of the recent controversy ignited by the 2013 American College of Cardiology/American Heart Association Cholesterol Treatment Guidelines that were released last month. They have been the subject of several newspaper articles and blogs , most of them missing the thrust of the guidelines. There is much to admire about these guidelines as they are more faithfully aligned with high-quality ‘actionable’ evidence than the 3 previous iterations. However, the controversy is focused on the performance of the risk calculator introduced for initiating treatment in individuals without established atherosclerotic disease or diabetes (so-called primary prevention cohort). The guidelines recommend statins for primary prevention in individuals who have a 10-year risk estimated to be 7.5%. The risk calculator was derived from population cohorts studied in the 1990s. The discrimination for predicting the risk of atherosclerotic cardiovascular events

4 0.1292206 356 andrew gelman stats-2010-10-20-Ranking on crime rankings

Introduction: Following up on our discussion of crime rates–surprisingly (to me), Detroit’s violent crime rate was only 75% more than Minneapolis’s–Chris Uggen pointed me to this warning from Richard Rosenfeld and Janet Lauritsen about comparative crime stats.

5 0.12368897 480 andrew gelman stats-2010-12-21-Instead of “confidence interval,” let’s say “uncertainty interval”

Introduction: I’ve become increasingly uncomfortable with the term “confidence interval,” for several reasons: - The well-known difficulties in interpretation (officially the confidence statement can be interpreted only on average, but people typically implicitly give the Bayesian interpretation to each case), - The ambiguity between confidence intervals and predictive intervals. (See the footnote in BDA where we discuss the difference between “inference” and “prediction” in the classical framework.) - The awkwardness of explaining that confidence intervals are big in noisy situations where you have less confidence, and confidence intervals are small when you have more confidence. So here’s my proposal. Let’s use the term “uncertainty interval” instead. The uncertainty interval tells you how much uncertainty you have. That works pretty well, I think. P.S. As of this writing, “confidence interval” outGoogles “uncertainty interval” by the huge margin of 9.5 million to 54000. So we

6 0.10641694 1364 andrew gelman stats-2012-06-04-Massive confusion about a study that purports to show that exercise may increase heart risk

7 0.10589163 1913 andrew gelman stats-2013-06-24-Why it doesn’t make sense in general to form confidence intervals by inverting hypothesis tests

8 0.10491994 775 andrew gelman stats-2011-06-21-Fundamental difficulty of inference for a ratio when the denominator could be positive or negative

9 0.10180905 1672 andrew gelman stats-2013-01-14-How do you think about the values in a confidence interval?

10 0.10083053 870 andrew gelman stats-2011-08-25-Why it doesn’t make sense in general to form confidence intervals by inverting hypothesis tests

11 0.098366439 849 andrew gelman stats-2011-08-11-The Reliability of Cluster Surveys of Conflict Mortality: Violent Deaths and Non-Violent Deaths

12 0.098241553 1299 andrew gelman stats-2012-05-04-Models, assumptions, and data summaries

13 0.096877612 695 andrew gelman stats-2011-05-04-Statistics ethics question

14 0.089279346 1317 andrew gelman stats-2012-05-13-Question 3 of my final exam for Design and Analysis of Sample Surveys

15 0.086248986 1086 andrew gelman stats-2011-12-27-The most dangerous jobs in America

16 0.085232712 1910 andrew gelman stats-2013-06-22-Struggles over the criticism of the “cannabis users and IQ change” paper

17 0.085038498 514 andrew gelman stats-2011-01-13-News coverage of statistical issues…how did I do?

18 0.083240688 1607 andrew gelman stats-2012-12-05-The p-value is not . . .

19 0.081897333 1912 andrew gelman stats-2013-06-24-Bayesian quality control?

20 0.079687662 716 andrew gelman stats-2011-05-17-Is the internet causing half the rapes in Norway? I wanna see the scatterplot.


similar blogs computed by lsi model

lsi for this blog:

topicId topicWeight

[(0, 0.121), (1, -0.014), (2, 0.064), (3, -0.115), (4, 0.01), (5, -0.04), (6, -0.005), (7, 0.038), (8, -0.013), (9, -0.076), (10, -0.083), (11, -0.007), (12, 0.056), (13, 0.001), (14, 0.017), (15, 0.03), (16, 0.04), (17, -0.015), (18, 0.024), (19, -0.015), (20, 0.045), (21, 0.026), (22, -0.002), (23, -0.029), (24, 0.042), (25, -0.002), (26, -0.017), (27, -0.034), (28, 0.023), (29, 0.002), (30, -0.065), (31, -0.025), (32, -0.034), (33, -0.032), (34, 0.014), (35, 0.064), (36, 0.012), (37, 0.043), (38, 0.027), (39, -0.012), (40, -0.013), (41, -0.001), (42, 0.001), (43, -0.028), (44, 0.043), (45, -0.022), (46, -0.033), (47, -0.004), (48, 0.015), (49, 0.006)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 0.97089797 1662 andrew gelman stats-2013-01-09-The difference between “significant” and “non-significant” is not itself statistically significant

Introduction: Commenter Rahul asked what I thought of this note by Scott Firestone ( link from Tyler Cowen) criticizing a recent discussion by Kevin Drum suggesting that lead exposure causes violent crime. Firestone writes: It turns out there was in fact a prospective study done—but its implications for Drum’s argument are mixed. The study was a cohort study done by researchers at the University of Cincinnati. Between 1979 and 1984, 376 infants were recruited. Their parents consented to have lead levels in their blood tested over time; this was matched with records over subsequent decades of the individuals’ arrest records, and specifically arrest for violent crime. Ultimately, some of these individuals were dropped from the study; by the end, 250 were selected for the results. The researchers found that for each increase of 5 micrograms of lead per deciliter of blood, there was a higher risk for being arrested for a violent crime, but a further look at the numbers shows a more mixe

2 0.73703825 1766 andrew gelman stats-2013-03-16-“Nightshifts Linked to Increased Risk for Ovarian Cancer”

Introduction: Zosia Chustecka writes : Much of the previous work on the link between cancer and nightshifts has focused on breast cancer . . . The latest report, focusing on ovarian cancer, was published in the April issue of Occupational and Environmental Medicine. This increase in the risk for ovarian cancer with nightshift work is consistent with, and of similar magnitude to, the risk for breast cancer, say lead author Parveen Bhatti, PhD, and colleagues from the epidemiology program at the Fred Hutchinson Cancer Research Center in Seattle, Washington. The researchers examined data from a local population-based cancer registry that is part of the Surveillance Epidemiology and End Results (SEER) Program. They identified 1101 women with advanced epithelial ovarian cancer, 389 with borderline disease, and 1832 without ovarian cancer (control group). The women, who were 35 to 74 years of age, were asked about the hours they worked, and specifically whether they had ever worked the nig

3 0.71988976 2030 andrew gelman stats-2013-09-19-Is coffee a killer? I don’t think the effect is as high as was estimated from the highest number that came out of a noisy study

Introduction: Thomas Lumley writes : The Herald  has a story about hazards of coffee. The picture caption says Men who drink more than four cups a day are 56 per cent more likely to die. which is obviously not true: deaths, as we’ve observed before, are fixed at one per customer.  The story says It’s not that people are dying at a rapid rate. But men who drink more than four cups a day are 56 per cent more likely to die and women have double the chance compared with moderate drinkers, according to the The University of Queensland and the University of South Carolina study. What  the study  actually reported was rates of death: over an average of 17 years, men who drink more than four cups a day died at about a 21% higher rate, with little evidence of any difference in men.  After they considered only men and women under 55 (which they don’t say was something they had planned to do), and attempted to control for a whole bunch of other factors, the rate increase went to 56% for me

4 0.70495588 1672 andrew gelman stats-2013-01-14-How do you think about the values in a confidence interval?

Introduction: Philip Jones writes: As an interested reader of your blog, I wondered if you might consider a blog entry sometime on the following question I posed on CrossValidated (StackExchange). I originally posed the question based on my uncertainty about 95% CIs: “Are all values within the 95% CI equally likely (probable), or are the values at the “tails” of the 95% CI less likely than those in the middle of the CI closer to the point estimate?” I posed this question based on discordant information I found at a couple of different web sources (I posted these sources in the body of the question). I received some interesting replies, and the replies were not unanimous, in fact there is some serious disagreement there! After seeing this disagreement, I naturally thought of you, and whether you might be able to clear this up. Please note I am not referring to credible intervals, but rather to the common medical journal reporting standard of confidence intervals. My response: First

5 0.70249051 2114 andrew gelman stats-2013-11-26-“Please make fun of this claim”

Introduction: Jeff sent me an email with the above title and a link to a press release, “Nut consumption reduces risk of death,” which begins: According to the largest study of its kind, people who ate a daily handful of nuts were 20 percent less likely to die from any cause over a 30-year period than those who didn’t consume nuts . . . Their report, published in the New England Journal of Medicine, contains further good news: The regular nut-eaters were found to be more slender than those who didn’t eat nuts, a finding that should alleviate fears that eating a lot of nuts will lead to overweight. . . . For the new research, the scientists were able to tap databases from two well-known, ongoing observational studies that collect data on diet and other lifestyle factors and various health outcomes. The Nurses’ Health Study provided data on 76,464 women between 1980 and 2010, and the Health Professionals’ Follow-Up Study yielded data on 42,498 men from 1986 to 2010. . . . Sophisticated data a

6 0.68276972 2248 andrew gelman stats-2014-03-15-Problematic interpretations of confidence intervals

7 0.67380887 410 andrew gelman stats-2010-11-12-The Wald method has been the subject of extensive criticism by statisticians for exaggerating results”

8 0.67027032 1150 andrew gelman stats-2012-02-02-The inevitable problems with statistical significance and 95% intervals

9 0.65221786 2022 andrew gelman stats-2013-09-13-You heard it here first: Intense exercise can suppress appetite

10 0.6478734 1427 andrew gelman stats-2012-07-24-More from the sister blog

11 0.64002961 1364 andrew gelman stats-2012-06-04-Massive confusion about a study that purports to show that exercise may increase heart risk

12 0.63971078 2227 andrew gelman stats-2014-02-27-“What Can we Learn from the Many Labs Replication Project?”

13 0.62062752 1838 andrew gelman stats-2013-05-03-Setting aside the politics, the debate over the new health-care study reveals that we’re moving to a new high standard of statistical journalism

14 0.6161533 1741 andrew gelman stats-2013-02-27-Thin scientists say it’s unhealthy to be fat

15 0.61295009 1305 andrew gelman stats-2012-05-07-Happy news on happiness; what can we believe?

16 0.61086518 2049 andrew gelman stats-2013-10-03-On house arrest for p-hacking

17 0.60929471 2223 andrew gelman stats-2014-02-24-“Edlin’s rule” for routinely scaling down published estimates

18 0.60475928 7 andrew gelman stats-2010-04-27-Should Mister P be allowed-encouraged to reside in counter-factual populations?

19 0.60474825 1086 andrew gelman stats-2011-12-27-The most dangerous jobs in America

20 0.6036815 899 andrew gelman stats-2011-09-10-The statistical significance filter


similar blogs computed by lda model

lda for this blog:

topicId topicWeight

[(13, 0.018), (15, 0.027), (16, 0.021), (21, 0.029), (24, 0.14), (27, 0.014), (45, 0.017), (55, 0.047), (61, 0.235), (63, 0.024), (81, 0.033), (89, 0.017), (95, 0.023), (99, 0.227)]

similar blogs list:

simIndex simValue blogId blogTitle

1 0.93786895 1558 andrew gelman stats-2012-11-02-Not so fast on levees and seawalls for NY harbor?

Introduction: I was talking with June Williamson and mentioned offhand that I’d seen something in the paper saying that if only we’d invested a few billion dollars in levees we would’ve saved zillions in economic damage from the flood. (A quick search also revealed this eerily prescient article from last month and, more recently, this online discussion.) June said, No, no, no: levees are not the way to go: Here and here are the articles on “soft infrastructure” for the New York-New Jersey Harbor I was mentioning, summarizing work that is more extensively published in two books, “Rising Currents” and “On the Water: Palisade Bay”: The hazards posed by climate change, sea level rise, and severe storm surges make this the time to transform our coastal cities through adaptive design. The conventional response to flooding, in recent history, has been hard engineering — fortifying the coastal infrastructure with seawalls and bulkheads to protect real estate at the expense of natural t

same-blog 2 0.91847354 1662 andrew gelman stats-2013-01-09-The difference between “significant” and “non-significant” is not itself statistically significant

Introduction: Commenter Rahul asked what I thought of this note by Scott Firestone ( link from Tyler Cowen) criticizing a recent discussion by Kevin Drum suggesting that lead exposure causes violent crime. Firestone writes: It turns out there was in fact a prospective study done—but its implications for Drum’s argument are mixed. The study was a cohort study done by researchers at the University of Cincinnati. Between 1979 and 1984, 376 infants were recruited. Their parents consented to have lead levels in their blood tested over time; this was matched with records over subsequent decades of the individuals’ arrest records, and specifically arrest for violent crime. Ultimately, some of these individuals were dropped from the study; by the end, 250 were selected for the results. The researchers found that for each increase of 5 micrograms of lead per deciliter of blood, there was a higher risk for being arrested for a violent crime, but a further look at the numbers shows a more mixe

3 0.90579653 1028 andrew gelman stats-2011-11-26-Tenure lets you handle students who cheat

Introduction: The other day, a friend of mine who is an untenured professor (not in statistics or political science) was telling me about a class where many of the students seemed to be resubmitting papers that they had already written for previous classes. (The supposition was based on internal evidence of the topics of the submitted papers.) It would be possible to check this and then kick the cheating students out of the program—but why do it? It would be a lot of work, also some of the students who are caught might complain, then word would get around that my friend is a troublemaker. And nobody likes a troublemaker. Once my friend has tenure it would be possible to do the right thing. But . . . here’s the hitch: most college instructors do not have tenure, and one result, I suspect, is a decline in ethical standards. This is something I hadn’t thought of in our earlier discussion of job security for teachers: tenure gives you the freedom to kick out cheating students.

4 0.89788747 1370 andrew gelman stats-2012-06-07-Duncan Watts and the Titanic

Introduction: Daniel Mendelsohn recently asked , “Why do we love the Titanic?”, seeking to understand how it has happened that: It may not be true that ‘the three most written-about subjects of all time are Jesus, the Civil War, and the Titanic,’ as one historian has put it, but it’s not much of an exaggeration. . . . The inexhaustible interest suggests that the Titanic’s story taps a vein much deeper than the morbid fascination that has attached to other disasters. The explosion of the Hindenburg, for instance, and even the torpedoing, just three years after the Titanic sank, of the Lusitania, another great liner whose passenger list boasted the rich and the famous, were calamities that shocked the world but have failed to generate an obsessive preoccupation. . . . If the Titanic has gripped our imagination so forcefully for the past century, it must be because of something bigger than any fact of social or political or cultural history. To get to the bottom of why we can’t forget it, yo

5 0.89453554 16 andrew gelman stats-2010-05-04-Burgess on Kipling

Introduction: This is my last entry derived from Anthony Burgess’s book reviews , and it’ll be short. His review of Angus Wilson’s “The Strange Ride of Rudyard Kipling: His Life and Works” is a wonderfully balanced little thing. Nothing incredibly deep–like most items in the collection, the review is only two pages long–but I give it credit for being a rare piece of Kipling criticism I’ve seen that (a) seriously engages with the politics, without (b) congratulating itself on bravely going against the fashions of the politically incorrect chattering classes by celebrating Kipling’s magnificent achievement blah blah blah. Instead, Burgess shows respect for Kipling’s work and puts it in historical, biographical, and literary context. Burgess concludes that Wilson’s book “reminds us, in John Gross’s words, that Kipling ‘remains a haunting, unsettling presence, with whom we still have to come to terms.’ Still.” Well put, and generous of Burgess to end his review with another’s quote. Other cri

6 0.88066858 1433 andrew gelman stats-2012-07-28-LOL without the CATS

7 0.8766818 1975 andrew gelman stats-2013-08-09-Understanding predictive information criteria for Bayesian models

8 0.87169683 2349 andrew gelman stats-2014-05-26-WAIC and cross-validation in Stan!

9 0.86354589 714 andrew gelman stats-2011-05-16-NYT Labs releases Openpaths, a utility for saving your iphone data

10 0.85137981 21 andrew gelman stats-2010-05-07-Environmentally induced cancer “grossly underestimated”? Doubtful.

11 0.84112859 827 andrew gelman stats-2011-07-28-Amusing case of self-defeating science writing

12 0.84046477 9 andrew gelman stats-2010-04-28-But it all goes to pay for gas, car insurance, and tolls on the turnpike

13 0.83768803 696 andrew gelman stats-2011-05-04-Whassup with glm()?

14 0.82576853 729 andrew gelman stats-2011-05-24-Deviance as a difference

15 0.8179692 1714 andrew gelman stats-2013-02-09-Partial least squares path analysis

16 0.81347114 776 andrew gelman stats-2011-06-22-Deviance, DIC, AIC, cross-validation, etc

17 0.80543566 1739 andrew gelman stats-2013-02-26-An AI can build and try out statistical models using an open-ended generative grammar

18 0.80323112 561 andrew gelman stats-2011-02-06-Poverty, educational performance – and can be done about it

19 0.79834658 2156 andrew gelman stats-2014-01-01-“Though They May Be Unaware, Newlyweds Implicitly Know Whether Their Marriage Will Be Satisfying”

20 0.79314232 2033 andrew gelman stats-2013-09-23-More on Bayesian methods and multilevel modeling