andrew_gelman_stats andrew_gelman_stats-2014 andrew_gelman_stats-2014-2352 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Rolf Zwaan gives an excellent discussion of how superstition can arise and perpetuate itself: A social-behavioral priming experiment is like rolling a 20-sided die, an icosahedron. If you roll the die a number of times, 20 will turn up at some point. Bingo! You have a significant effect. In fact, given what we now know about questionable and not so questionable research practices, it is fair to assume that the researchers are actually rolling with a 20-sided die where maybe as many as six sides have a 20 on them. So the chances of rolling a 20 are quite high. Once the researchers have rolled a 20, their next interpretive move is to consider the circumstances that happened to coincide with rolling the die instrumental in producing the 20. The only problem is that they don’t know what those circumstances were. Was it the physical condition of the roller? Was it the weather? Was it the time of day? Was it the color of the roller’s sweater? Indeed, we’ve been told first that it
sentIndex sentText sentNum sentScore
1 Rolf Zwaan gives an excellent discussion of how superstition can arise and perpetuate itself: A social-behavioral priming experiment is like rolling a 20-sided die, an icosahedron. [sent-1, score-0.69]
2 If you roll the die a number of times, 20 will turn up at some point. [sent-2, score-0.425]
3 In fact, given what we now know about questionable and not so questionable research practices, it is fair to assume that the researchers are actually rolling with a 20-sided die where maybe as many as six sides have a 20 on them. [sent-5, score-1.121]
4 Once the researchers have rolled a 20, their next interpretive move is to consider the circumstances that happened to coincide with rolling the die instrumental in producing the 20. [sent-7, score-1.508]
5 The only problem is that they don’t know what those circumstances were. [sent-8, score-0.193]
6 Indeed, we’ve been told first that it’s the color of her shirt and then that it’s the weather. [sent-13, score-0.222]
7 Zwaan continues: Now suppose that someone else tries to faithfully recreate the circumstances that co-occurred with the rolling of the 20, from the information that was provided by the original rollers. [sent-14, score-1.016]
8 They recruit a 23-year old male roller from Michigan, wait until the outside temperature is exactly 17 degrees Celsius, make the experimenter wear a green sweater, have him drink the same IPA on the night before, and so on. [sent-15, score-1.078]
9 Unfortunately, a different number comes up— a disappointing 11. [sent-18, score-0.241]
10 He tells this to the first roller, who replies: Yes you got a different number than we did but that’s because of all kinds of extraneous factors that we didn’t tell you about because we don’t know what they are. [sent-20, score-0.184]
11 Or, as Nick Brown puts it , “Hold on a moment which I move these goalposts. [sent-24, score-0.086]
wordName wordTfidf (topN-words)
[('rolling', 0.488), ('roller', 0.414), ('die', 0.26), ('sweater', 0.207), ('circumstances', 0.193), ('zwaan', 0.187), ('questionable', 0.155), ('color', 0.118), ('bingo', 0.104), ('recreate', 0.104), ('shirt', 0.104), ('priming', 0.104), ('interpretive', 0.104), ('perpetuate', 0.098), ('rolls', 0.093), ('experimenter', 0.093), ('rolled', 0.093), ('extraneous', 0.093), ('celsius', 0.093), ('number', 0.091), ('faithfully', 0.09), ('rolf', 0.09), ('move', 0.086), ('recruit', 0.085), ('sadly', 0.083), ('coincide', 0.083), ('disappointing', 0.082), ('michigan', 0.082), ('wear', 0.08), ('original', 0.075), ('roll', 0.074), ('drink', 0.074), ('weather', 0.074), ('night', 0.073), ('nick', 0.071), ('replies', 0.071), ('producing', 0.07), ('chances', 0.069), ('brown', 0.068), ('comes', 0.068), ('male', 0.068), ('instrumental', 0.068), ('green', 0.067), ('tries', 0.066), ('condition', 0.065), ('temperature', 0.063), ('replicate', 0.063), ('researchers', 0.063), ('practices', 0.062), ('wait', 0.061)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 2352 andrew gelman stats-2014-05-29-When you believe in things that you don’t understand
Introduction: Rolf Zwaan gives an excellent discussion of how superstition can arise and perpetuate itself: A social-behavioral priming experiment is like rolling a 20-sided die, an icosahedron. If you roll the die a number of times, 20 will turn up at some point. Bingo! You have a significant effect. In fact, given what we now know about questionable and not so questionable research practices, it is fair to assume that the researchers are actually rolling with a 20-sided die where maybe as many as six sides have a 20 on them. So the chances of rolling a 20 are quite high. Once the researchers have rolled a 20, their next interpretive move is to consider the circumstances that happened to coincide with rolling the die instrumental in producing the 20. The only problem is that they don’t know what those circumstances were. Was it the physical condition of the roller? Was it the weather? Was it the time of day? Was it the color of the roller’s sweater? Indeed, we’ve been told first that it
2 0.097265728 515 andrew gelman stats-2011-01-13-The Road to a B
Introduction: A student in my intro class came by the other day with a lot of questions. It soon became clear that he was confused about a lot of things, going back several weeks in the course. What this means is that we did not do a good job of monitoring his performance earlier during the semester. But the question now is: what do do next? I’ll sign the drop form any time during the semester, but he didn’t want to drop the class (the usual scheduling issues). And he doesn’t want to get a C or a D. He’s in big trouble and at this point is basically rolling the dice that he’ll do well enough on the final to eke out a B in the course. (Yes, he goes to section meetings and office hours, and he even tried hiring a tutor. But it’s tough–if you’ve already been going to class and still don’t know what’s going on, it’s not so easy to pull yourself out of the hole, even if you have a big pile of practice problems ahead of you.) What we really need for this student, and others like him, is a road
3 0.075960517 169 andrew gelman stats-2010-07-29-Say again?
Introduction: “Ich glaube, dass die Wahrscheinlichkeitsrechnung das richtige Werkzeug zum Lösen solcher Probleme ist”, sagt Andrew Gelman , Statistikprofessor von der Columbia-Universität in New York. Wie oft aber derart knifflige Aufgaben im realen Leben auftauchen, könne er nicht sagen. Was fast schon beruhigend klingt. OK, fine.
4 0.072787859 2227 andrew gelman stats-2014-02-27-“What Can we Learn from the Many Labs Replication Project?”
Introduction: Aki points us to this discussion from Rolf Zwaan: The first massive replication project in psychology has just reached completion (several others are to follow). . . . What can we learn from the ManyLabs project? The results here show the effect sizes for the replication efforts (in green and grey) as well as the original studies (in blue). The 99% confidence intervals are for the meta-analysis of the effect size (the green dots); the studies are ordered by effect size. Let’s first consider what we canNOT learn from these data. Of the 13 replication attempts (when the first four are taken together), 11 succeeded and 2 did not (in fact, at some point ManyLabs suggests that a third one, Imagined Contact also doesn’t really replicate). We cannot learn from this that the vast majority of psychological findings will replicate . . . But even if we had an accurate estimate of the percentage of findings that replicate, how useful would that be? Rather than trying to arrive at a mo
Introduction: I was just reading an old post and came across this example which I’d like to share with you again: Here’s a story of R-squared = 1%. Consider a 0/1 outcome with about half the people in each category. For.example, half the people with some disease die in a year and half live. Now suppose there’s a treatment that increases survival rate from 50% to 60%. The unexplained sd is 0.5 and the explained sd is 0.05, hence R-squared is 0.01.
6 0.070741013 2177 andrew gelman stats-2014-01-19-“The British amateur who debunked the mathematics of happiness”
7 0.06739302 582 andrew gelman stats-2011-02-20-Statisticians vs. everybody else
8 0.065188274 845 andrew gelman stats-2011-08-08-How adoption speed affects the abandonment of cultural tastes
9 0.061763853 1501 andrew gelman stats-2012-09-18-More studies on the economic effects of climate change
10 0.061601855 2308 andrew gelman stats-2014-04-27-White stripes and dead armadillos
11 0.061258122 2263 andrew gelman stats-2014-03-24-Empirical implications of Empirical Implications of Theoretical Models
12 0.059859879 360 andrew gelman stats-2010-10-21-Forensic bioinformatics, or, Don’t believe everything you read in the (scientific) papers
13 0.059205033 157 andrew gelman stats-2010-07-21-Roller coasters, charity, profit, hmmm
14 0.057046127 2137 andrew gelman stats-2013-12-17-Replication backlash
16 0.055061586 1492 andrew gelman stats-2012-09-11-Using the “instrumental variables” or “potential outcomes” approach to clarify causal thinking
18 0.048476316 586 andrew gelman stats-2011-02-23-A statistical version of Arrow’s paradox
19 0.048453867 2183 andrew gelman stats-2014-01-23-Discussion on preregistration of research studies
20 0.048085239 1818 andrew gelman stats-2013-04-22-Goal: Rules for Turing chess
topicId topicWeight
[(0, 0.079), (1, -0.024), (2, 0.0), (3, -0.022), (4, 0.007), (5, -0.018), (6, 0.022), (7, 0.004), (8, -0.0), (9, -0.018), (10, -0.011), (11, 0.006), (12, 0.016), (13, -0.008), (14, -0.009), (15, 0.011), (16, 0.031), (17, -0.016), (18, 0.015), (19, -0.005), (20, -0.009), (21, 0.018), (22, -0.008), (23, 0.002), (24, -0.007), (25, 0.011), (26, -0.004), (27, -0.014), (28, 0.013), (29, -0.003), (30, 0.003), (31, -0.006), (32, 0.006), (33, 0.004), (34, -0.001), (35, -0.002), (36, -0.016), (37, 0.016), (38, -0.003), (39, -0.013), (40, -0.02), (41, 0.0), (42, 0.008), (43, 0.005), (44, -0.025), (45, -0.004), (46, -0.022), (47, -0.003), (48, 0.006), (49, 0.002)]
simIndex simValue blogId blogTitle
same-blog 1 0.95475423 2352 andrew gelman stats-2014-05-29-When you believe in things that you don’t understand
Introduction: Rolf Zwaan gives an excellent discussion of how superstition can arise and perpetuate itself: A social-behavioral priming experiment is like rolling a 20-sided die, an icosahedron. If you roll the die a number of times, 20 will turn up at some point. Bingo! You have a significant effect. In fact, given what we now know about questionable and not so questionable research practices, it is fair to assume that the researchers are actually rolling with a 20-sided die where maybe as many as six sides have a 20 on them. So the chances of rolling a 20 are quite high. Once the researchers have rolled a 20, their next interpretive move is to consider the circumstances that happened to coincide with rolling the die instrumental in producing the 20. The only problem is that they don’t know what those circumstances were. Was it the physical condition of the roller? Was it the weather? Was it the time of day? Was it the color of the roller’s sweater? Indeed, we’ve been told first that it
Introduction: I read this front-page New York Times article and was immediately suspicious. Here’s the story (from reporter Gina Kolata): Could exercise actually be bad for some healthy people? A well-known group of researchers, including one who helped write the scientific paper justifying national guidelines that promote exercise for all, say the answer may be a qualified yes. By analyzing data from six rigorous exercise studies involving 1,687 people, the group found that about 10 percent actually got worse on at least one of the measures related to heart disease: blood pressure and levels of insulin, HDL cholesterol or triglycerides. About 7 percent got worse on at least two measures. And the researchers say they do not know why. “It is bizarre,” said Claude Bouchard, lead author of the paper , published on Wednesday in the journal PLoS One . . . Dr. Michael Lauer, director of the Division of Cardiovascular Sciences at the National Heart, Lung, and Blood Institute, the lead federal
3 0.75678021 53 andrew gelman stats-2010-05-26-Tumors, on the left, or on the right?
Introduction: In response to the post The bane of many causes in the context of mobile phone use and brain cancer, Robert Erikson wrote: The true control here is the side of the head of the tumor: same side as phone use or opposite side. If that is the test, the data from the study are scary. Clearly tumors are more likely on the “same” side, at whatever astronomical p value you want to use. That cannot be explained away by misremembering, since an auxiliary study showed misremembering was not biased toward cell phone-tumor consistency. A strong signal in the data pointed by Prof. Erikson is that the tumors are overwhelmingly likelier to appear on the same side of the head as where the phone is held. I’ve converted the ratios into percentages, based on an assumption that the risk for tumors would be apriori equal for both sides of the head. There is a group of people with low-to-moderate exposure and high lateral bias, but the bias does increase quite smoothly with increasing
4 0.7521739 2270 andrew gelman stats-2014-03-28-Creating a Lenin-style democracy
Introduction: Mark Palko explains why a penalty for getting the wrong answer on a test (the SAT, which is used in college admissions and which is used in the famous 8 schools example) is not a “penalty for guessing.” Then the very next day he catches this from Todd Balf in the New York Times Magazine: Students were docked one-quarter point for every multiple-choice question they got wrong, requiring a time-consuming risk analysis to determine which questions to answer and which to leave blank. Ugh! That just makes me want to . . . ok, I won’t go there. Anyway, Palko goes to the trouble to explain: While time management for a test like the SAT can be complicated, the rule for guessing is embarrassingly simple: give your best guess for questions you read; don’t waste time guessing on questions that you didn’t have time to read. The risk analysis actually becomes much more complicated when you take away the penalty for guessing. On the ACT (or the new SAT), there is a positive
Introduction: I came across a document [updated link here ], “Applying structured analogies to the global warming alarm movement,” by Kesten Green and Scott Armstrong. The general approach is appealing to me, but the execution seemed disturbingly flawed. Here’s how they introduce the project: The structured analogies procedure we [Green and Armstrong] used for this study was as follows: 1. Identify possible analogies by searching the literature and by asking experts with different viewpoints to nominate analogies to the target situation: alarm over dangerous manmade global warming. 2. Screen the possible analogies to ensure they meet the stated criteria and that the outcomes are known. 3. Code the relevant characteristics of the analogous situations. 4. Forecast target situation outcomes by using a predetermined mechanical rule to select the outcomes of the analogies. Here is how we posed the question to the experts: The Intergovernmental Panel on Climate Change and other organizat
6 0.75158983 526 andrew gelman stats-2011-01-19-“If it saves the life of a single child…” and other nonsense
8 0.7439006 1905 andrew gelman stats-2013-06-18-There are no fat sprinters
9 0.74110246 457 andrew gelman stats-2010-12-07-Whassup with phantom-limb treatment?
11 0.74035895 1058 andrew gelman stats-2011-12-14-Higgs bozos: Rosencrantz and Guildenstern are spinning in their graves
12 0.74019653 137 andrew gelman stats-2010-07-10-Cost of communicating numbers
13 0.73881924 1724 andrew gelman stats-2013-02-16-Zero Dark Thirty and Bayes’ theorem
14 0.73745567 2158 andrew gelman stats-2014-01-03-Booze: Been There. Done That.
15 0.73716831 504 andrew gelman stats-2011-01-05-For those of you in the U.K., also an amusing paradox involving the infamous hookah story
17 0.73342925 2049 andrew gelman stats-2013-10-03-On house arrest for p-hacking
18 0.73249805 514 andrew gelman stats-2011-01-13-News coverage of statistical issues…how did I do?
19 0.73103517 2053 andrew gelman stats-2013-10-06-Ideas that spread fast and slow
20 0.72851026 69 andrew gelman stats-2010-06-04-A Wikipedia whitewash
topicId topicWeight
[(0, 0.013), (2, 0.037), (8, 0.012), (13, 0.012), (16, 0.133), (24, 0.037), (34, 0.036), (37, 0.05), (45, 0.012), (47, 0.046), (48, 0.011), (62, 0.02), (71, 0.013), (82, 0.028), (84, 0.035), (86, 0.092), (93, 0.019), (95, 0.041), (96, 0.032), (99, 0.218)]
simIndex simValue blogId blogTitle
same-blog 1 0.94521296 2352 andrew gelman stats-2014-05-29-When you believe in things that you don’t understand
Introduction: Rolf Zwaan gives an excellent discussion of how superstition can arise and perpetuate itself: A social-behavioral priming experiment is like rolling a 20-sided die, an icosahedron. If you roll the die a number of times, 20 will turn up at some point. Bingo! You have a significant effect. In fact, given what we now know about questionable and not so questionable research practices, it is fair to assume that the researchers are actually rolling with a 20-sided die where maybe as many as six sides have a 20 on them. So the chances of rolling a 20 are quite high. Once the researchers have rolled a 20, their next interpretive move is to consider the circumstances that happened to coincide with rolling the die instrumental in producing the 20. The only problem is that they don’t know what those circumstances were. Was it the physical condition of the roller? Was it the weather? Was it the time of day? Was it the color of the roller’s sweater? Indeed, we’ve been told first that it
2 0.90175921 185 andrew gelman stats-2010-08-04-Why does anyone support private macroeconomic forecasts?
Introduction: Tyler Cowen asks the above question. I don’t have a full answer, but, in the Economics section of A Quantitative Tour of the Social Sciences , Richard Clarida discusses in detail the ways that researchers have tried to estimate the extent to which government or private forecasts supply additional information.
3 0.88568896 2214 andrew gelman stats-2014-02-17-On deck this week
Introduction: Mon : The Washington Post reprints university press releases without editing them Tues : Florida backlash Wed : The replication and criticism movement is not about suppressing speculative research; rather, it’s all about enabling science’s fabled self-correcting nature Thurs : Do differences between biology and statistics explain some of our diverging attitudes regarding criticism and replication of scientific claims? Fri : The world’s most popular languages that the Mac documentation hasn’t been translated into
4 0.87943316 722 andrew gelman stats-2011-05-20-Why no Wegmania?
Introduction: A colleague asks: When I search the web, I find the story [of the article by Said, Wegman, et al. on social networks in climate research, which was recently bumped from the journal Computational Statistics and Data Analysis because of plagiarism] only on blogs, USA Today, and UPI. Why is that? Any idea why it isn’t reported by any of the major newspapers? Here’s my answer: 1. USA Today broke the story. Apparently this USA Today reporter put a lot of effort into it. The NYT doesn’t like to run a story that begins, “Yesterday, USA Today reported…” 2. To us it’s big news because we’re statisticians. [The main guy in the study, Edward Wegman, won the Founders Award from the American Statistical Association a few years ago.] To the rest of the world, the story is: “Obscure prof at an obscure college plagiarized an article in a journal that nobody’s ever heard of.” When a Harvard scientist paints black dots on white mice and says he’s curing cancer, that’s news. When P
5 0.87522894 636 andrew gelman stats-2011-03-29-The Conservative States of America
Introduction: After noting the increasing political conservatism of people in the poorer states, Richard Florida writes : The current economic crisis only appears to have deepened conservatism’s hold on America’s states. This trend stands in sharp contrast to the Great Depression, when America embraced FDR and the New Deal. Liberalism, which is stronger in richer, better-educated, more-diverse, and, especially, more prosperous places, is shrinking across the board and has fallen behind conservatism even in its biggest strongholds. This obviously poses big challenges for liberals, the Obama administration, and the Democratic Party moving forward. But the much bigger, long-term danger is economic rather than political. This ideological state of affairs advantages the policy preferences of poorer, less innovative states over wealthier, more innovative, and productive ones. American politics is increasingly disconnected from its economic engine. And this deepening political divide has become pe
7 0.87452257 767 andrew gelman stats-2011-06-15-Error in an attribution of an error
8 0.87193614 2182 andrew gelman stats-2014-01-22-Spell-checking example demonstrates key aspects of Bayesian data analysis
9 0.86731017 159 andrew gelman stats-2010-07-23-Popular governor, small state
10 0.86714822 377 andrew gelman stats-2010-10-28-The incoming moderate Republican congressmembers
11 0.8660537 1586 andrew gelman stats-2012-11-21-Readings for a two-week segment on Bayesian modeling?
12 0.86553013 1928 andrew gelman stats-2013-07-06-How to think about papers published in low-grade journals?
13 0.8654424 321 andrew gelman stats-2010-10-05-Racism!
14 0.86532897 1712 andrew gelman stats-2013-02-07-Philosophy and the practice of Bayesian statistics (with all the discussions!)
15 0.86414993 935 andrew gelman stats-2011-10-01-When should you worry about imputed data?
16 0.86397171 1022 andrew gelman stats-2011-11-21-Progress for the Poor
17 0.86378264 2107 andrew gelman stats-2013-11-20-NYT (non)-retraction watch
18 0.86289847 154 andrew gelman stats-2010-07-18-Predictive checks for hierarchical models
19 0.86284447 445 andrew gelman stats-2010-12-03-Getting a job in pro sports… as a statistician
20 0.86278105 609 andrew gelman stats-2011-03-13-Coauthorship norms