andrew_gelman_stats andrew_gelman_stats-2011 andrew_gelman_stats-2011-1060 knowledge-graph by maker-knowledge-mining

1060 andrew gelman stats-2011-12-15-Freakonomics: What went wrong?


meta infos for this blog

Source: html

Introduction: Kaiser and I tell the story . Regular readers will be familiar with much of this material. We kept our article short because of space restrictions at American Scientist magazine. Now I want to do a follow-up with all the good stories that we had to cut. P.S. Let me remind everyone once again that Freakonomics (the book and the blog) has some great stuff. Kaiser and I are only picking on Levitt & co. because we know they could do so much better. P.P.S. Just to emphasize: our point that Freakonomics has mistakes is nothing new—see, for example, the articles and blogs by Felix Salmon, Ariel Rubenstein, John DiNardo, and Daniel Davies. The contribution of our new article is explore how it was that all these mistakes happened, to juxtapose the many strengths of the Freakonomics franchise (much of the work described in the first book but also a lot of what appears on their blog) with its failings. In some ways these contrasts are characteristic of social science research in


Summary: the most important sentenses genereted by tfidf model

sentIndex sentText sentNum sentScore

1 Regular readers will be familiar with much of this material. [sent-2, score-0.115]

2 We kept our article short because of space restrictions at American Scientist magazine. [sent-3, score-0.079]

3 Let me remind everyone once again that Freakonomics (the book and the blog) has some great stuff. [sent-7, score-0.082]

4 Just to emphasize: our point that Freakonomics has mistakes is nothing new—see, for example, the articles and blogs by Felix Salmon, Ariel Rubenstein, John DiNardo, and Daniel Davies. [sent-13, score-0.112]

5 The contribution of our new article is explore how it was that all these mistakes happened, to juxtapose the many strengths of the Freakonomics franchise (much of the work described in the first book but also a lot of what appears on their blog) with its failings. [sent-14, score-0.402]

6 In some ways these contrasts are characteristic of social science research in general: a mix of careful assessment of assumptions (for example, in the use of instrumental variables analysis rather than simple comparisons to estimate causal effects) and casual storytelling. [sent-15, score-0.481]

7 ” story has an additional factor: Levitt’s somewhat unstable mix of skepticism and trust, as indicated by, on one hand, his self-labeling as a “rogue economist” and, on the other, his experiences as a corporate consultant and student and teacher at elite universities. [sent-17, score-0.493]

8 As we write: We attribute many of these errors to the structure of the authors’ collaboration, which, from what we can tell, relies on an informal social network that has many potential failure points. [sent-18, score-0.339]

9 In the original Freakonomics, much of whose content appeared originally in columns for the New York Times Magazine, the network seems to have been more straightforward: Levitt did the research, Dubner trusted Levitt, the Times trusted Dubner, and we the readers trusted the Times’s endorsement. [sent-19, score-1.024]

10 In SuperFreakonomics and the authors’ blog, it becomes less clear: Levitt trusts brilliant stars such as [software executive Nathan] Myhrvold or [economics professor Emily] Oster, Dubner trusts Levitt, and we the readers trust the Freakonomics brand. [sent-20, score-0.877]


similar blogs computed by tfidf model

tfidf for this blog:

wordName wordTfidf (topN-words)

[('freakonomics', 0.401), ('levitt', 0.387), ('dubner', 0.241), ('trusted', 0.237), ('trusts', 0.215), ('kaiser', 0.173), ('network', 0.122), ('readers', 0.115), ('mix', 0.112), ('mistakes', 0.112), ('juxtapose', 0.107), ('trust', 0.105), ('times', 0.103), ('franchise', 0.097), ('rubenstein', 0.097), ('ariel', 0.094), ('oster', 0.091), ('brand', 0.088), ('contrasts', 0.088), ('myhrvold', 0.088), ('stars', 0.088), ('dinardo', 0.086), ('consultant', 0.086), ('strengths', 0.086), ('rogue', 0.086), ('unstable', 0.085), ('emily', 0.083), ('remind', 0.082), ('tell', 0.081), ('authors', 0.079), ('restrictions', 0.079), ('characteristic', 0.078), ('straightforward', 0.078), ('relies', 0.077), ('columns', 0.076), ('nathan', 0.073), ('indicated', 0.073), ('felix', 0.072), ('salmon', 0.072), ('blog', 0.071), ('instrumental', 0.07), ('corporate', 0.07), ('attribute', 0.07), ('executive', 0.07), ('informal', 0.07), ('collaboration', 0.07), ('brilliant', 0.069), ('elite', 0.067), ('casual', 0.067), ('assessment', 0.066)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 1.0000001 1060 andrew gelman stats-2011-12-15-Freakonomics: What went wrong?

Introduction: Kaiser and I tell the story . Regular readers will be familiar with much of this material. We kept our article short because of space restrictions at American Scientist magazine. Now I want to do a follow-up with all the good stories that we had to cut. P.S. Let me remind everyone once again that Freakonomics (the book and the blog) has some great stuff. Kaiser and I are only picking on Levitt & co. because we know they could do so much better. P.P.S. Just to emphasize: our point that Freakonomics has mistakes is nothing new—see, for example, the articles and blogs by Felix Salmon, Ariel Rubenstein, John DiNardo, and Daniel Davies. The contribution of our new article is explore how it was that all these mistakes happened, to juxtapose the many strengths of the Freakonomics franchise (much of the work described in the first book but also a lot of what appears on their blog) with its failings. In some ways these contrasts are characteristic of social science research in

2 0.54185683 1100 andrew gelman stats-2012-01-05-Freakonomics: Why ask “What went wrong?”

Introduction: A friend/colleague sent me some comments on my recent article with Kaiser Fung on Freakonomics. My friend gave several reasons why he thought we were unfair to Levitt. I’ll give my reply (my friend preferred that I not quote his email, but you can get a general sense of the questions from my answers). But first let me point you to my original post, Freakonomics 2: What went wrong? , from a couple years ago, in which I raised many of the points that ultimately went into our article. And here’s my recent note. (I numbered my points, but the email I was replying to was not numbered. This is not a point-by-point rebuttal to anything but rather just a series of remarks.) 1. Both Kaiser and I are big fans of Freakonomics. It’s only because Levitt can (and has) done better, that we’re sad when he doesn’t live up to his own high standards. If we didn’t convey this sense of respect in our American Scientist article, that is our failing. 2. I think it was at best tacky and

3 0.47505212 1223 andrew gelman stats-2012-03-20-A kaleidoscope of responses to Dubner’s criticisms of our criticisms of Freaknomics

Introduction: Jonathan Cantor pointed me to a new blog post by Stephen Dubner in which he expresses disagreement with what Kaiser and I wrote in our American Scientist article , “Freakonomics: What Went Wrong?”. In response, I thought it would be interesting to go “meta” here by considering all the different ways ways that I could reply to Dubner’s criticism of our criticism of his writings. (In the same post, Dubner also slams Chris Blattman (or, as he calls him, “a man named Chris Blattman”), but I won’t get into that here.) In reacting to Dubner, I will give several perspectives, all of which I believe . Usually in writing a response, one would have to choose, but here I find it interesting to present all these different perspectives in one place. 1. Understand. I understand where Dubner is coming from. We say some positive things and some negative things about his work, but it’s natural for him to focus on the negative. I’m the same way myself, probably almost all autho

4 0.38229913 170 andrew gelman stats-2010-07-29-When is expertise relevant?

Introduction: Responding to journalist Elizabeth Kolbert’s negative review of Freakonomics 2 in the New Yorker, Stephen Dubner writes , that, although they do not have any training in climate science, it’s also the case that: Neither of us [Levitt and Dubner] were Ku Klux Klan members either, or sumo wrestlers or Realtors or abortion providers or schoolteachers or even pimps. And yet somehow we managed to write about all that without any horse dung (well, not much at least) flying our way. But Levitt is a schoolteacher (at the University of Chicago)! And, of course, you don’t have to be a sumo wrestler to be (some kind of an) expert on sumo wrestling, nor do you have to teach in the K-12 system to be an expert in education, nor do you have to provide abortions to be an expert on abortion, etc. And Levitt has had quite a bit of horse dung thrown at him for the abortion research. The connection is that abortion and climate change matter to a lot of people, while sumo wrestling and pimps and

5 0.32859147 1692 andrew gelman stats-2013-01-25-Freakonomics Experiments

Introduction: Stephen Dubner writes : Freakonomics Experiments is a set of simple experiments about complex issues—whether to break up with your significant other, quit your job, or start a diet, just to name a few. . . . a collaboration between researchers at the University of Chicago, Freakonomics, and—we hope!—you. Steve Levitt and John List, of the University of Chicago, run the experimental and statistical side of things. Stephen Dubner, Steve Levitt, and the Freakonomics staff have given these experiments the Freakonomics twist you’re used to. Once you flip the coin, you become a member of the most important part of the collaboration, the Freakonomics Experiments team. Without your participation, we couldn’t complete any of this research. . . . You’ll choose a question that you are facing today, such as whether to quit your job or buy a house. Then you’ll provide us some background information about yourself. After that, you’ll flip the coin to find out what you should do in your situati

6 0.28837594 1650 andrew gelman stats-2013-01-03-Did Steven Levitt really believe in 2008 that Obama “would be the greatest president in history”?

7 0.24853887 334 andrew gelman stats-2010-10-11-Herman Chernoff used to do that too; also, some puzzlement over another’s puzzlement over another’s preferences

8 0.23362112 1180 andrew gelman stats-2012-02-22-I’m officially no longer a “rogue”

9 0.20327421 1632 andrew gelman stats-2012-12-20-Who exactly are those silly academics who aren’t as smart as a Vegas bookie?

10 0.19040281 943 andrew gelman stats-2011-10-04-Flip it around

11 0.16422693 1491 andrew gelman stats-2012-09-10-Update on Levitt paper on child car seats

12 0.1555739 809 andrew gelman stats-2011-07-19-“One of the easiest ways to differentiate an economist from almost anyone else in society”

13 0.15087928 993 andrew gelman stats-2011-11-05-The sort of thing that gives technocratic reasoning a bad name

14 0.14021975 1456 andrew gelman stats-2012-08-13-Macro, micro, and conflicts of interest

15 0.1243974 120 andrew gelman stats-2010-06-30-You can’t put Pandora back in the box

16 0.12208664 1099 andrew gelman stats-2012-01-05-Approaching harmonic convergence

17 0.11297493 622 andrew gelman stats-2011-03-21-A possible resolution of the albedo mystery!

18 0.10600582 2186 andrew gelman stats-2014-01-26-Infoviz on top of stat graphic on top of spreadsheet

19 0.10467257 543 andrew gelman stats-2011-01-28-NYT shills for personal DNA tests

20 0.10249183 344 andrew gelman stats-2010-10-15-Story time


similar blogs computed by lsi model

lsi for this blog:

topicId topicWeight

[(0, 0.15), (1, -0.082), (2, -0.05), (3, -0.004), (4, -0.025), (5, -0.017), (6, 0.033), (7, -0.002), (8, 0.073), (9, 0.113), (10, -0.089), (11, -0.05), (12, -0.037), (13, 0.016), (14, -0.146), (15, -0.018), (16, -0.164), (17, 0.28), (18, 0.033), (19, 0.137), (20, -0.131), (21, -0.034), (22, 0.111), (23, -0.066), (24, 0.138), (25, -0.207), (26, 0.133), (27, 0.009), (28, 0.236), (29, -0.096), (30, 0.03), (31, -0.061), (32, -0.064), (33, 0.039), (34, -0.042), (35, 0.065), (36, -0.038), (37, 0.009), (38, -0.056), (39, -0.045), (40, -0.053), (41, -0.018), (42, -0.005), (43, 0.014), (44, 0.036), (45, 0.011), (46, -0.037), (47, 0.005), (48, -0.049), (49, 0.019)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 0.97070831 1060 andrew gelman stats-2011-12-15-Freakonomics: What went wrong?

Introduction: Kaiser and I tell the story . Regular readers will be familiar with much of this material. We kept our article short because of space restrictions at American Scientist magazine. Now I want to do a follow-up with all the good stories that we had to cut. P.S. Let me remind everyone once again that Freakonomics (the book and the blog) has some great stuff. Kaiser and I are only picking on Levitt & co. because we know they could do so much better. P.P.S. Just to emphasize: our point that Freakonomics has mistakes is nothing new—see, for example, the articles and blogs by Felix Salmon, Ariel Rubenstein, John DiNardo, and Daniel Davies. The contribution of our new article is explore how it was that all these mistakes happened, to juxtapose the many strengths of the Freakonomics franchise (much of the work described in the first book but also a lot of what appears on their blog) with its failings. In some ways these contrasts are characteristic of social science research in

2 0.90622103 1100 andrew gelman stats-2012-01-05-Freakonomics: Why ask “What went wrong?”

Introduction: A friend/colleague sent me some comments on my recent article with Kaiser Fung on Freakonomics. My friend gave several reasons why he thought we were unfair to Levitt. I’ll give my reply (my friend preferred that I not quote his email, but you can get a general sense of the questions from my answers). But first let me point you to my original post, Freakonomics 2: What went wrong? , from a couple years ago, in which I raised many of the points that ultimately went into our article. And here’s my recent note. (I numbered my points, but the email I was replying to was not numbered. This is not a point-by-point rebuttal to anything but rather just a series of remarks.) 1. Both Kaiser and I are big fans of Freakonomics. It’s only because Levitt can (and has) done better, that we’re sad when he doesn’t live up to his own high standards. If we didn’t convey this sense of respect in our American Scientist article, that is our failing. 2. I think it was at best tacky and

3 0.88393331 1223 andrew gelman stats-2012-03-20-A kaleidoscope of responses to Dubner’s criticisms of our criticisms of Freaknomics

Introduction: Jonathan Cantor pointed me to a new blog post by Stephen Dubner in which he expresses disagreement with what Kaiser and I wrote in our American Scientist article , “Freakonomics: What Went Wrong?”. In response, I thought it would be interesting to go “meta” here by considering all the different ways ways that I could reply to Dubner’s criticism of our criticism of his writings. (In the same post, Dubner also slams Chris Blattman (or, as he calls him, “a man named Chris Blattman”), but I won’t get into that here.) In reacting to Dubner, I will give several perspectives, all of which I believe . Usually in writing a response, one would have to choose, but here I find it interesting to present all these different perspectives in one place. 1. Understand. I understand where Dubner is coming from. We say some positive things and some negative things about his work, but it’s natural for him to focus on the negative. I’m the same way myself, probably almost all autho

4 0.87201077 334 andrew gelman stats-2010-10-11-Herman Chernoff used to do that too; also, some puzzlement over another’s puzzlement over another’s preferences

Introduction: Steven Levitt writes :. Diamond often would fall asleep in seminars, often for large chunks of time. What was amazing, however, is that he would open his eyes and then make by far the most insightful comment of the entire seminar! Now that we have n=2 [see the first part of the title of this blog entry], I’m wondering . . . maybe this sort of thing is more common than Levitt and I had realized. P.S. Levitt also writes: The one thing that puzzles me [Levitt] is why in the world would he want to be on the Board of the Federal Reserve? One thing economists just don’t understand are people’s preferences. To get meta here for a moment . . . just as Levitt can’t understand Diamond’s preferences, I find it extremely difficult to understand that Levitt is puzzled by Diamond’s desire to serve on the Federal Reserve, It’s obvious, no? Diamond has expertise on macroeconomics and, I assume, some strong and well-informed opinions on monetary policy; the Federal Reserve determ

5 0.86265165 170 andrew gelman stats-2010-07-29-When is expertise relevant?

Introduction: Responding to journalist Elizabeth Kolbert’s negative review of Freakonomics 2 in the New Yorker, Stephen Dubner writes , that, although they do not have any training in climate science, it’s also the case that: Neither of us [Levitt and Dubner] were Ku Klux Klan members either, or sumo wrestlers or Realtors or abortion providers or schoolteachers or even pimps. And yet somehow we managed to write about all that without any horse dung (well, not much at least) flying our way. But Levitt is a schoolteacher (at the University of Chicago)! And, of course, you don’t have to be a sumo wrestler to be (some kind of an) expert on sumo wrestling, nor do you have to teach in the K-12 system to be an expert in education, nor do you have to provide abortions to be an expert on abortion, etc. And Levitt has had quite a bit of horse dung thrown at him for the abortion research. The connection is that abortion and climate change matter to a lot of people, while sumo wrestling and pimps and

6 0.85991186 1692 andrew gelman stats-2013-01-25-Freakonomics Experiments

7 0.83248937 1099 andrew gelman stats-2012-01-05-Approaching harmonic convergence

8 0.8212325 1632 andrew gelman stats-2012-12-20-Who exactly are those silly academics who aren’t as smart as a Vegas bookie?

9 0.79392272 1180 andrew gelman stats-2012-02-22-I’m officially no longer a “rogue”

10 0.76398385 1650 andrew gelman stats-2013-01-03-Did Steven Levitt really believe in 2008 that Obama “would be the greatest president in history”?

11 0.67638165 1491 andrew gelman stats-2012-09-10-Update on Levitt paper on child car seats

12 0.67079979 993 andrew gelman stats-2011-11-05-The sort of thing that gives technocratic reasoning a bad name

13 0.63611072 1456 andrew gelman stats-2012-08-13-Macro, micro, and conflicts of interest

14 0.57954276 74 andrew gelman stats-2010-06-08-“Extreme views weakly held”

15 0.5590601 622 andrew gelman stats-2011-03-21-A possible resolution of the albedo mystery!

16 0.54980808 943 andrew gelman stats-2011-10-04-Flip it around

17 0.51244146 339 andrew gelman stats-2010-10-13-Battle of the NYT opinion-page economists

18 0.48790035 809 andrew gelman stats-2011-07-19-“One of the easiest ways to differentiate an economist from almost anyone else in society”

19 0.46174788 1108 andrew gelman stats-2012-01-09-Blogging, polemical and otherwise

20 0.44634122 13 andrew gelman stats-2010-04-30-Things I learned from the Mickey Kaus for Senate campaign


similar blogs computed by lda model

lda for this blog:

topicId topicWeight

[(16, 0.133), (17, 0.017), (24, 0.084), (34, 0.018), (42, 0.207), (47, 0.016), (53, 0.013), (55, 0.03), (82, 0.016), (86, 0.03), (99, 0.288)]

similar blogs list:

simIndex simValue blogId blogTitle

1 0.95786262 1775 andrew gelman stats-2013-03-23-In which I disagree with John Maynard Keynes

Introduction: In his review in 1938 of Historical Development of the Graphical Representation of Statistical Data , by H. Gray Funkhauser, for The Economic Journal , the great economist writes: Perhaps the most striking outcome of Mr. Funkhouser’s researches is the fact of the very slow progress which graphical methods made until quite recently. . . . In the first fifty volumes of the Statistical Journal, 1837-87, only fourteen graphs are printed altogether. It is surprising to be told that Laplace never drew a graph of the normal law of error . . . Edgeworth made no use of statistical charts as distinct from mathematical diagrams. Apart from Quetelet and Jevons, the most important influences were probably those of Galton and of Mulhall’s Dictionary, first published in 1884. Galton was indeed following his father and grandfather in this field, but his pioneer work was mainly restricted to meteorological maps, and he did not contribute to the development of the graphical representation of ec

same-blog 2 0.94466496 1060 andrew gelman stats-2011-12-15-Freakonomics: What went wrong?

Introduction: Kaiser and I tell the story . Regular readers will be familiar with much of this material. We kept our article short because of space restrictions at American Scientist magazine. Now I want to do a follow-up with all the good stories that we had to cut. P.S. Let me remind everyone once again that Freakonomics (the book and the blog) has some great stuff. Kaiser and I are only picking on Levitt & co. because we know they could do so much better. P.P.S. Just to emphasize: our point that Freakonomics has mistakes is nothing new—see, for example, the articles and blogs by Felix Salmon, Ariel Rubenstein, John DiNardo, and Daniel Davies. The contribution of our new article is explore how it was that all these mistakes happened, to juxtapose the many strengths of the Freakonomics franchise (much of the work described in the first book but also a lot of what appears on their blog) with its failings. In some ways these contrasts are characteristic of social science research in

3 0.93037838 483 andrew gelman stats-2010-12-23-Science, ideology, and human origins

Introduction: A link from Tyler Cowen led me to this long blog article by Razib Khan, discussing some recent genetic findings on human origins in the context of the past twenty-five years of research and popularization of science. I don’t know much about human origins (beyond my ooh-that’s-cool reactions to exhibits at the Natural History Museum, my general statistician’s skepticism at various over-the-top claims I’ve heard over the years about “mitochondrial Eve” and the like, and various bits I’ve read over the years regarding when people came over to Australia, America, etc.), but what particularly interested me about Khan’s article was his discussion about the various controversies among scientists, his own reactions when reading and thinking about these issues as they were happening (Khan was a student at the time), and the interaction between science and political ideology. There’s a limit to how far you can go with this sort of cultural criticism of science, and Khan realizes this

4 0.92571634 713 andrew gelman stats-2011-05-15-1-2 social scientist + 1-2 politician = ???

Introduction: A couple things in this interview by Andrew Goldman of Larry Summers currently irritated me. I’ll give the quotes and then explain my annoyance. 1. Goldman: What would the economy look like now if $1.2 trillion had been spent? Summers: I think it’s an artificial question because there would have been all kinds of problems in actually moving $1.2 trillion dollars through the system — finding enough bridge projects that were ready to go and the like. But the recovery probably would have proceeded more rapidly if the fiscal program had been larger. . . . 2. Goldman: You’re aware of — and were making light of — the fact that you occasionally rub people the wrong way. Summers: In meetings, I’m more focused on trying to figure out what the right answer is than making everybody feel validated. In Washington and at Harvard, that sometimes rubs people the wrong way. OK, now my reactions: 1. Not enough bridge projects, huh? I don’t believe it. We’ve been hearing fo

5 0.92336845 808 andrew gelman stats-2011-07-18-The estimated effect size is implausibly large. Under what models is this a piece of evidence that the true effect is small?

Introduction: Paul Pudaite writes in response to my discussion with Bartels regarding effect sizes and measurement error models: You [Gelman] wrote: “I actually think there will be some (non-Gaussian) models for which, as y gets larger, E(x|y) can actually go back toward zero.” I [Pudaite] encountered this phenomenon some time in the ’90s. See this graph which shows the conditional expectation of X given Z, when Z = X + Y and the probability density functions of X and Y are, respectively, exp(-x^2) and 1/(y^2+1) (times appropriate constants). As the magnitude of Z increases, E[X|Z] shrinks to zero. I wasn’t sure it was worth the effort to try to publish a two paragraph paper. I suspect that this is true whenever the tail of one distribution is ‘sufficiently heavy’ with respect to the tail of the other. Hmm, I suppose there might be enough substance in a paper that attempted to characterize this outcome for, say, unimodal symmetric distributions. Maybe someone can do this? I think i

6 0.91643375 590 andrew gelman stats-2011-02-25-Good introductory book for statistical computation?

7 0.91530341 492 andrew gelman stats-2010-12-30-That puzzle-solving feeling

8 0.91394722 1002 andrew gelman stats-2011-11-10-“Venetia Orcutt, GWU med school professor, quits after complaints of no-show class”

9 0.91064262 60 andrew gelman stats-2010-05-30-What Auteur Theory and Freshwater Economics have in common

10 0.90515983 1138 andrew gelman stats-2012-01-25-Chris Schmid on Evidence Based Medicine

11 0.90189767 111 andrew gelman stats-2010-06-26-Tough love as a style of writing

12 0.90154928 1535 andrew gelman stats-2012-10-16-Bayesian analogue to stepwise regression?

13 0.89906204 1936 andrew gelman stats-2013-07-13-Economic policy does not occur in a political vacuum

14 0.8954128 943 andrew gelman stats-2011-10-04-Flip it around

15 0.89537627 746 andrew gelman stats-2011-06-05-An unexpected benefit of Arrow’s other theorem

16 0.89424372 1726 andrew gelman stats-2013-02-18-What to read to catch up on multivariate statistics?

17 0.89338779 1791 andrew gelman stats-2013-04-07-Scatterplot charades!

18 0.8899259 2323 andrew gelman stats-2014-05-07-Cause he thinks he’s so-phisticated

19 0.88973272 307 andrew gelman stats-2010-09-29-“Texting bans don’t reduce crashes; effects are slight crash increases”

20 0.88840097 1844 andrew gelman stats-2013-05-06-Against optimism about social science