andrew_gelman_stats andrew_gelman_stats-2011 andrew_gelman_stats-2011-649 knowledge-graph by maker-knowledge-mining

649 andrew gelman stats-2011-04-05-Internal and external forecasting


meta infos for this blog

Source: html

Introduction: Some thoughts on the implausibility of Paul Ryan’s 2.8% unemployment forecast. Some general issues arise. P.S. Yes, Democrats also have been known to promote optimistic forecasts!


Summary: the most important sentenses genereted by tfidf model

sentIndex sentText sentNum sentScore

1 Some thoughts on the implausibility of Paul Ryan’s 2. [sent-1, score-0.643]

2 Yes, Democrats also have been known to promote optimistic forecasts! [sent-6, score-0.967]


similar blogs computed by tfidf model

tfidf for this blog:

wordName wordTfidf (topN-words)

[('implausibility', 0.456), ('optimistic', 0.381), ('ryan', 0.334), ('promote', 0.326), ('forecasts', 0.296), ('unemployment', 0.281), ('democrats', 0.245), ('paul', 0.233), ('known', 0.196), ('thoughts', 0.187), ('issues', 0.172), ('yes', 0.16), ('general', 0.124), ('also', 0.064)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 1.0 649 andrew gelman stats-2011-04-05-Internal and external forecasting

Introduction: Some thoughts on the implausibility of Paul Ryan’s 2.8% unemployment forecast. Some general issues arise. P.S. Yes, Democrats also have been known to promote optimistic forecasts!

2 0.13069732 286 andrew gelman stats-2010-09-20-Are the Democrats avoiding a national campaign?

Introduction: Bob Erikson, one of my colleagues at Columbia who knows much more about American politics than I do, sent in the following screed. I’ll post Bob’s note, followed by my comments. Bob writes: Monday morning many of us were startled by the following headline: White House strenuously denies NYT report that it is considering getting aggressive about winning the midterm elections. At first I [Bob] thought I was reading the Onion, but no, it was a sarcastic comment on the blog Talking Points Memo. But the gist of the headline appears to be correct. Indeed, the New York Times reported that White House advisers denied that a national ad campaign was being planned. ‘There’s been no discussion of such a thing at the White House’ What do we make of this? Is there some hidden downside to actually running a national campaign? Of course, money spent nationally is not spent on targeted local campaigns. But that is always the case. What explains the Democrats’ trepidation abou

3 0.10959269 642 andrew gelman stats-2011-04-02-Bill James and the base-rate fallacy

Introduction: I was recently rereading and enjoying Bill James’s Historical Baseball Abstract (the second edition, from 2001). But even the Master is not perfect. Here he is, in the context of the all-time 20th-greatest shortstop (in his reckoning): Are athletes special people? In general, no, but occasionally, yes. Johnny Pesky at 75 was trim, youthful, optimistic, and practically exploding with energy. You rarely meet anybody like that who isn’t an ex-athlete–and that makes athletes seem special. [italics in the original] Hey, I’ve met 75-year-olds like that–and none of them are ex-athletes! That’s probably because I don’t know a lot of ex-athletes. But Bill James . . . he knows a lot of athletes. He went to the bathroom with Tim Raines once! The most I can say is that I saw Rickey Henderson steal a couple bases when he was playing against the Orioles once. Cognitive psychologists talk about the base-rate fallacy , which is the mistake of estimating probabilities without accou

4 0.10489561 187 andrew gelman stats-2010-08-05-Update on state size and governors’ popularity

Introduction: Nick Obradovich saw our graphs and regressions showing that the most popular governors tended to come from small states and suggested looking at unemployment rates. (I’d used change in per-capita income as my economic predictor, following the usual practice in political science.) Here’s the graph that got things started: And here’s what Obradovich wrote: It seems that average unemployment rate is more strongly negatively correlated with positive governor approval ratings than is population. The unemployment rate and state size is positively correlated. Anyway, when I include state unemployment rate in the regressions, it pulls the significance away from state population. I do economic data work much of the day, so when I read your post this morning and looked at your charts, state unemployment rates jumped right out at me as a potential confound. I passed this suggestion on to Hanfei, who ran some regressions: lm (popularity ~ c.log.statepop + c.unemployment)

5 0.10189509 2343 andrew gelman stats-2014-05-22-Big Data needs Big Model

Introduction: Gary Marcus and Ernest Davis wrote this useful news article on the promise and limitations of “big data.” And let me add this related point: Big data are typically not random samples, hence the need for “big model” to map from sample to population. Here’s an example (with Wei Wang, David Rothschild, and Sharad Goel): Election forecasts have traditionally been based on representative polls, in which randomly sampled individuals are asked for whom they intend to vote. While representative polling has historically proven to be quite effective, it comes at considerable financial and time costs. Moreover, as response rates have declined over the past several decades, the statistical ben- efits of representative sampling have diminished. In this paper, we show that with proper statistical adjustment, non-representative polls can be used to generate accurate election forecasts, and often faster and at less expense than traditional survey methods. We demon- strate this approach

6 0.09407866 1396 andrew gelman stats-2012-06-27-Recently in the sister blog

7 0.093244284 2181 andrew gelman stats-2014-01-21-The Commissar for Traffic presents the latest Five-Year Plan

8 0.089198768 1431 andrew gelman stats-2012-07-27-Overfitting

9 0.088292234 79 andrew gelman stats-2010-06-10-What happens when the Democrats are “fighting Wall Street with one hand, unions with the other,” while the Republicans are fighting unions with two hands?

10 0.08816056 391 andrew gelman stats-2010-11-03-Some thoughts on election forecasting

11 0.087681048 182 andrew gelman stats-2010-08-03-Nebraska never looked so appealing: anatomy of a zombie attack. Oops, I mean a recession.

12 0.082848117 394 andrew gelman stats-2010-11-05-2010: What happened?

13 0.078380145 1946 andrew gelman stats-2013-07-19-Prior distributions on derived quantities rather than on parameters themselves

14 0.076388612 185 andrew gelman stats-2010-08-04-Why does anyone support private macroeconomic forecasts?

15 0.072794221 237 andrew gelman stats-2010-08-27-Bafumi-Erikson-Wlezien predict a 50-seat loss for Democrats in November

16 0.072202444 323 andrew gelman stats-2010-10-06-Sociotropic Voting and the Media

17 0.07153374 1388 andrew gelman stats-2012-06-22-Americans think economy isn’t so bad in their city but is crappy nationally and globally

18 0.067430608 2255 andrew gelman stats-2014-03-19-How Americans vote

19 0.065887466 1168 andrew gelman stats-2012-02-14-The tabloids strike again

20 0.065199189 1985 andrew gelman stats-2013-08-16-Learning about correlations using cross-sectional and over-time comparisons between and within countries


similar blogs computed by lsi model

lsi for this blog:

topicId topicWeight

[(0, 0.044), (1, -0.016), (2, 0.057), (3, 0.038), (4, -0.033), (5, -0.003), (6, -0.027), (7, -0.021), (8, -0.006), (9, 0.022), (10, 0.011), (11, 0.015), (12, 0.005), (13, -0.012), (14, -0.004), (15, -0.02), (16, -0.025), (17, 0.004), (18, -0.017), (19, 0.011), (20, -0.013), (21, 0.017), (22, -0.016), (23, 0.021), (24, 0.01), (25, 0.013), (26, 0.015), (27, -0.0), (28, -0.003), (29, 0.018), (30, 0.009), (31, 0.046), (32, 0.006), (33, -0.016), (34, -0.049), (35, 0.02), (36, -0.009), (37, 0.028), (38, 0.032), (39, -0.005), (40, -0.023), (41, 0.021), (42, 0.037), (43, -0.019), (44, 0.012), (45, 0.045), (46, 0.028), (47, -0.026), (48, 0.017), (49, 0.009)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 0.98272961 649 andrew gelman stats-2011-04-05-Internal and external forecasting

Introduction: Some thoughts on the implausibility of Paul Ryan’s 2.8% unemployment forecast. Some general issues arise. P.S. Yes, Democrats also have been known to promote optimistic forecasts!

2 0.70598453 286 andrew gelman stats-2010-09-20-Are the Democrats avoiding a national campaign?

Introduction: Bob Erikson, one of my colleagues at Columbia who knows much more about American politics than I do, sent in the following screed. I’ll post Bob’s note, followed by my comments. Bob writes: Monday morning many of us were startled by the following headline: White House strenuously denies NYT report that it is considering getting aggressive about winning the midterm elections. At first I [Bob] thought I was reading the Onion, but no, it was a sarcastic comment on the blog Talking Points Memo. But the gist of the headline appears to be correct. Indeed, the New York Times reported that White House advisers denied that a national ad campaign was being planned. ‘There’s been no discussion of such a thing at the White House’ What do we make of this? Is there some hidden downside to actually running a national campaign? Of course, money spent nationally is not spent on targeted local campaigns. But that is always the case. What explains the Democrats’ trepidation abou

3 0.69040769 659 andrew gelman stats-2011-04-13-Jim Campbell argues that Larry Bartels’s “Unequal Democracy” findings are not robust

Introduction: A few years ago Larry Bartels presented this graph, a version of which latter appeared in his book Unequal Democracy: Larry looked at the data in a number of ways, and the evidence seemed convincing that, at least in the short term, the Democrats were better than Republicans for the economy. This is consistent with Democrats’ general policies of lowering unemployment, as compared to Republicans lowering inflation, and, by comparing first-term to second-term presidents, he found that the result couldn’t simply be explained as a rebound or alternation pattern. The question then arose, why have the Republicans won so many elections? Why aren’t the Democrats consistently dominating? Non-economic issues are part of the story, of course, but lots of evidence shows the economy to be a key concern for voters, so it’s still hard to see how, with a pattern such as shown above, the Republicans could keep winning. Larry had some explanations, largely having to do with timing: under De

4 0.68137068 1512 andrew gelman stats-2012-09-27-A Non-random Walk Down Campaign Street

Introduction: Political campaigns are commonly understood as random walks, during which, at any point in time, the level of support for any party or candidate is equally likely to go up or down. Each shift in the polls is then interpreted as the result of some combination of news and campaign strategies. A completely different story of campaigns is the mean reversion model in which the elections are determined by fundamental factors of the economy and partisanship; the role of the campaign is to give voters a chance to reach their predetermined positions. The popularity of the random walk model for polls may be partially explained via analogy to the widespread idea that stock prices reflect all available information, as popularized in Burton Malkiel’s book, A Random Walk Down Wall Street. Once the idea has sunk in that short-term changes in the stock market are inherently unpredictable, it is natural for journalists to think the same of polls. For example, political analyst Nate Silver wrote

5 0.67228067 384 andrew gelman stats-2010-10-31-Two stories about the election that I don’t believe

Introduction: I don’t exactly disagree with the two arguments that I reproduce below, but I think they miss the point. Is “the battle over elitism” really central to this election? First, the easy one. Peter Baker in the New York Times, under the heading, “Elitism: The Charge That Obama Can’t Shake”: For all the discussion of health care and spending and jobs, at the core of the nation’s debate this fall has been the battle of elitism. . . . Ron Bonjean, a Republican strategist, said Mr. Obama had not connected with popular discontent. “A lot of people have never been to Washington or New York, and they feel people there are so out of touch,” he said. . . . Rather than entertaining the possibility that the program they have pursued is genuinely and even legitimately unpopular, the White House and its allies have concluded that their political troubles amount to mainly a message and image problem. I think this is misleading for the usual reason that these message-oriented critiques are

6 0.66313261 43 andrew gelman stats-2010-05-19-What do Tuesday’s elections tell us about November?

7 0.65103418 394 andrew gelman stats-2010-11-05-2010: What happened?

8 0.64986217 84 andrew gelman stats-2010-06-14-Is it 1930?

9 0.63713449 551 andrew gelman stats-2011-02-02-Obama and Reagan, sitting in a tree, etc.

10 0.63597494 323 andrew gelman stats-2010-10-06-Sociotropic Voting and the Media

11 0.62565863 1020 andrew gelman stats-2011-11-20-No no no no no

12 0.61847812 521 andrew gelman stats-2011-01-17-“the Tea Party’s ire, directed at Democrats and Republicans alike”

13 0.60588223 2343 andrew gelman stats-2014-05-22-Big Data needs Big Model

14 0.60572952 1388 andrew gelman stats-2012-06-22-Americans think economy isn’t so bad in their city but is crappy nationally and globally

15 0.59907162 237 andrew gelman stats-2010-08-27-Bafumi-Erikson-Wlezien predict a 50-seat loss for Democrats in November

16 0.5928672 312 andrew gelman stats-2010-10-02-“Regression to the mean” is fine. But what’s the “mean”?

17 0.58238423 2228 andrew gelman stats-2014-02-28-Combining two of my interests

18 0.57839322 656 andrew gelman stats-2011-04-11-Jonathan Chait and I agree about the importance of the fundamentals in determining presidential elections

19 0.57691562 2005 andrew gelman stats-2013-09-02-“Il y a beaucoup de candidats démocrates, et leurs idéologies ne sont pas très différentes. Et la participation est imprévisible.”

20 0.57063329 1570 andrew gelman stats-2012-11-08-Poll aggregation and election forecasting


similar blogs computed by lda model

lda for this blog:

topicId topicWeight

[(24, 0.046), (50, 0.069), (83, 0.243), (95, 0.127), (99, 0.301)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 0.93508828 649 andrew gelman stats-2011-04-05-Internal and external forecasting

Introduction: Some thoughts on the implausibility of Paul Ryan’s 2.8% unemployment forecast. Some general issues arise. P.S. Yes, Democrats also have been known to promote optimistic forecasts!

2 0.85095096 1312 andrew gelman stats-2012-05-11-Are our referencing errors undermining our scholarship and credibility? The case of expatriate failure rates

Introduction: Thomas Basbøll points to this ten-year-old article from Anne-Wil Harzing on the consequences of sloppy citations. Harzing tells the story of an unsupported claim that is contradicted by published data but has been presented as fact in a particular area of the academic literature. She writes that “high expatriate failure rates [with "expatriate failure" defined as "the expatriate returning home before his/her contractual period of employment abroad expires"] were in fact a myth created by massive misquotations and careless copying of references.” Many papers claimed an expatriate failure rate of 25-40% (according to Harzing, this is much higher than the actual rate as estimated from empirical data), with this overly-high rate supported by a complicated link of references leading to . . . no real data. Hartzing reports the following published claims: Harvey (1996: 103): `The rate of failure of expatriate managers relocating overseas from United States based MNCs has been estima

3 0.8484205 1307 andrew gelman stats-2012-05-07-The hare, the pineapple, and Ed Wegman

Introduction: Commenters here are occasionally bothered that I spend so much time attacking frauds and plagiarists. See, for example, here and here . Why go on and on about these losers, given that there are more important problems in the world such as war, pestilence, hunger, and graphs where the y-axis doesn’t go all the way down to zero? Part of the story is that I do research for a living so I resent people who devalue research through misattribution or fraud, in the same way that rich people don’t like counterfeiters. What really bugs me, though, is when cheaters get caught and still don’t admit it. People like Hauser, Wegman, Fischer, and Weick get under my skin because they have the chutzpah to just deny deny deny. The grainy time-stamped videotape with their hand in the cookie jar is right there, and they’ll still talk around the problem. Makes me want to scream. This happens all the time . All. Over. The. Place. Everybody makes mistakes, and just about everybody does thing

4 0.82455707 1977 andrew gelman stats-2013-08-11-Debutante Hill

Introduction: I was curious so I ordered a used copy. It was pretty good. It fit in my pocket and I read it on the plane. It was written in a bland, spare manner, not worth reading for any direct insights it would give into human nature, but the plot moved along. And the background material was interesting in the window it gave into the society of the 1950s. It was fun to read a book of pulp fiction that didn’t have any dead bodies in it. I wonder what Jenny Davidson would think of it.

5 0.81728846 926 andrew gelman stats-2011-09-26-NYC

Introduction: Our downstairs neighbor hates us. She looks away from us when we see them on the street, if we’re coming into the building at the same time she doesn’t hold open the door, and if we’re in the elevator when it stops on her floor, she refuses to get on. On the other hand, if you’re a sociology professor in Chicago, one of your colleagues might try to run you over in a parking lot. So I guess I’m getting off easy.

6 0.81148195 1456 andrew gelman stats-2012-08-13-Macro, micro, and conflicts of interest

7 0.80172837 1890 andrew gelman stats-2013-06-09-Frontiers of Science update

8 0.78779197 1042 andrew gelman stats-2011-12-05-Timing is everything!

9 0.78519315 1704 andrew gelman stats-2013-02-03-Heuristics for identifying ecological fallacies?

10 0.781434 944 andrew gelman stats-2011-10-05-How accurate is your gaydar?

11 0.7799654 1294 andrew gelman stats-2012-05-01-Modeling y = a + b + c

12 0.77682316 519 andrew gelman stats-2011-01-16-Update on the generalized method of moments

13 0.77644372 645 andrew gelman stats-2011-04-04-Do you have any idea what you’re talking about?

14 0.77435625 627 andrew gelman stats-2011-03-24-How few respondents are reasonable to use when calculating the average by county?

15 0.77174568 1313 andrew gelman stats-2012-05-11-Question 1 of my final exam for Design and Analysis of Sample Surveys

16 0.77051806 1646 andrew gelman stats-2013-01-01-Back when fifty years was a long time ago

17 0.77032 554 andrew gelman stats-2011-02-04-An addition to the model-makers’ oath

18 0.76994103 1086 andrew gelman stats-2011-12-27-The most dangerous jobs in America

19 0.76870674 1308 andrew gelman stats-2012-05-08-chartsnthings !

20 0.76601976 1643 andrew gelman stats-2012-12-29-Sexism in science (as elsewhere)