andrew_gelman_stats andrew_gelman_stats-2012 andrew_gelman_stats-2012-1424 knowledge-graph by maker-knowledge-mining

1424 andrew gelman stats-2012-07-22-Extreme events as evidence for differences in distributions


meta infos for this blog

Source: html

Introduction: I think Lawrence Summers would like this paper by James Hansen, Makiko Sato, and Reto Ruedy (link from Krugman via Palko ). Hansen et al. write: The distribution of seasonal mean temperature anomalies has shifted toward higher temperatures and the range of anomalies has increased. An important change is the emergence of a category of summertime extremely hot outliers, more than three standard deviations (σ) warmer than climatology. This hot extreme, which covered much less than 1% of Earth’s surface in the period of climatology, now typically covers about 10% of the land area. The point is that it makes sense to look at the whole distribution, but extreme events provide information also. P.S. Here are some papers by my Columbia colleague Wolfram Schenkler on potential impacts of global warming on agriculture.


Summary: the most important sentenses genereted by tfidf model

sentIndex sentText sentNum sentScore

1 I think Lawrence Summers would like this paper by James Hansen, Makiko Sato, and Reto Ruedy (link from Krugman via Palko ). [sent-1, score-0.088]

2 write: The distribution of seasonal mean temperature anomalies has shifted toward higher temperatures and the range of anomalies has increased. [sent-3, score-1.759]

3 An important change is the emergence of a category of summertime extremely hot outliers, more than three standard deviations (σ) warmer than climatology. [sent-4, score-1.176]

4 This hot extreme, which covered much less than 1% of Earth’s surface in the period of climatology, now typically covers about 10% of the land area. [sent-5, score-1.024]

5 The point is that it makes sense to look at the whole distribution, but extreme events provide information also. [sent-6, score-0.451]

6 Here are some papers by my Columbia colleague Wolfram Schenkler on potential impacts of global warming on agriculture. [sent-9, score-0.645]


similar blogs computed by tfidf model

tfidf for this blog:

wordName wordTfidf (topN-words)

[('anomalies', 0.347), ('hansen', 0.303), ('hot', 0.275), ('extreme', 0.193), ('seasonal', 0.188), ('emergence', 0.18), ('warmer', 0.18), ('agriculture', 0.18), ('temperatures', 0.16), ('impacts', 0.157), ('land', 0.154), ('surface', 0.154), ('wolfram', 0.149), ('shifted', 0.147), ('lawrence', 0.144), ('outliers', 0.144), ('covers', 0.141), ('distribution', 0.138), ('earth', 0.137), ('deviations', 0.137), ('summers', 0.136), ('warming', 0.131), ('covered', 0.123), ('temperature', 0.122), ('krugman', 0.12), ('palko', 0.114), ('category', 0.111), ('global', 0.108), ('events', 0.105), ('period', 0.101), ('colleague', 0.101), ('extremely', 0.097), ('james', 0.094), ('range', 0.093), ('columbia', 0.09), ('via', 0.088), ('et', 0.084), ('toward', 0.082), ('provide', 0.08), ('potential', 0.08), ('higher', 0.078), ('typically', 0.076), ('whole', 0.073), ('change', 0.069), ('papers', 0.068), ('three', 0.064), ('link', 0.064), ('standard', 0.063), ('mean', 0.057), ('write', 0.054)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 0.99999994 1424 andrew gelman stats-2012-07-22-Extreme events as evidence for differences in distributions

Introduction: I think Lawrence Summers would like this paper by James Hansen, Makiko Sato, and Reto Ruedy (link from Krugman via Palko ). Hansen et al. write: The distribution of seasonal mean temperature anomalies has shifted toward higher temperatures and the range of anomalies has increased. An important change is the emergence of a category of summertime extremely hot outliers, more than three standard deviations (σ) warmer than climatology. This hot extreme, which covered much less than 1% of Earth’s surface in the period of climatology, now typically covers about 10% of the land area. The point is that it makes sense to look at the whole distribution, but extreme events provide information also. P.S. Here are some papers by my Columbia colleague Wolfram Schenkler on potential impacts of global warming on agriculture.

2 0.17478243 180 andrew gelman stats-2010-08-03-Climate Change News

Introduction: I. State of the Climate report The National Oceanic and Atmospheric Administration recently released their “State of the Climate Report” for 2009 . The report has chapters discussing global climate (temperatures, water vapor, cloudiness, alpine glaciers,…); oceans (ocean heat content, sea level, sea surface temperatures, etc.); the arctic (sea ice extent, permafrost, vegetation, and so on); Antarctica (weather observations, sea ice extent,…), and regional climates. NOAA also provides a nice page that lets you display any of 11 relevant time-series datasets (land-surface air temperature, sea level, ocean heat content, September arctic sea-ice extent, sea-surface temperature, northern hemisphere snow cover, specific humidity, glacier mass balance, marine air temperature, tropospheric temperature, and stratospheric temperature). Each of the plots overlays data from several databases (not necessarily indepenedent of each other), and you can select which ones to include or leave

3 0.1261501 1936 andrew gelman stats-2013-07-13-Economic policy does not occur in a political vacuum

Introduction: Even if a policymaker is sure of the ideal economic policy, he or she can only implement it with the help of some of the other political players. But I’m saying something different, echoing what I wrote a couple days ago. I thought of this the other day after seeing this recent quote from Paul Krugman ( extracted by Brad DeLong) about Larry “Starbucks” Summers: Summers is . . . indistinguishable from me [Krugman] on macro-policy. And he may be a bit to the left, because he’s even more certain than I am . . . that some extra spending now will actually help us more in fiscal terms. So he published a piece in the Financial Times that was meant to be a big statement about this. But before he got to that, he spend three paragraphs about the importance of dealing with the deficit in the medium term . . . to establish that ‘I am a respectable person; I am not like that rabble-rouser, Krugman.’ . . . Maybe. But, going back to 2009, I still suspect that Summers, or some part of S

4 0.10568574 983 andrew gelman stats-2011-10-31-Skepticism about skepticism of global warming skepticism skepticism

Introduction: A group of University of California professors headed by physicist Richard Muller recently released a report confirming global warming. Then geophysicist Judith Curry, a coauthor on the papers produced by the Muller group, turned around and said that their data actually show that global warming has stopped. (Also see clarification here .) Curry is described in the news article as the second author on the papers, but the authors are listed alphabetically so it’s probably more accurate to describe her as one of the ten authors. Muller’s one, Curry’s another, . . . now I want to know what 7 of the other 8 authors think! (One of the authors is Richard Muller’s daughter Elizabeth, so maybe we shouldn’t count her as an independent view.) Some enterprising reporter should really interview the other 7 authors of that report . Just a quick question like, “Is there scientific basis for saying that warming hasn’t stopped?” To add some fuel to the fire, let me repost what my ph

5 0.10484999 1295 andrew gelman stats-2012-05-02-Selection bias, or, How you can think the experts don’t check their models, if you simply don’t look at what the experts actually are doing

Introduction: My friend Seth, whom I know from Berkeley (we taught a course together on left-handedness), has a blog on topics ranging from thoughtful discussions of scientific evidence, to experiences with his unconventional weight-loss scheme, offbeat self-experimentation, and advocacy of fringe scientific theories, leavened with occasional dollops of cynicism and political extremism . I agree with Seth on some things but not others. ( Here’s Seth’s reason for not attempting a clinical trial of his diet.) Recently I was disturbed (but, I’m sorry to say, not surprised) to see Seth post the following: Predictions of climate models versus reality . I [Seth] have only seen careful prediction-vs-reality comparisons made by AGW [anthropogenic global warming] skeptics. Those who believe humans are dangerously warming the planet appear to be silent on this subject. In response, Phil commented : Funny, on the day you [Seth] made your post saying that you haven’t seen comparis

6 0.093924016 1500 andrew gelman stats-2012-09-17-“2% per degree Celsius . . . the magic number for how worker productivity responds to warm-hot temperatures”

7 0.093029208 713 andrew gelman stats-2011-05-15-1-2 social scientist + 1-2 politician = ???

8 0.091714367 1782 andrew gelman stats-2013-03-30-“Statistical Modeling: A Fresh Approach”

9 0.091434576 1501 andrew gelman stats-2012-09-18-More studies on the economic effects of climate change

10 0.090004422 2128 andrew gelman stats-2013-12-09-How to model distributions that have outliers in one direction

11 0.089114167 1123 andrew gelman stats-2012-01-17-Big corporations are more popular than you might realize

12 0.08663483 1402 andrew gelman stats-2012-07-01-Ice cream! and temperature

13 0.085405044 1318 andrew gelman stats-2012-05-13-Stolen jokes

14 0.084374398 2086 andrew gelman stats-2013-11-03-How best to compare effects measured in two different time periods?

15 0.083323881 28 andrew gelman stats-2010-05-12-Alert: Incompetent colleague wastes time of hardworking Wolfram Research publicist

16 0.082277417 2340 andrew gelman stats-2014-05-20-Thermodynamic Monte Carlo: Michael Betancourt’s new method for simulating from difficult distributions and evaluating normalizing constants

17 0.081000283 735 andrew gelman stats-2011-05-28-New app for learning intro statistics

18 0.080783419 2122 andrew gelman stats-2013-12-03-Objects of the class “Lawrence Summers”: Arne Duncan edition

19 0.079658337 1824 andrew gelman stats-2013-04-25-Fascinating graphs from facebook data

20 0.079656139 1215 andrew gelman stats-2012-03-16-The “hot hand” and problems with hypothesis testing


similar blogs computed by lsi model

lsi for this blog:

topicId topicWeight

[(0, 0.093), (1, 0.001), (2, 0.014), (3, -0.002), (4, 0.001), (5, -0.017), (6, 0.044), (7, 0.006), (8, -0.024), (9, 0.021), (10, -0.016), (11, -0.013), (12, 0.011), (13, -0.001), (14, -0.048), (15, 0.009), (16, 0.021), (17, 0.025), (18, -0.001), (19, -0.037), (20, 0.019), (21, 0.017), (22, 0.015), (23, 0.003), (24, 0.037), (25, 0.011), (26, -0.007), (27, 0.008), (28, 0.047), (29, 0.02), (30, -0.019), (31, 0.059), (32, -0.007), (33, -0.03), (34, -0.052), (35, -0.004), (36, -0.007), (37, 0.005), (38, 0.05), (39, 0.0), (40, 0.029), (41, 0.066), (42, -0.037), (43, -0.049), (44, -0.056), (45, 0.022), (46, -0.04), (47, -0.02), (48, -0.036), (49, 0.016)]

similar blogs list:

simIndex simValue blogId blogTitle

same-blog 1 0.93912303 1424 andrew gelman stats-2012-07-22-Extreme events as evidence for differences in distributions

Introduction: I think Lawrence Summers would like this paper by James Hansen, Makiko Sato, and Reto Ruedy (link from Krugman via Palko ). Hansen et al. write: The distribution of seasonal mean temperature anomalies has shifted toward higher temperatures and the range of anomalies has increased. An important change is the emergence of a category of summertime extremely hot outliers, more than three standard deviations (σ) warmer than climatology. This hot extreme, which covered much less than 1% of Earth’s surface in the period of climatology, now typically covers about 10% of the land area. The point is that it makes sense to look at the whole distribution, but extreme events provide information also. P.S. Here are some papers by my Columbia colleague Wolfram Schenkler on potential impacts of global warming on agriculture.

2 0.72909039 180 andrew gelman stats-2010-08-03-Climate Change News

Introduction: I. State of the Climate report The National Oceanic and Atmospheric Administration recently released their “State of the Climate Report” for 2009 . The report has chapters discussing global climate (temperatures, water vapor, cloudiness, alpine glaciers,…); oceans (ocean heat content, sea level, sea surface temperatures, etc.); the arctic (sea ice extent, permafrost, vegetation, and so on); Antarctica (weather observations, sea ice extent,…), and regional climates. NOAA also provides a nice page that lets you display any of 11 relevant time-series datasets (land-surface air temperature, sea level, ocean heat content, September arctic sea-ice extent, sea-surface temperature, northern hemisphere snow cover, specific humidity, glacier mass balance, marine air temperature, tropospheric temperature, and stratospheric temperature). Each of the plots overlays data from several databases (not necessarily indepenedent of each other), and you can select which ones to include or leave

3 0.67317301 2340 andrew gelman stats-2014-05-20-Thermodynamic Monte Carlo: Michael Betancourt’s new method for simulating from difficult distributions and evaluating normalizing constants

Introduction: I hate to keep bumping our scheduled posts but this is just too important and too exciting to wait. So it’s time to jump the queue. The news is a paper from Michael Betancourt that presents a super-cool new way to compute normalizing constants: A common strategy for inference in complex models is the relaxation of a simple model into the more complex target model, for example the prior into the posterior in Bayesian inference. Existing approaches that attempt to generate such transformations, however, are sensitive to the pathologies of complex distributions and can be difficult to implement in practice. Leveraging the geometry of thermodynamic processes I introduce a principled and robust approach to deforming measures that presents a powerful new tool for inference. The idea is to generalize Hamiltonian Monte Carlo so that it moves through a family of distributions (that is, it transitions through an “inverse temperature” variable called beta that indexes the family) a

4 0.64345056 1501 andrew gelman stats-2012-09-18-More studies on the economic effects of climate change

Introduction: After writing yesterday’s post , I was going through Solomon Hsiang’s blog and found a post pointing to three studies from researchers at business schools: Severe Weather and Automobile Assembly Productivity Gérard P. Cachon, Santiago Gallino and Marcelo Olivares Abstract: It is expected that climate change could lead to an increased frequency of severe weather. In turn, severe weather intuitively should hamper the productivity of work that occurs outside. But what is the effect of rain, snow, fog, heat and wind on work that occurs indoors, such as the production of automobiles? Using weekly production data from 64 automobile plants in the United States over a ten-year period, we find that adverse weather conditions lead to a significant reduction in production. For example, one additional day of high wind advisory by the National Weather Service (i.e., maximum winds generally in excess of 44 miles per hour) reduces production by 26%, which is comparable in order of magnitude t

5 0.60509384 1201 andrew gelman stats-2012-03-07-Inference = data + model

Introduction: A recent article on global warming reminded me of the difficulty of letting the data speak. William Nordhaus shows the following graph: And then he writes: One of the reasons that drawing conclusions on temperature trends is tricky is that the historical temperature series is highly volatile, as can be seen in the figure. The presence of short-term volatility requires looking at long-term trends. A useful analogy is the stock market. Suppose an analyst says that because real stock prices have declined over the last decade (which is true), it follows that there is no upward trend. Here again, an examination of the long-term data would quickly show this to be incorrect. The last decade of temperature and stock market data is not representative of the longer-term trends. The finding that global temperatures are rising over the last century-plus is one of the most robust findings of climate science and statistics. I see what he’s saying, but first, I don’t find the st

6 0.60027248 1500 andrew gelman stats-2012-09-17-“2% per degree Celsius . . . the magic number for how worker productivity responds to warm-hot temperatures”

7 0.54937917 1295 andrew gelman stats-2012-05-02-Selection bias, or, How you can think the experts don’t check their models, if you simply don’t look at what the experts actually are doing

8 0.54782891 945 andrew gelman stats-2011-10-06-W’man < W’pedia, again

9 0.53296977 2181 andrew gelman stats-2014-01-21-The Commissar for Traffic presents the latest Five-Year Plan

10 0.52892214 431 andrew gelman stats-2010-11-26-One fun thing about physicists . . .

11 0.51638061 2112 andrew gelman stats-2013-11-25-An interesting but flawed attempt to apply general forecasting principles to contextualize attitudes toward risks of global warming

12 0.51597351 1897 andrew gelman stats-2013-06-13-When’s that next gamma-ray blast gonna come, already?

13 0.51343566 1829 andrew gelman stats-2013-04-28-Plain old everyday Bayesianism!

14 0.51003778 1274 andrew gelman stats-2012-04-21-Value-added assessment political FAIL

15 0.50982571 1801 andrew gelman stats-2013-04-13-Can you write a program to determine the causal order?

16 0.50853002 1420 andrew gelman stats-2012-07-18-The treatment, the intermediate outcome, and the ultimate outcome: Leverage and the financial crisis

17 0.5067808 607 andrew gelman stats-2011-03-11-Rajiv Sethi on the interpretation of prediction market data

18 0.50632489 1522 andrew gelman stats-2012-10-05-High temperatures cause violent crime and implications for climate change, also some suggestions about how to better summarize these claims

19 0.50274074 2122 andrew gelman stats-2013-12-03-Objects of the class “Lawrence Summers”: Arne Duncan edition

20 0.50262797 141 andrew gelman stats-2010-07-12-Dispute over counts of child deaths in Iraq due to sanctions


similar blogs computed by lda model

lda for this blog:

topicId topicWeight

[(9, 0.31), (15, 0.029), (16, 0.05), (20, 0.04), (21, 0.031), (24, 0.114), (34, 0.021), (42, 0.049), (99, 0.24)]

similar blogs list:

simIndex simValue blogId blogTitle

1 0.98373044 577 andrew gelman stats-2011-02-16-Annals of really really stupid spam

Introduction: This came in the inbox today: Dear Dr. Gelman, GenWay recently found your article titled “Multiple imputation for model checking: completed-data plots with missing and latent data.” (Biometrics. 2005 Mar;61(1):74-85.) and thought you might be interested in learning about our superior quality signaling proteins. GenWay prides itself on being a leader in customer service aiming to exceed your expectations with the quality and price of our products. With more than 60,000 reagents backed by our outstanding guarantee you are sure to find the products you have been searching for. Please feel free to visit the following resource pages: * Apoptosis Pathway (product list) * Adipocytokine (product list) * Cell Cycle Pathway (product list) * Jak STAT (product list) * GnRH (product list) * MAPK (product list) * mTOR (product list) * T Cell Receptor (product list) * TGF-beta (product list) * Wnt (product list) * View All Pathways

2 0.97457695 993 andrew gelman stats-2011-11-05-The sort of thing that gives technocratic reasoning a bad name

Introduction: 1. Freakonomics characterizes drunk driving as an example of “the human tendency to worry about rare problems that are unlikely to happen.” 2. The CDC reports , “Alcohol-impaired drivers are involved in about 1 in 3 crash deaths, resulting in nearly 11,000 deaths in 2009.” No offense to the tenured faculty at the University of Chicago, but I’m going with the CDC on this one. P.S. The Freakonomics blog deserves to be dinged another time, not just for claiming, based on implausible assumptions and making the all-else-equal fallacy that “drunk walking is 8 times more likely to result in your death than drunk driving” but for presenting this weak inference as a fact rather than as a speculation. When doing “Freakonomics,” you can be counterintuitive, or you can be sensible, but it’s hard to be both. I mean, sure, sometimes you can be. But there’s a tradeoff, and in this case, they’re choosing to push the envelope on counterintuitiveness.

3 0.94181395 1356 andrew gelman stats-2012-05-31-Question 21 of my final exam for Design and Analysis of Sample Surveys

Introduction: 21. A country is divided into three regions with populations of 2 million, 2 million, and 0.5 million, respectively. A survey is done asking about foreign policy opinions.. Somebody proposes taking a sample of 50 people from each reason. Give a reason why this non-proportional sample would not usually be done, and also a reason why it might actually be a good idea. Solution to question 20 From yesterday : 20. Explain in two sentences why we expect survey respondents to be honest about vote preferences but possibly dishonest about reporting unhealty behaviors. Solution: Respondents tend to be sincere about vote preferences because this affects the outcome of the poll, and people are motivated to have their candidate poll well. This motivation is typically not present in reporting behaviors; you have no particular reason for wanting to affect the average survey response.

same-blog 4 0.9301194 1424 andrew gelman stats-2012-07-22-Extreme events as evidence for differences in distributions

Introduction: I think Lawrence Summers would like this paper by James Hansen, Makiko Sato, and Reto Ruedy (link from Krugman via Palko ). Hansen et al. write: The distribution of seasonal mean temperature anomalies has shifted toward higher temperatures and the range of anomalies has increased. An important change is the emergence of a category of summertime extremely hot outliers, more than three standard deviations (σ) warmer than climatology. This hot extreme, which covered much less than 1% of Earth’s surface in the period of climatology, now typically covers about 10% of the land area. The point is that it makes sense to look at the whole distribution, but extreme events provide information also. P.S. Here are some papers by my Columbia colleague Wolfram Schenkler on potential impacts of global warming on agriculture.

5 0.92783558 1291 andrew gelman stats-2012-04-30-Systematic review of publication bias in studies on publication bias

Introduction: Via Yalda Afshar , a 2005 paper by Hans-Hermann Dubben and Hans-Peter Beck-Bornholdt: Publication bias is a well known phenomenon in clinical literature, in which positive results have a better chance of being published, are published earlier, and are published in journals with higher impact factors. Conclusions exclusively based on published studies, therefore, can be misleading. Selective under-reporting of research might be more widespread and more likely to have adverse consequences for patients than publication of deliberately falsified data. We investigated whether there is preferential publication of positive papers on publication bias. They conclude, “We found no evidence of publication bias in reports on publication bias.” But of course that’s the sort of finding regarding publication bias of findings on publication bias that you’d expect would get published. What we really need is a careful meta-analysis to estimate the level of publication bias in studies of publi

6 0.92216498 529 andrew gelman stats-2011-01-21-“City Opens Inquiry on Grading Practices at a Top-Scoring Bronx School”

7 0.91632682 1532 andrew gelman stats-2012-10-13-A real-life dollar auction game!

8 0.91448611 1332 andrew gelman stats-2012-05-20-Problemen met het boek

9 0.90652096 1664 andrew gelman stats-2013-01-10-Recently in the sister blog: Brussels sprouts, ugly graphs, and switched at birth

10 0.86869818 1961 andrew gelman stats-2013-07-29-Postdocs in probabilistic modeling! With David Blei! And Stan!

11 0.86345392 389 andrew gelman stats-2010-11-01-Why it can be rational to vote

12 0.86345178 1565 andrew gelman stats-2012-11-06-Why it can be rational to vote

13 0.85048234 1566 andrew gelman stats-2012-11-07-A question about voting systems—unrelated to U.S. elections!

14 0.84688163 1142 andrew gelman stats-2012-01-29-Difficulties with the 1-4-power transformation

15 0.84595275 560 andrew gelman stats-2011-02-06-Education and Poverty

16 0.84295774 1110 andrew gelman stats-2012-01-10-Jobs in statistics research! In New Jersey!

17 0.84015268 29 andrew gelman stats-2010-05-12-Probability of successive wins in baseball

18 0.83538902 1226 andrew gelman stats-2012-03-22-Story time meets the all-else-equal fallacy and the fallacy of measurement

19 0.81906611 1715 andrew gelman stats-2013-02-09-Thomas Hobbes would be spinning in his grave

20 0.80977213 640 andrew gelman stats-2011-03-31-Why Edit Wikipedia?