andrew_gelman_stats andrew_gelman_stats-2010 andrew_gelman_stats-2010-155 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: David Blackwell was already retired by the time I came to Berkeley, and probably our closest connection was that I taught the class in decision theory that he used to teach. I enjoyed that class a lot, partly because it took me out of my usual comfort zone of statistical inference and data analysis toward something more theoretical and mathematical. Blackwell was one of the legendary figures in the department at that time and was also one of the most tolerant of alternative approaches to statistics, perhaps because of combination of a mathematical background, applied research in the war and after (which I learned about in this recent obituary ), and personal experiences, Blackwell may be best known in statistics for the Rao-Blackwell theorem . Rao, of course, is also famoust for the Cramer-Rao lower bound. Both theorems relate to minimum-variance statistical estimators. Here’s a quote from Thomas (Jesus’s dad) Ferguson in Blackwell’s obituary : He went from one area to an
sentIndex sentText sentNum sentScore
1 David Blackwell was already retired by the time I came to Berkeley, and probably our closest connection was that I taught the class in decision theory that he used to teach. [sent-1, score-0.192]
2 I enjoyed that class a lot, partly because it took me out of my usual comfort zone of statistical inference and data analysis toward something more theoretical and mathematical. [sent-2, score-0.447]
3 Here’s a quote from Thomas (Jesus’s dad) Ferguson in Blackwell’s obituary : He went from one area to another, and he’d write a fundamental paper in each, He would come into a field that had been well studied and find something really new that was remarkable. [sent-6, score-0.432]
4 And here’s a quote from Peter Bickel, who in 1967 published an important paper on Bayesian inference: He had this great talent for making things appear simple, He liked elegance and simplicity. [sent-8, score-0.222]
5 That is the ultimate best thing in mathematics, if you have an insight that something seemingly complicated is really simple, but simple after the fact. [sent-9, score-0.365]
6 And here’s Blackwell himself, from 1983: Basically, I’m not interested in doing research and I never have been, I’m interested in understanding, which is quite a different thing. [sent-10, score-0.19]
7 And often to understand something you have to work it out yourself because no one else has done it. [sent-11, score-0.121]
8 I’m surprised to hear Blackwell consider “research” and “understanding” to be different, as to me they seem to be closely related. [sent-12, score-0.077]
9 One of the most interesting areas of statistical research today is on methods for understanding models as maps from data to predictions. [sent-13, score-0.33]
10 As Blackwell and his collaborators demonstrated, even the understanding of simple statistical inferences is not a simple task. [sent-14, score-0.519]
11 According to the obituary, Blackwell was denied jobs at Princeton and the University of California because of racial discrimination, and so, a year after receiving his Ph. [sent-17, score-0.186]
12 , he “sent out applications to 104 black colleges on the assumption that no other schools would hire him. [sent-19, score-0.238]
13 ” The bit about the 104 job applications surprised me. [sent-20, score-0.264]
14 Nowadays I know that people send out hundreds of job applications, but I didn’t know that this was done back in 1943. [sent-21, score-0.117]
15 My Barnard College colleague Rajiv Sethi discusses Blackwell’s research as seen by economists. [sent-26, score-0.086]
wordName wordTfidf (topN-words)
[('blackwell', 0.74), ('obituary', 0.287), ('simple', 0.136), ('understanding', 0.126), ('applications', 0.123), ('bickel', 0.087), ('elegance', 0.087), ('research', 0.086), ('rao', 0.079), ('quote', 0.077), ('surprised', 0.077), ('tolerant', 0.074), ('barnard', 0.072), ('denied', 0.072), ('jesus', 0.07), ('dad', 0.069), ('rajiv', 0.069), ('sethi', 0.069), ('legendary', 0.069), ('comfort', 0.069), ('something', 0.068), ('theorems', 0.067), ('zone', 0.067), ('statistical', 0.067), ('class', 0.065), ('retired', 0.064), ('job', 0.064), ('closest', 0.063), ('relate', 0.062), ('princeton', 0.062), ('discrimination', 0.061), ('colleges', 0.061), ('racial', 0.059), ('talent', 0.058), ('ferguson', 0.056), ('enjoyed', 0.056), ('ultimate', 0.056), ('inference', 0.055), ('receiving', 0.055), ('california', 0.055), ('collaborators', 0.054), ('hire', 0.054), ('berkeley', 0.053), ('seemingly', 0.053), ('done', 0.053), ('demonstrated', 0.053), ('insight', 0.052), ('interested', 0.052), ('maps', 0.051), ('theorem', 0.049)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999994 155 andrew gelman stats-2010-07-19-David Blackwell
Introduction: David Blackwell was already retired by the time I came to Berkeley, and probably our closest connection was that I taught the class in decision theory that he used to teach. I enjoyed that class a lot, partly because it took me out of my usual comfort zone of statistical inference and data analysis toward something more theoretical and mathematical. Blackwell was one of the legendary figures in the department at that time and was also one of the most tolerant of alternative approaches to statistics, perhaps because of combination of a mathematical background, applied research in the war and after (which I learned about in this recent obituary ), and personal experiences, Blackwell may be best known in statistics for the Rao-Blackwell theorem . Rao, of course, is also famoust for the Cramer-Rao lower bound. Both theorems relate to minimum-variance statistical estimators. Here’s a quote from Thomas (Jesus’s dad) Ferguson in Blackwell’s obituary : He went from one area to an
2 0.24231736 493 andrew gelman stats-2010-12-31-Obituaries in 2010
Introduction: David Blackwell . Julian Besag . Arnold Zellner . Benoit Mandelbrot and Hirotugu Akaike (late) . Alfred Kahn .
3 0.10437924 638 andrew gelman stats-2011-03-30-More on the correlation between statistical and political ideology
Introduction: This is a chance for me to combine two of my interests–politics and statistics–and probably to irritate both halves of the readership of this blog. Anyway… I recently wrote about the apparent correlation between Bayes/non-Bayes statistical ideology and liberal/conservative political ideology: The Bayes/non-Bayes fissure had a bit of a political dimension–with anti-Bayesians being the old-line conservatives (for example, Ronald Fisher) and Bayesians having a more of a left-wing flavor (for example, Dennis Lindley). Lots of counterexamples at an individual level, but my impression is that on average the old curmudgeonly, get-off-my-lawn types were (with some notable exceptions) more likely to be anti-Bayesian. This was somewhat based on my experiences at Berkeley. Actually, some of the cranky anti-Bayesians were probably Democrats as well, but when they were being anti-Bayesian they seemed pretty conservative. Recently I received an interesting item from Gerald Cliff, a pro
4 0.083681412 1469 andrew gelman stats-2012-08-25-Ways of knowing
Introduction: In this discussion from last month, computer science student and Judea Pearl collaborator Elias Barenboim expressed an attitude that hierarchical Bayesian methods might be fine in practice but that they lack theory, that Bayesians can’t succeed in toy problems. I posted a P.S. there which might not have been noticed so I will put it here: I now realize that there is some disagreement about what constitutes a “guarantee.” In one of his comments, Barenboim writes, “the assurance we have that the result must hold as long as the assumptions in the model are correct should be regarded as a guarantee.” In that sense, yes, we have guarantees! It is fundamental to Bayesian inference that the result must hold if the assumptions in the model are correct. We have lots of that in Bayesian Data Analysis (particularly in the first four chapters but implicitly elsewhere as well), and this is also covered in the classic books by Lindley, Jaynes, and others. This sort of guarantee is indeed p
5 0.08220154 2072 andrew gelman stats-2013-10-21-The future (and past) of statistical sciences
Introduction: In connection with this workshop, I was asked to write a few paragraphs describing my perspective on “the current and near-term future state of the statistical sciences you are most familiar with.” Here’s what I wrote: I think that, at any given time, the field of statistics has a core, but that core changes over time. There are different paradigmatic ways to solve problems. 100 or 150 years ago, the thing to do was to identify a phenomenon of interest with some probability distribution and then use the mathematics of that distribution to gain insight into the underlying process. Thus, for example, if certain data looked like they came from a normal distribution, one could surmise that the values in question arose by adding many small independent pieces. If the data looked like they came from a binomial distribution, that would imply independence and equal probabilities. Waiting times that followed an exponential distribution could be considered as coming from a memoryless
6 0.08101432 1921 andrew gelman stats-2013-07-01-Going meta on Niall Ferguson
7 0.079339996 361 andrew gelman stats-2010-10-21-Tenure-track statistics job at Teachers College, here at Columbia!
8 0.076263413 2151 andrew gelman stats-2013-12-27-Should statistics have a Nobel prize?
9 0.075420514 1110 andrew gelman stats-2012-01-10-Jobs in statistics research! In New Jersey!
10 0.073878497 956 andrew gelman stats-2011-10-13-Hey, you! Don’t take that class!
11 0.073420897 1690 andrew gelman stats-2013-01-23-When are complicated models helpful in psychology research and when are they overkill?
14 0.069207072 2245 andrew gelman stats-2014-03-12-More on publishing in journals
15 0.068282843 291 andrew gelman stats-2010-09-22-Philosophy of Bayes and non-Bayes: A dialogue with Deborah Mayo
16 0.065979518 1695 andrew gelman stats-2013-01-28-Economists argue about Bayes
17 0.064236373 1338 andrew gelman stats-2012-05-23-Advice on writing research articles
18 0.062319089 390 andrew gelman stats-2010-11-02-Fragment of statistical autobiography
19 0.061820958 1205 andrew gelman stats-2012-03-09-Coming to agreement on philosophy of statistics
20 0.061233368 1493 andrew gelman stats-2012-09-12-Niall Ferguson, the John Yoo line, and the paradox of influence
topicId topicWeight
[(0, 0.152), (1, -0.018), (2, -0.068), (3, 0.006), (4, -0.025), (5, 0.053), (6, -0.032), (7, 0.043), (8, 0.0), (9, 0.03), (10, -0.021), (11, -0.007), (12, -0.01), (13, 0.006), (14, -0.024), (15, -0.024), (16, -0.011), (17, -0.044), (18, -0.02), (19, -0.018), (20, -0.013), (21, 0.003), (22, 0.012), (23, -0.009), (24, 0.027), (25, -0.009), (26, -0.021), (27, 0.009), (28, -0.0), (29, 0.013), (30, 0.003), (31, 0.022), (32, -0.006), (33, 0.007), (34, 0.011), (35, -0.046), (36, -0.005), (37, -0.015), (38, -0.024), (39, -0.003), (40, 0.006), (41, 0.009), (42, -0.014), (43, -0.022), (44, 0.037), (45, -0.033), (46, -0.018), (47, -0.004), (48, 0.013), (49, -0.008)]
simIndex simValue blogId blogTitle
same-blog 1 0.94929373 155 andrew gelman stats-2010-07-19-David Blackwell
Introduction: David Blackwell was already retired by the time I came to Berkeley, and probably our closest connection was that I taught the class in decision theory that he used to teach. I enjoyed that class a lot, partly because it took me out of my usual comfort zone of statistical inference and data analysis toward something more theoretical and mathematical. Blackwell was one of the legendary figures in the department at that time and was also one of the most tolerant of alternative approaches to statistics, perhaps because of combination of a mathematical background, applied research in the war and after (which I learned about in this recent obituary ), and personal experiences, Blackwell may be best known in statistics for the Rao-Blackwell theorem . Rao, of course, is also famoust for the Cramer-Rao lower bound. Both theorems relate to minimum-variance statistical estimators. Here’s a quote from Thomas (Jesus’s dad) Ferguson in Blackwell’s obituary : He went from one area to an
2 0.77885407 205 andrew gelman stats-2010-08-13-Arnold Zellner
Introduction: Steve Ziliak reports: I [Ziliak] am sorry to share this sad news about Arnold Zellner (AEA Distinguished Fellow, 2002, ASA President, 1991, ISBA co-founding president, all around genius and sweet fellow), who died yesterday morning (August 11, 2010). He was a truly great statistician and to me and to many others a generous and wonderful friend, colleague, and hero. I will miss him. His cancer was spreading everywhere though you wouldn’t know it as his energy level was Arnold’s typical: abnormally high. But then he had a stroke just a few days after an unsuccessful surgery “to help with breathing” the doctor said, and the combination of events weakened him terribly. He was vibrant through June and much of July, and maintained an 8 hour work day at the office. He never lost his sense of humor nor his joy of life. He died at home in hospice care and fortunately he did not suffer long. From the official announcement from the University of Chicago: Arnold began his academi
3 0.76648259 2012 andrew gelman stats-2013-09-07-Job openings at American University
Introduction: American University in Washington, D.C. has two full-time tenure-line positions available : An ideal candidate will have facility with computation, and can identify specific prospects for on-campus collaboration, possibly interdepartmental. We are particularly interested in candidates who can assist colleagues who need to deal with data sets that are too large, distributed, or heterogeneous to be amenable to traditional methods of analysis. From a mathematician, we also seek a research program with deep roots in mathematics. From a statistician, we seek a familiarity with Bayesian modeling. We are open to researchers who ignore traditional disciplinary boundaries. I like the bits about computation, interdepartmental, and Bayesian modeling. My former colleagues at Berkeley would be spinning in their theorems were they to see this (but, don’t worry, I doubt they read blogs). I really do think that computation is more important than theorem-proving. Both are important (for exam
4 0.75573069 2151 andrew gelman stats-2013-12-27-Should statistics have a Nobel prize?
Introduction: Xiao-Li says yes: The most compelling reason for having highly visible awards in any field is to enhance its ability to attract future talent. Virtually all the media and public attention our profession received in recent years has been on the utility of statistics in all walks of life. We are extremely happy for and proud of this recognition—it is long overdue. However, the media and public have given much more attention to the Fields Medal than to the COPSS Award, even though the former has hardly been about direct or even indirect impact on everyday life. Why this difference? . . . these awards arouse media and public interest by featuring how ingenious the awardees are and how difficult the problems they solved, much like how conquering Everest bestows admiration not because the admirers care or even know much about Everest itself but because it represents the ultimate physical feat. In this sense, the biggest winner of the Fields Medal is mathematics itself: enticing the brig
Introduction: For “humanity, devotion to truth and inspiring leadership” at Columbia College. Reading Jenny’s remarks (“my hugest and most helpful pool of colleagues was to be found not among the ranks of my fellow faculty but in the classroom. . . . we shared a sense of the excitement of the enterprise on which we were all embarked”) reminds me of the comment Seth made once, that the usual goal of university teaching is to make the students into carbon copies of the instructor, and that he found it to me much better to make use of the students’ unique strengths. This can’t always be true–for example, in learning to speak a foreign language, I just want to be able to do it, and my own experiences in other domains is not so relevant. But for a worldly subject such as literature or statistics or political science, then, yes, I do think it would be good for students to get involved and use their own knowledge and experiences. One other statement of Jenny’s caught my eye. She wrote: I [Je
6 0.73023301 2282 andrew gelman stats-2014-04-05-Bizarre academic spam
9 0.71685958 479 andrew gelman stats-2010-12-20-WWJD? U can find out!
10 0.71482199 1282 andrew gelman stats-2012-04-26-Bad news about (some) statisticians
12 0.71326542 974 andrew gelman stats-2011-10-26-NYC jobs in applied statistics, psychometrics, and causal inference!
13 0.7107175 1533 andrew gelman stats-2012-10-14-If x is correlated with y, then y is correlated with x
14 0.70751542 1740 andrew gelman stats-2013-02-26-“Is machine learning a subset of statistics?”
15 0.70619029 1153 andrew gelman stats-2012-02-04-More on the economic benefits of universities
16 0.70180392 361 andrew gelman stats-2010-10-21-Tenure-track statistics job at Teachers College, here at Columbia!
17 0.70157355 1600 andrew gelman stats-2012-12-01-$241,364.83 – $13,000 = $228,364.83
18 0.70033491 193 andrew gelman stats-2010-08-09-Besag
19 0.6973561 2330 andrew gelman stats-2014-05-12-Historical Arc of Universities
20 0.69716221 903 andrew gelman stats-2011-09-13-Duke postdoctoral fellowships in nonparametric Bayes & high-dimensional data
topicId topicWeight
[(2, 0.014), (5, 0.037), (15, 0.03), (16, 0.043), (21, 0.018), (24, 0.123), (37, 0.016), (39, 0.126), (42, 0.022), (77, 0.018), (81, 0.036), (95, 0.014), (97, 0.015), (98, 0.016), (99, 0.34)]
simIndex simValue blogId blogTitle
1 0.98101938 443 andrew gelman stats-2010-12-02-Automating my graphics advice
Introduction: After seeing this graph : I have the following message for Sharad: Rotate the graph 90 degrees so you can see the words. Also you can ditch the lines. Then what you have is a dotplot, following the principles of Cleveland (1985). You can lay out a few on one page to see some interactions with demographics. The real challenge here . . . . . . is to automate this sort of advice. Or maybe we just need a really nice dotplot() function and enough examples, and people will start doing it? P.S. Often a lineplot is better. See here for a discussion of another Sharad example.
2 0.96512556 1343 andrew gelman stats-2012-05-25-And now, here’s something we hope you’ll really like
Introduction: This came in the email: Postdoctoral Researcher (3 years) in State-Space Modeling of Animal Movement and Population Dynamics in Universities of Turku and Helsinki, Finland We seek for a statistician/mathematician with experience in ecological modeling or an ecologist with strong quantitative training to join an interdisciplinary research team focusing on dispersal and dynamics of the Siberian flying squirrel (Pteromys volans). The Postdoctoral Researcher will develop modeling approaches (from individual based models to population level models) to assess the dispersal and population dynamics of the flying squirrel. A key challenge will be the integration of different kinds of data (census data, telemetry data, mark-recapture data, life-history data, and data on environmental covariates such as forest structure) into the modeling framework using Bayesian State-Space models or other such approaches. The project will be supervised by Dr. Vesa Selonen (a flying squirrel specialist;
same-blog 3 0.96481448 155 andrew gelman stats-2010-07-19-David Blackwell
Introduction: David Blackwell was already retired by the time I came to Berkeley, and probably our closest connection was that I taught the class in decision theory that he used to teach. I enjoyed that class a lot, partly because it took me out of my usual comfort zone of statistical inference and data analysis toward something more theoretical and mathematical. Blackwell was one of the legendary figures in the department at that time and was also one of the most tolerant of alternative approaches to statistics, perhaps because of combination of a mathematical background, applied research in the war and after (which I learned about in this recent obituary ), and personal experiences, Blackwell may be best known in statistics for the Rao-Blackwell theorem . Rao, of course, is also famoust for the Cramer-Rao lower bound. Both theorems relate to minimum-variance statistical estimators. Here’s a quote from Thomas (Jesus’s dad) Ferguson in Blackwell’s obituary : He went from one area to an
4 0.95869726 1157 andrew gelman stats-2012-02-07-Philosophy of Bayesian statistics: my reactions to Hendry
Introduction: Continuing with my discussion here and here of the articles in the special issue of the journal Rationality, Markets and Morals on the philosophy of Bayesian statistics: David Hendry, “Empirical Economic Model Discovery and Theory Evaluation”: Hendry presents a wide-ranging overview of scientific learning, with an interesting comparison of physical with social sciences. (For some reason, he discusses many physical sciences but restricts his social-science examples to economics and psychology.) The only part of Hendry’s long and interesting article that I will discuss, however, is the part where he decides to take a gratuitous swing at Bayes. I don’t know why he did this, but maybe it’s part of some fraternity initiation thing, like TP-ing the dean’s house on Halloween. Here’s the story. Hendry writes: ‘Prior distributions’ widely used in Bayesian analyses, whether subjective or ‘objective’, cannot be formed in such a setting either, absent a falsely assumed crys
Introduction: Steven Levitt writes :. Diamond often would fall asleep in seminars, often for large chunks of time. What was amazing, however, is that he would open his eyes and then make by far the most insightful comment of the entire seminar! Now that we have n=2 [see the first part of the title of this blog entry], I’m wondering . . . maybe this sort of thing is more common than Levitt and I had realized. P.S. Levitt also writes: The one thing that puzzles me [Levitt] is why in the world would he want to be on the Board of the Federal Reserve? One thing economists just don’t understand are people’s preferences. To get meta here for a moment . . . just as Levitt can’t understand Diamond’s preferences, I find it extremely difficult to understand that Levitt is puzzled by Diamond’s desire to serve on the Federal Reserve, It’s obvious, no? Diamond has expertise on macroeconomics and, I assume, some strong and well-informed opinions on monetary policy; the Federal Reserve determ
6 0.94223225 1927 andrew gelman stats-2013-07-05-“Numbersense: How to use big data to your advantage”
7 0.94148183 844 andrew gelman stats-2011-08-07-Update on the new Handbook of MCMC
8 0.94097269 31 andrew gelman stats-2010-05-13-Visualization in 1939
9 0.93794554 867 andrew gelman stats-2011-08-23-The economics of the mac? A paradox of competition
10 0.93692464 1622 andrew gelman stats-2012-12-14-Can gambling addicts be identified in gambling venues?
12 0.93299556 1469 andrew gelman stats-2012-08-25-Ways of knowing
13 0.93258882 1125 andrew gelman stats-2012-01-18-Beautiful Line Charts
14 0.93179762 1634 andrew gelman stats-2012-12-21-Two reviews of Nate Silver’s new book, from Kaiser Fung and Cathy O’Neil
15 0.93160915 1692 andrew gelman stats-2013-01-25-Freakonomics Experiments
16 0.93141854 61 andrew gelman stats-2010-05-31-A data visualization manifesto
17 0.9308126 957 andrew gelman stats-2011-10-14-Questions about a study of charter schools
18 0.93069506 10 andrew gelman stats-2010-04-29-Alternatives to regression for social science predictions
19 0.93062013 1610 andrew gelman stats-2012-12-06-Yes, checking calibration of probability forecasts is part of Bayesian statistics
20 0.93004763 2287 andrew gelman stats-2014-04-09-Advice: positive-sum, zero-sum, or negative-sum