andrew_gelman_stats andrew_gelman_stats-2010 andrew_gelman_stats-2010-396 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Journalism in the age of data is a video report including interviews with many visualization people. It’s also a great example of how citations, and further information appear alongside with the video – showing us the future of video content online.
sentIndex sentText sentNum sentScore
1 Journalism in the age of data is a video report including interviews with many visualization people. [sent-1, score-1.646]
2 It’s also a great example of how citations, and further information appear alongside with the video – showing us the future of video content online. [sent-2, score-2.732]
wordName wordTfidf (topN-words)
[('video', 0.717), ('alongside', 0.274), ('interviews', 0.237), ('citations', 0.237), ('journalism', 0.215), ('visualization', 0.185), ('content', 0.179), ('showing', 0.162), ('age', 0.158), ('online', 0.157), ('appear', 0.148), ('future', 0.146), ('report', 0.124), ('including', 0.112), ('great', 0.101), ('information', 0.093), ('us', 0.089), ('many', 0.065), ('example', 0.059), ('data', 0.048), ('also', 0.047)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999994 396 andrew gelman stats-2010-11-05-Journalism in the age of data
Introduction: Journalism in the age of data is a video report including interviews with many visualization people. It’s also a great example of how citations, and further information appear alongside with the video – showing us the future of video content online.
2 0.18487681 595 andrew gelman stats-2011-02-28-What Zombies see in Scatterplots
Introduction: This video caught my interest – news video clip (from this post2 ) http://www.stat.columbia.edu/~cook/movabletype/archives/2011/02/on_summarizing.html The news commentator did seem to be trying to point out what a couple of states had to say about the claimed relationship – almost on their own. Some methods have been worked out for zombies to do just this! So I grabbed the data as close as I quickly could, modified the code slightly and here’s the zombie veiw of it. PoliticInt.pdf North Carolina is the bolded red curve, Idaho the bolded green curve. Missisipi and New York are the bolded blue. As ugly as it is this is the Bayasian marginal picture – exactly (given MCMC errror). K? p.s. you will get a very confusing picture if you forget to centre the x (i.e. see chapter 4 of Gelman and Hill book)
3 0.17279597 1277 andrew gelman stats-2012-04-23-Infographic of the year
Introduction: This (by Frans Hofmeester) is excellent. What really makes it work, I think, is that it goes slowly enough. 2 minutes and 45 seconds is enough time for me, as a viewer, to feel like I’m living through each stage of development. If the video were sped up to go from 0 to 12 in only 30 seconds, that would be cool in its own way but would give up the sense of local stability that is characteristic of development.
4 0.16505429 1698 andrew gelman stats-2013-01-30-The spam just gets weirder and weirder
Introduction: In the inbox today, under the header, “Hidden Costs behind Milk & Dairy Consumption (video)”: Hey Professor Gelman, Our site’s production team recently released a short video uncovering the local and global impact that milk has on our lives. After spending some time on your posts, I noticed you talked about dairy products and milk so I thought I’d email you. Are you the correct person to contact in regards to the content on the site? If so, let me know if you’re interested in checking out the video. Thanks, Emily S. Hmmm . . . I guess I do talk a lot about dairy products and milk on this site!
5 0.16084658 1256 andrew gelman stats-2012-04-10-Our data visualization panel at the New York Public Library
Introduction: In case you couldn’t come to our panel (with Kaiser Fung, Mark Hansen, Tahir Hemphill, Manuel Lima, and Jonathan Stray, and organized by Isabel Draves), here’s the video:
6 0.14990424 407 andrew gelman stats-2010-11-11-Data Visualization vs. Statistical Graphics
7 0.12836282 1754 andrew gelman stats-2013-03-08-Cool GSS training video! And cumulative file 1972-2012!
8 0.11021025 1286 andrew gelman stats-2012-04-28-Agreement Groups in US Senate and Dynamic Clustering
9 0.09586069 1440 andrew gelman stats-2012-08-02-“A Christmas Carol” as applied to plagiarism
10 0.087548599 2055 andrew gelman stats-2013-10-08-A Bayesian approach for peer-review panels? and a speculation about Bruno Frey
11 0.087542944 194 andrew gelman stats-2010-08-09-Data Visualization
12 0.084268302 2251 andrew gelman stats-2014-03-17-In the best alternative histories, the real world is what’s ultimately real
13 0.083405815 1752 andrew gelman stats-2013-03-06-Online Education and Jazz
14 0.080350965 1881 andrew gelman stats-2013-06-03-Boot
15 0.078228652 1811 andrew gelman stats-2013-04-18-Psychology experiments to understand what’s going on with data graphics?
16 0.07662902 1532 andrew gelman stats-2012-10-13-A real-life dollar auction game!
17 0.075721227 172 andrew gelman stats-2010-07-30-Why don’t we have peer reviewing for oral presentations?
18 0.074718937 1831 andrew gelman stats-2013-04-29-The Great Race
19 0.073152721 1125 andrew gelman stats-2012-01-18-Beautiful Line Charts
20 0.071705863 958 andrew gelman stats-2011-10-14-The General Social Survey is a great resource
topicId topicWeight
[(0, 0.063), (1, -0.021), (2, -0.018), (3, 0.012), (4, 0.048), (5, -0.02), (6, -0.043), (7, 0.009), (8, -0.043), (9, 0.011), (10, 0.009), (11, -0.012), (12, 0.021), (13, 0.022), (14, -0.017), (15, 0.003), (16, 0.027), (17, -0.01), (18, 0.032), (19, -0.017), (20, -0.002), (21, 0.001), (22, -0.004), (23, -0.008), (24, -0.01), (25, -0.019), (26, 0.004), (27, -0.016), (28, 0.03), (29, -0.002), (30, -0.028), (31, 0.0), (32, 0.021), (33, -0.003), (34, 0.024), (35, 0.051), (36, 0.017), (37, 0.015), (38, -0.009), (39, 0.022), (40, -0.031), (41, 0.016), (42, 0.059), (43, 0.015), (44, 0.029), (45, 0.052), (46, 0.021), (47, -0.017), (48, -0.018), (49, -0.022)]
simIndex simValue blogId blogTitle
same-blog 1 0.95976907 396 andrew gelman stats-2010-11-05-Journalism in the age of data
Introduction: Journalism in the age of data is a video report including interviews with many visualization people. It’s also a great example of how citations, and further information appear alongside with the video – showing us the future of video content online.
2 0.73580027 275 andrew gelman stats-2010-09-14-Data visualization at the American Evaluation Association
Introduction: Stephanie Evergreen writes: Media, web design, and marketing have all created an environment where stakeholders – clients, program participants, funders – all expect high quality graphics and reporting that effectively conveys the valuable insights from evaluation work. Some in statistics and mathematics have used data visualization strategies to support more useful reporting of complex ideas. Global growing interest in improving communications has begun to take root in the evaluation field as well. But as anyone who has sat through a day’s worth of a conference or had to endure a dissertation-worthy evaluation report knows, evaluators still have a long way to go. To support the development of researchers and evaluators, some members of the American Evaluation Association are proposing a new TIG (Topical Interest Group) on Data Visualization and Reporting. If you are a member of AEA (or want to be) and you are interested in joining this TIG, contact Stephanie Evergreen.
3 0.6297521 958 andrew gelman stats-2011-10-14-The General Social Survey is a great resource
Introduction: See, for example, this report by Deborah Carr on changing attitudes about marital infidelity: Two great things about the General Social Survey are: (1) the data are freely available online , and (2) the same questions have been asked since 1972 so you get a nice long series.
4 0.61226761 192 andrew gelman stats-2010-08-08-Turning pages into data
Introduction: There is a lot of data on the web, meant to be looked at by people, but how do you turn it into a spreadsheet people could actually analyze statistically? The technique to turn web pages intended for people into structured data sets intended for computers is called “screen scraping.” It has just been made easier with a wiki/community http://scraperwiki.com/ . They provide libraries to extract information from PDF, Excel files, to automatically fill in forms and similar. Moreover, the community aspect of it should allow researchers doing similar things to get connected. It’s very good. Here’s an example of scraping road accident data or port of London ship arrivals . You can already find collections of structured data online, examples are Infochimps (“find the world’s data”), and Freebase (“An entity graph of people, places and things, built by a community that loves open data.”). There’s also a repository system for data, TheData (“An open-source application for pub
5 0.60468727 2065 andrew gelman stats-2013-10-17-Cool dynamic demographic maps provide beautiful illustration of Chris Rock effect
Introduction: Robert Gonzalez reports on some beautiful graphs from John Nelson. Here’s Nelson: The sexes start out homogenous, go super segregated in the teen years, segregate for business in the twenty-somethings, and re-couple for co-habitation years. Then the lights fade into faint pockets of pink. I [Nelson] am using simple tract-level population/gender counts from the US Census Bureau. Because their tract boundaries extend into the water and vacant area, I used NYC’s Bytes of the Big Apple zoning shapes to clip the census tracts to residentially zoned areas -giving me a more realistic (and more recognizable) definition of populated areas. The census breaks out their population counts by gender for five-year age spans ranging from teeny tiny infants through esteemed 85+ year-olds. And here’s Gonzalez: Between ages 0 and 14, the entire map is more or less an evenly mixed purple landscape; newborns, children and adolescents, after all, can’t really choose where the
6 0.60202277 304 andrew gelman stats-2010-09-29-Data visualization marathon
7 0.59405506 1689 andrew gelman stats-2013-01-23-MLB Hall of Fame Voting Trajectories
8 0.59367001 595 andrew gelman stats-2011-02-28-What Zombies see in Scatterplots
9 0.59284991 215 andrew gelman stats-2010-08-18-DataMarket
10 0.58317471 1604 andrew gelman stats-2012-12-04-An epithet I can live with
11 0.58255243 1811 andrew gelman stats-2013-04-18-Psychology experiments to understand what’s going on with data graphics?
12 0.57333994 714 andrew gelman stats-2011-05-16-NYT Labs releases Openpaths, a utility for saving your iphone data
13 0.57088423 1286 andrew gelman stats-2012-04-28-Agreement Groups in US Senate and Dynamic Clustering
14 0.57075965 1014 andrew gelman stats-2011-11-16-Visualizations of NYPD stop-and-frisk data
15 0.5687328 1828 andrew gelman stats-2013-04-27-Time-Sharing Experiments for the Social Sciences
16 0.566836 2092 andrew gelman stats-2013-11-07-Data visualizations gone beautifully wrong
17 0.56534618 764 andrew gelman stats-2011-06-14-Examining US Legislative process with “Many Bills”
18 0.56015879 927 andrew gelman stats-2011-09-26-R and Google Visualization
19 0.55997604 1669 andrew gelman stats-2013-01-12-The power of the puzzlegraph
20 0.55932224 1810 andrew gelman stats-2013-04-17-Subway series
topicId topicWeight
[(5, 0.043), (24, 0.037), (65, 0.272), (98, 0.082), (99, 0.358)]
simIndex simValue blogId blogTitle
1 0.96291745 1333 andrew gelman stats-2012-05-20-Question 10 of my final exam for Design and Analysis of Sample Surveys
Introduction: 10. Out of a random sample of 100 Americans, zero report having ever held political office. From this information, give a 95% confidence interval for the proportion of Americans who have ever held political office. Solution to question 9 From yesterday : 9. Out of a population of 100 medical records, 40 are randomly sampled and then audited. 10 out of the 40 audits reveal fraud. From this information, give an estimate, standard error, and 95% confidence interval for the proportion of audits in the population with fraud. Solution: estimate is p.hat=10/40=0.25. Se is sqrt(1-f)*sqrt(p.hat*(1-.hat)/n)=sqrt(1-0.4)*sqrt(0.25*0.75/40)=0.053. 95% interval is [0.25 +/- 2*0.053] = [0.14,0.36].
2 0.96238089 457 andrew gelman stats-2010-12-07-Whassup with phantom-limb treatment?
Introduction: OK, here’s something that is completely baffling me. I read this article by John Colapinto on the neuroscientist V. S. Ramachandran, who’s famous for his innovative treatment for “phantom limb” pain: His first subject was a young man who a decade earlier had crashed his motorcycle and torn from his spinal column the nerves supplying the left arm. After keeping the useless arm in a sling for a year, the man had the arm amputated above the elbow. Ever since, he had felt unremitting cramping in the phantom limb, as though it were immobilized in an awkward position. . . . Ramachandram positioned a twenty-inch-by-twenty-inch drugstore mirror . . . and told him to place his intact right arm on one side of the mirror and his stump on the other. He told the man to arrange the mirror so that the reflection created the illusion that his intact arm was the continuation of the amputated one. The Ramachandran asked the man to move his right and left arms . . . “Oh, my God!” the man began
same-blog 3 0.95031476 396 andrew gelman stats-2010-11-05-Journalism in the age of data
Introduction: Journalism in the age of data is a video report including interviews with many visualization people. It’s also a great example of how citations, and further information appear alongside with the video – showing us the future of video content online.
4 0.91295677 1993 andrew gelman stats-2013-08-22-Improvements to Kindle Version of BDA3
Introduction: I let Andrew know about the comments about the defective Kindle version of BDA2 and he wrote to his editor at Chapman and Hall, Rob Calver, who wrote back with this info: I can guarantee that the Kindle version of the third edition will be a substantial improvement. We publish all of our mathematics and statistics books through Kindle now as Print Replica. This means that we send the printer pdf to Amazon and they convert into their Print Replica format, which is essentially just a pdf viewer. We have not experienced very many issues at all with this setup. Unfortunately, there was a period before Amazon launched Print Replica when they converted math/stat books into their Kindle format, and converted them very badly in some cases. Equations were held as images, making them very difficult to read. It appears this was the case with Andrew’s second edition, judging by some of the comments. The third edition [of BDA] will be available through Kindle with a short delay (for Amazo
5 0.90855074 990 andrew gelman stats-2011-11-04-At the politics blogs . . .
Introduction: There is no increased inequality, unless you look at the top 1% The revolving door of U.S. politics The redistricting song
6 0.89584994 2062 andrew gelman stats-2013-10-15-Last word on Mister P (for now)
7 0.88417232 1021 andrew gelman stats-2011-11-21-Don’t judge a book by its title
8 0.87880147 1845 andrew gelman stats-2013-05-07-Is Felix Salmon wrong on free TV?
9 0.86990017 523 andrew gelman stats-2011-01-18-Spam is out of control
11 0.86501706 1361 andrew gelman stats-2012-06-02-Question 23 of my final exam for Design and Analysis of Sample Surveys
12 0.8628794 1197 andrew gelman stats-2012-03-04-“All Models are Right, Most are Useless”
13 0.85840631 2056 andrew gelman stats-2013-10-09-Mister P: What’s its secret sauce?
14 0.85561579 1426 andrew gelman stats-2012-07-23-Special effects
15 0.85189575 1334 andrew gelman stats-2012-05-21-Question 11 of my final exam for Design and Analysis of Sample Surveys
16 0.84986281 2292 andrew gelman stats-2014-04-15-When you believe in things that you don’t understand
17 0.84632182 2061 andrew gelman stats-2013-10-14-More on Mister P and how it does what it does
18 0.84348577 1819 andrew gelman stats-2013-04-23-Charles Murray’s “Coming Apart” and the measurement of social and political divisions
19 0.84131819 416 andrew gelman stats-2010-11-16-Is parenting a form of addiction?
20 0.83634049 1365 andrew gelman stats-2012-06-04-Question 25 of my final exam for Design and Analysis of Sample Surveys