andrew_gelman_stats andrew_gelman_stats-2010 andrew_gelman_stats-2010-289 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Aleks points me to this article showing some pretty maps by Eric Fisher showing where people of different ethnicity live within several metro areas within the U.S. The idea is simple but effective; in the words of Cliff Kuang: Fisher used a straight forward method borrowed from Rankin: Using U.S. Census data from 2000, he created a map where one dot equals 25 people. The dots are then color-coded based on race: White is pink; Black is blue; Hispanic is orange, and Asian is green. The results for various cities are fascinating: Just like every city is different, every city is integrated (or segregated) in different ways. New York is shown below. No, San Francisco is not “very, very white” But I worry that these maps are difficult for non-experts to read. For example, Kuang writes the following:: San Francisco proper is very, very white. This is an understandable mistake coming from someone who, I assume, has never lived in the Bay Area. But what’s amazing i
sentIndex sentText sentNum sentScore
1 Aleks points me to this article showing some pretty maps by Eric Fisher showing where people of different ethnicity live within several metro areas within the U. [sent-1, score-0.784]
2 The idea is simple but effective; in the words of Cliff Kuang: Fisher used a straight forward method borrowed from Rankin: Using U. [sent-3, score-0.158]
3 Census data from 2000, he created a map where one dot equals 25 people. [sent-5, score-0.369]
4 The dots are then color-coded based on race: White is pink; Black is blue; Hispanic is orange, and Asian is green. [sent-6, score-0.074]
5 The results for various cities are fascinating: Just like every city is different, every city is integrated (or segregated) in different ways. [sent-7, score-0.839]
6 No, San Francisco is not “very, very white” But I worry that these maps are difficult for non-experts to read. [sent-9, score-0.13]
7 For example, Kuang writes the following:: San Francisco proper is very, very white. [sent-10, score-0.068]
8 This is an understandable mistake coming from someone who, I assume, has never lived in the Bay Area. [sent-11, score-0.234]
9 But what’s amazing is that Kuang made the above howler after looking at the color-coded map of the city! [sent-12, score-0.244]
10 , here are the statistics : The city of San Francisco is 45% non-Hispanic white, 14% Hispanic, 7% black, and 31% Asian (with the remaining 3% being Native American, Pacific Islander, or reporting multiple races). [sent-15, score-0.313]
11 My point is that even a clean graph like Fisher’s–a graph that I love–can still easily be misread. [sent-18, score-0.293]
12 It always helps to point to one of the points or lines and explain exactly what it is. [sent-20, score-0.124]
wordName wordTfidf (topN-words)
[('kuang', 0.49), ('francisco', 0.259), ('san', 0.243), ('city', 0.239), ('white', 0.219), ('fisher', 0.205), ('hispanic', 0.184), ('asian', 0.158), ('lived', 0.154), ('maps', 0.13), ('map', 0.122), ('amazing', 0.122), ('black', 0.12), ('graph', 0.116), ('islander', 0.112), ('segregated', 0.112), ('orange', 0.105), ('equals', 0.105), ('pacific', 0.105), ('showing', 0.102), ('metro', 0.101), ('borrowed', 0.097), ('cliff', 0.097), ('york', 0.093), ('bay', 0.085), ('integrated', 0.083), ('dot', 0.082), ('native', 0.081), ('races', 0.081), ('understandable', 0.08), ('pink', 0.079), ('ain', 0.079), ('within', 0.078), ('dots', 0.074), ('cities', 0.074), ('remaining', 0.074), ('fascinating', 0.069), ('ethnicity', 0.069), ('every', 0.069), ('aleks', 0.068), ('proper', 0.068), ('census', 0.068), ('different', 0.066), ('helps', 0.066), ('eric', 0.064), ('race', 0.063), ('straight', 0.061), ('clean', 0.061), ('created', 0.06), ('points', 0.058)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000001 289 andrew gelman stats-2010-09-21-“How segregated is your city?”: A story of why every graph, no matter how clear it seems to be, needs a caption to anchor the reader in some numbers
Introduction: Aleks points me to this article showing some pretty maps by Eric Fisher showing where people of different ethnicity live within several metro areas within the U.S. The idea is simple but effective; in the words of Cliff Kuang: Fisher used a straight forward method borrowed from Rankin: Using U.S. Census data from 2000, he created a map where one dot equals 25 people. The dots are then color-coded based on race: White is pink; Black is blue; Hispanic is orange, and Asian is green. The results for various cities are fascinating: Just like every city is different, every city is integrated (or segregated) in different ways. New York is shown below. No, San Francisco is not “very, very white” But I worry that these maps are difficult for non-experts to read. For example, Kuang writes the following:: San Francisco proper is very, very white. This is an understandable mistake coming from someone who, I assume, has never lived in the Bay Area. But what’s amazing i
2 0.19018432 1316 andrew gelman stats-2012-05-12-black and Black, white and White
Introduction: I’ve always thought it looked strange to see people referred to in print as Black or White rather than black or white. For example consider this sentence: “A black guy was walking down the street and he saw a bunch of white guys standing around.” That looks fine, whereas “A Black guy was walking down the street and he saw a bunch of White guys standing around”—that looks weird to me, as if the encounter was taking place in an Ethnic Studies seminar. But maybe I’m wrong on this. Jay Livingston argues that black and white are colors whereas Black and White are races (or, as I would prefer to say, ethnic categories) and illustrates with this picture of a white person and a White person: In conversation, I sometimes talk about pink people, brown people, and tan people, but that won’t work in a research paper. P.S. I suspect Carp will argue that I’m being naive: meanings of words change across contexts and over time. To which I reply: Sure, but I still have to choose h
3 0.15246375 68 andrew gelman stats-2010-06-03-…pretty soon you’re talking real money.
Introduction: A New York Times article reports the opening of a half-mile section of bike path, recently built along the west side of Manhattan at a cost of $16M, or roughly $30 million per mile. That’s about $5700 per linear foot. Kinda sounds like a lot, doesn’t it? Well, $30 million per mile for about one car-lane mile is a lot, but it’s not out of line compared to other urban highway construction costs. The Doyle Drive project in San Francisco — a freeway to replace the current old and deteriorating freeway approach to the Golden Gate Bridge — is currently under way at $1 billion for 1.6 miles…but hey, it will have six lanes each way, so that isn’t so bad, at $50 million per lane-mile. And there are other components to the project, too, not just building the highway (there will also be bike paths, landscaping, on- and off-ramps, and so on). All in all it seems roughly in line with the New York bike lane project. Speaking of the Doyle Drive project, one expense was the cost of movin
4 0.14875495 1649 andrew gelman stats-2013-01-02-Back when 50 miles was a long way
Introduction: This post is by Phil. Michael Graham Richard has posted some great maps from the 1932 Atlas of the Historical Geography of the United States; the maps show how long it took to get to various places in the U.S. from New York City in 1800, 1830, 1857, and 1930. (I wonder if the atlas has one from around 1900 as well, that didn’t make it into the article? I’d like to see it, too, if it exists.) Worth a look. This post is by Phil. Time to get to anywhere in the conterminous states from New York City, in 1857
5 0.14344123 1978 andrew gelman stats-2013-08-12-Fixing the race, ethnicity, and national origin questions on the U.S. Census
Introduction: In his new book, “What is Your Race? The Census and Our Flawed Efforts to Classify Americans,” former Census Bureau director Ken Prewitt recommends taking the race question off the decennial census: He recommends gradual changes, integrating the race and national origin questions while improving both. In particular, he would replace the main “race” question by a “race or origin” question, with the instruction to “Mark one or more” of the following boxes: “White,” “Black, African Am., or Negro,” “Hispanic, Latino, or Spanish origin,” “American Indian or Alaska Native,” “Asian”, “Native Hawaiian or Other Pacific Islander,” and “Some other race or origin.” Then the next question is to write in “specific race, origin, or enrolled or principal tribe.” Prewitt writes: His suggestion is to go with these questions in 2020 and 2030, then in 2040 “drop the race question and use only the national origin question.” He’s also relying on the American Community Survey to gather a lo
6 0.12225491 613 andrew gelman stats-2011-03-15-Gay-married state senator shot down gay marriage
8 0.11424589 1880 andrew gelman stats-2013-06-02-Flame bait
9 0.10249249 2255 andrew gelman stats-2014-03-19-How Americans vote
10 0.099729672 1085 andrew gelman stats-2011-12-27-Laws as expressive
11 0.09884984 1810 andrew gelman stats-2013-04-17-Subway series
12 0.09664394 1297 andrew gelman stats-2012-05-03-New New York data research organizations
13 0.092549168 1869 andrew gelman stats-2013-05-24-In which I side with Neyman over Fisher
14 0.088845678 502 andrew gelman stats-2011-01-04-Cash in, cash out graph
15 0.086598903 469 andrew gelman stats-2010-12-16-2500 people living in a park in Chicago?
16 0.084735759 1653 andrew gelman stats-2013-01-04-Census dotmap
17 0.084596097 1027 andrew gelman stats-2011-11-25-Note to student journalists: Google is your friend
18 0.084341712 492 andrew gelman stats-2010-12-30-That puzzle-solving feeling
19 0.084054731 2288 andrew gelman stats-2014-04-10-Small multiples of lineplots > maps (ok, not always, but yes in this case)
20 0.083841652 125 andrew gelman stats-2010-07-02-The moral of the story is, Don’t look yourself up on Google
topicId topicWeight
[(0, 0.113), (1, -0.047), (2, 0.025), (3, 0.055), (4, 0.062), (5, -0.057), (6, -0.057), (7, 0.039), (8, -0.023), (9, -0.028), (10, -0.008), (11, -0.003), (12, -0.005), (13, 0.024), (14, 0.013), (15, 0.039), (16, 0.026), (17, 0.005), (18, -0.028), (19, -0.101), (20, -0.041), (21, -0.02), (22, 0.0), (23, 0.023), (24, 0.027), (25, -0.037), (26, -0.028), (27, 0.03), (28, 0.032), (29, 0.021), (30, 0.049), (31, -0.044), (32, -0.032), (33, 0.01), (34, 0.01), (35, -0.019), (36, 0.002), (37, -0.016), (38, -0.023), (39, 0.016), (40, -0.06), (41, 0.014), (42, 0.029), (43, 0.046), (44, -0.009), (45, 0.046), (46, -0.011), (47, 0.006), (48, 0.008), (49, -0.014)]
simIndex simValue blogId blogTitle
same-blog 1 0.96100765 289 andrew gelman stats-2010-09-21-“How segregated is your city?”: A story of why every graph, no matter how clear it seems to be, needs a caption to anchor the reader in some numbers
Introduction: Aleks points me to this article showing some pretty maps by Eric Fisher showing where people of different ethnicity live within several metro areas within the U.S. The idea is simple but effective; in the words of Cliff Kuang: Fisher used a straight forward method borrowed from Rankin: Using U.S. Census data from 2000, he created a map where one dot equals 25 people. The dots are then color-coded based on race: White is pink; Black is blue; Hispanic is orange, and Asian is green. The results for various cities are fascinating: Just like every city is different, every city is integrated (or segregated) in different ways. New York is shown below. No, San Francisco is not “very, very white” But I worry that these maps are difficult for non-experts to read. For example, Kuang writes the following:: San Francisco proper is very, very white. This is an understandable mistake coming from someone who, I assume, has never lived in the Bay Area. But what’s amazing i
2 0.7627297 428 andrew gelman stats-2010-11-24-Flawed visualization of U.S. voting maybe has some good features
Introduction: Aleks points me to this attractive visualization by David Sparks of U.S. voting. On the plus side, the pictures and associated movie (showing an oddly horizontally-stretched-out United States) are pretty and seem to have gotten a bit of attention–the maps have received 31 comments, which is more than we get on almost all our blog entries here. On the minus side, the movie is misleading. In many years it shows the whole U.S. as a single color, even when candidates from both parties won some votes. The text has errors too, for example the false claim that the South favored a Democratic candidate in 1980. The southern states that Jimmy Carter carried in 1980 were Georgia and . . . that’s it. But, as Aleks says, once this tool is out there, maybe people can use it to do better. It’s in that spirit that I’m linking. Ya gotta start somewhere. Also, this is a good example of a general principle: When you make a graph, look at it carefully to see if it makes sense!
3 0.73685986 469 andrew gelman stats-2010-12-16-2500 people living in a park in Chicago?
Introduction: Frank Hansen writes: Columbus Park is on Chicago’s west side, in the Austin neighborhood. The park is a big green area which includes a golf course. Here is the google satellite view. Here is the nytimes page. Go to Chicago, and zoom over to the census tract 2521, which is just north of the horizontal gray line (Eisenhower Expressway, aka I290) and just east of Oak Park. The park is labeled on the nytimes map. The census data have around 50 dots (they say 50 people per dot) in the park which has no residential buildings. Congressional district is Danny Davis, IL7. Here’s a map of the district. So, how do we explain the map showing ~50 dots worth of people living in the park. What’s up with the algorithm to place the dots? I dunno. I leave this one to you, the readers.
4 0.72419804 2308 andrew gelman stats-2014-04-27-White stripes and dead armadillos
Introduction: Paul Alper writes: For years I [Alper] have been obsessed by the color of the line which divides oncoming (i.e., opposing) traffic because I was firmly convinced that the color of the center line changed during my lifetime. Yet, I never could find anyone who had the same remembrance (or interest in the topic). The other day I found this this explanation that vindicates my recollection (and I was continuously out of the U.S. from 1969 to 1973): The question of which color to use for highway center lines in the United States enjoyed considerable debate and changing standards over a period of several decades. By November 1954, 47 states had adopted white as their standard color for highway centerlines, with Oregon being the last holdout to use yellow. In 1958, the U.S. Bureau of Public Roads adopted white as the standard color for the new interstate highway system. The 1971 edition of the Manual on Uniform Traffic Control Devices, however, mandated yellow as the standard color o
5 0.70398581 1653 andrew gelman stats-2013-01-04-Census dotmap
Introduction: Andrew Vande Moere points to this impressive interactive map from Brandon Martin-Anderson showing the locations of all the residents of the United States and Canada. It says, “The map has 341,817,095 dots – one for each person.” Not quite . . . I was hoping to zoom into my building (approximately 10 people live on our floor, I say approximately because two of the apartments are split between two floors and I’m not sure how they would assign the residents), but unfortunately our entire block is just a solid mass of black. Also, they put a few dots in the park and in the river by accident (presumably because the borders of the census blocks were specified only approximately). But, hey, no algorithm is perfect. It’s hard to know what to do about this. The idea of mapping every person is cool, but you’ll always run into trouble displaying densely populated areas. Smaller dots might work, but then that might depend on the screen being used for display.
6 0.6742866 536 andrew gelman stats-2011-01-24-Trends in partisanship by state
7 0.6650461 672 andrew gelman stats-2011-04-20-The R code for those time-use graphs
8 0.66364974 488 andrew gelman stats-2010-12-27-Graph of the year
9 0.65881628 2154 andrew gelman stats-2013-12-30-Bill Gates’s favorite graph of the year
10 0.64251572 915 andrew gelman stats-2011-09-17-(Worst) graph of the year
11 0.63520384 502 andrew gelman stats-2011-01-04-Cash in, cash out graph
12 0.63372242 787 andrew gelman stats-2011-07-05-Different goals, different looks: Infovis and the Chris Rock effect
13 0.63341725 2065 andrew gelman stats-2013-10-17-Cool dynamic demographic maps provide beautiful illustration of Chris Rock effect
14 0.62836415 1316 andrew gelman stats-2012-05-12-black and Black, white and White
15 0.61317891 1125 andrew gelman stats-2012-01-18-Beautiful Line Charts
16 0.6131205 2288 andrew gelman stats-2014-04-10-Small multiples of lineplots > maps (ok, not always, but yes in this case)
17 0.6124323 965 andrew gelman stats-2011-10-19-Web-friendly visualizations in R
18 0.61076444 1669 andrew gelman stats-2013-01-12-The power of the puzzlegraph
19 0.61016589 1684 andrew gelman stats-2013-01-20-Ugly ugly ugly
20 0.60412025 739 andrew gelman stats-2011-05-31-When Did Girls Start Wearing Pink?
topicId topicWeight
[(7, 0.188), (9, 0.032), (16, 0.058), (21, 0.033), (23, 0.013), (24, 0.155), (27, 0.017), (45, 0.012), (61, 0.011), (63, 0.01), (72, 0.031), (77, 0.033), (86, 0.053), (87, 0.01), (92, 0.013), (98, 0.01), (99, 0.228)]
simIndex simValue blogId blogTitle
same-blog 1 0.92938399 289 andrew gelman stats-2010-09-21-“How segregated is your city?”: A story of why every graph, no matter how clear it seems to be, needs a caption to anchor the reader in some numbers
Introduction: Aleks points me to this article showing some pretty maps by Eric Fisher showing where people of different ethnicity live within several metro areas within the U.S. The idea is simple but effective; in the words of Cliff Kuang: Fisher used a straight forward method borrowed from Rankin: Using U.S. Census data from 2000, he created a map where one dot equals 25 people. The dots are then color-coded based on race: White is pink; Black is blue; Hispanic is orange, and Asian is green. The results for various cities are fascinating: Just like every city is different, every city is integrated (or segregated) in different ways. New York is shown below. No, San Francisco is not “very, very white” But I worry that these maps are difficult for non-experts to read. For example, Kuang writes the following:: San Francisco proper is very, very white. This is an understandable mistake coming from someone who, I assume, has never lived in the Bay Area. But what’s amazing i
2 0.92705035 975 andrew gelman stats-2011-10-27-Caffeine keeps your Mac awake
Introduction: Sometimes my computer goes blank when I’m giving a presentation and I haven’t clicked on anything for awhile. I mentioned this to Malecki and he installed Caffeine on my computer; problem solved.
3 0.91387343 1592 andrew gelman stats-2012-11-27-Art-math
Introduction: This seems like the sort of thing I would like: Drawing from My Mind’s Eye: Dorothea Rockburne in Conversation with David Cohen Introduced by Nina Samuel Thursday, November 29 6 pm BGC, 38 West 86th Street Benoît Mandelbrot, unusual among mathematicians of the twentieth century, harnessed the power of visual images to express his theories and to pursue new lines of thought. In this conversation artist Dorothea Rockburne will share memories of studying with mathematician Max Dehn at Black Mountain College, of meeting Mandelbrot, and discuss her recent work. Exhibition curator Nina Samuel will discuss the related exhibition “The Islands of Benoît Mandelbrot: Fractals, Chaos, and the Materiality of Thinking,” on view in the BGC Focus Gallery through January 27, 2013. David Cohen is editor and publisher of artcritical.com as well as founder and moderator of The Review Panel. Dorothea Rockburne is a distinguished artist whose work has been inspired by her lifelong st
4 0.90559804 1525 andrew gelman stats-2012-10-08-Ethical standards in different data communities
Introduction: I opened the paper today and saw this from Paul Krugman, on Jack Welch, the former chairman of General Electric, who posted an assertion on Twitter that the [recent unemployment data] had been cooked to help President Obama’s re-election campaign. His claim was quickly picked up by right-wing pundits and media personalities. It was nonsense, of course. Job numbers are prepared by professional civil servants, at an agency that currently has no political appointees. But then maybe Mr. Welch — under whose leadership G.E. reported remarkably smooth earnings growth, with none of the short-term fluctuations you might have expected (fluctuations that reappeared under his successor) — doesn’t know how hard it would be to cook the jobs data. I was curious so I googled *general electric historical earnings*. It was surprisingly difficult to find the numbers! Most of the links just went back to 2011, or to 2008. Eventually I came across this blog by Barry Ritholtz that showed this
5 0.90224266 721 andrew gelman stats-2011-05-20-Non-statistical thinking in the US foreign policy establishment
Introduction: I’m a few weeks behind in my New Yorker reading and so just recently read this fascinating article by Ryan Lizza on the current administration’s foreign policy. He gives some insights into the transformation Obama from antiwar candidate to a president conducting three wars. Speaking as a statistician, though, what grabbed my eye was a doctrine of journalist/professor/policymaker Samantha Power. Lizza writes: In 2002, after graduating from Harvard Law School, she wrote “A Problem from Hell,” which surveyed the grim history of six genocides committed in the twentieth century. Propounding a liberal-interventionist view, Power argued that “mass killing” on the scale of Rwanda or Bosnia must be prevented by other nations, including the United States. She wrote that America and its allies rarely have perfect information about when a regime is about to commit genocide; a President, therefore, must have “a bias toward belief” that massacres are imminent. From a statistical perspect
6 0.8871609 1976 andrew gelman stats-2013-08-10-The birthday problem
7 0.86882246 1194 andrew gelman stats-2012-03-04-Multilevel modeling even when you’re not interested in predictions for new groups
8 0.86237609 1603 andrew gelman stats-2012-12-03-Somebody listened to me!
9 0.86132836 1607 andrew gelman stats-2012-12-05-The p-value is not . . .
10 0.86104977 2165 andrew gelman stats-2014-01-09-San Fernando Valley cityscapes: An example of the benefits of fractal devastation?
11 0.8574996 1699 andrew gelman stats-2013-01-31-Fowlerpalooza!
12 0.85304284 402 andrew gelman stats-2010-11-09-Kaggle: forecasting competitions in the classroom
13 0.84615892 226 andrew gelman stats-2010-08-23-More on those L.A. Times estimates of teacher effectiveness
14 0.83595049 1814 andrew gelman stats-2013-04-20-A mess with which I am comfortable
15 0.82991588 2304 andrew gelman stats-2014-04-24-An open site for researchers to post and share papers
16 0.82653666 301 andrew gelman stats-2010-09-28-Correlation, prediction, variation, etc.
18 0.8237344 187 andrew gelman stats-2010-08-05-Update on state size and governors’ popularity
19 0.82357514 277 andrew gelman stats-2010-09-14-In an introductory course, when does learning occur?
20 0.82110751 81 andrew gelman stats-2010-06-12-Reputational Capital and Incentives in Organizations