andrew_gelman_stats andrew_gelman_stats-2011 andrew_gelman_stats-2011-714 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Jake Porway writes: We launched Openpaths the other week. It’s a site where people can privately upload and view their iPhone location data (at least until an Apple update wipes it out) and also download their data for their own use. More than just giving people a neat tool to view their data with, however, we’re also creating an option for them to donate their data to research projects at varying levels of anonymity. We’re still working out the terms for that, but we’d love any input and to get in touch with anyone who might want to use the data. I don’t have any use for this personally but maybe it will interest some of you. From the webpage: Openpaths is an anonymous, user-contributed database for the personal location data files recorded by iOS devices. Users securely store, explore, and manage their personal location data, and grant researchers access to portions of that data as they choose. All location data stored in openpaths is kept separate from user profi
sentIndex sentText sentNum sentScore
1 Jake Porway writes: We launched Openpaths the other week. [sent-1, score-0.072]
2 It’s a site where people can privately upload and view their iPhone location data (at least until an Apple update wipes it out) and also download their data for their own use. [sent-2, score-1.118]
3 More than just giving people a neat tool to view their data with, however, we’re also creating an option for them to donate their data to research projects at varying levels of anonymity. [sent-3, score-0.907]
4 We’re still working out the terms for that, but we’d love any input and to get in touch with anyone who might want to use the data. [sent-4, score-0.078]
5 From the webpage: Openpaths is an anonymous, user-contributed database for the personal location data files recorded by iOS devices. [sent-6, score-0.824]
6 Users securely store, explore, and manage their personal location data, and grant researchers access to portions of that data as they choose. [sent-7, score-1.08]
7 All location data stored in openpaths is kept separate from user profiles, and linked only at the moment when a user grants access to a research request. [sent-8, score-2.034]
8 Each user has encrypted their data with a unique passphrase that only they know, and that openpaths does not store. [sent-9, score-1.088]
9 When a user grants a data donation request, we confirm that user’s passphrase at that time, and use it to retrieve the appropriate location files. [sent-10, score-1.437]
10 Research requests are received from any and all projects – public, private, commercial, academic, artistic, or governmental. [sent-11, score-0.382]
11 Requests typically look at specific geographical areas or demographic information about their subjects, so research requests include these criteria. [sent-12, score-0.526]
12 Based on this information, users receive monthly updates that list the projects where their data is a good fit, and are offered the opportunity to donate their data. [sent-13, score-0.734]
13 In return, we ask researchers to provide a small benefit to their data donors. [sent-14, score-0.16]
14 This might be a custom visualization of a donor’s location information, access to the results of the research, or other related benefits. [sent-15, score-0.62]
wordName wordTfidf (topN-words)
[('openpaths', 0.432), ('location', 0.37), ('user', 0.28), ('passphrase', 0.216), ('requests', 0.214), ('projects', 0.168), ('access', 0.164), ('donate', 0.162), ('data', 0.16), ('grants', 0.158), ('users', 0.106), ('retrieve', 0.098), ('donor', 0.098), ('iphone', 0.098), ('porway', 0.098), ('wipes', 0.098), ('research', 0.097), ('privately', 0.093), ('securely', 0.093), ('stored', 0.093), ('upload', 0.089), ('donation', 0.089), ('custom', 0.086), ('jake', 0.086), ('personal', 0.084), ('profiles', 0.083), ('artistic', 0.081), ('neat', 0.081), ('portions', 0.081), ('view', 0.079), ('information', 0.078), ('touch', 0.078), ('geographical', 0.076), ('apple', 0.075), ('recorded', 0.074), ('updates', 0.074), ('launched', 0.072), ('download', 0.069), ('database', 0.068), ('files', 0.068), ('commercial', 0.067), ('store', 0.067), ('confirm', 0.066), ('manage', 0.066), ('monthly', 0.064), ('request', 0.063), ('anonymous', 0.063), ('webpage', 0.062), ('grant', 0.062), ('demographic', 0.061)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000001 714 andrew gelman stats-2011-05-16-NYT Labs releases Openpaths, a utility for saving your iphone data
Introduction: Jake Porway writes: We launched Openpaths the other week. It’s a site where people can privately upload and view their iPhone location data (at least until an Apple update wipes it out) and also download their data for their own use. More than just giving people a neat tool to view their data with, however, we’re also creating an option for them to donate their data to research projects at varying levels of anonymity. We’re still working out the terms for that, but we’d love any input and to get in touch with anyone who might want to use the data. I don’t have any use for this personally but maybe it will interest some of you. From the webpage: Openpaths is an anonymous, user-contributed database for the personal location data files recorded by iOS devices. Users securely store, explore, and manage their personal location data, and grant researchers access to portions of that data as they choose. All location data stored in openpaths is kept separate from user profi
2 0.08527419 569 andrew gelman stats-2011-02-12-Get the Data
Introduction: At GetTheData , you can ask and answer data related questions. Here’s a preview: I’m not sure a Q&A; site is the best way to do this. My pipe dream is to create a taxonomy of variables and instances, and collect spreadsheets annotated this way. Imagine doing a search of type: “give me datasets, where an instance is a person, the variables are age, gender and weight” – and out would come datasets, each one tagged with the descriptions of the variables that were held constant for the whole dataset (person_type=student, location=Columbia, time_of_study=1/1/2009, study_type=longitudinal). It would even be possible to automatically convert one variable into another, if it was necessary (like age = time_of_measurement-time_of_birth). Maybe the dream of Semantic Web will actually be implemented for relatively structured statistical data rather than much fuzzier “knowledge”, just consider the difficulties of developing a universal Freebase . Wolfram|Alpha is perhaps currently clos
3 0.084008232 1811 andrew gelman stats-2013-04-18-Psychology experiments to understand what’s going on with data graphics?
Introduction: Ricardo Pietrobon writes, regarding my post from last year on attitudes toward data graphics, Wouldn’t it be the case to start formally studying the usability of graphics from a cognitive perspective? with platforms such as the mechanical turk it should be fairly straightforward to test alternative methods and come to some conclusions about what might be more informative and what might better assist in supporting decisions. btw, my guess is that these two constructs might not necessarily agree with each other. And Jessica Hullman provides some background: Measuring success for the different goals that you hint at in your article is indeed challenging, and I don’t think that most visualization researchers would claim to have met this challenge (myself included). Visualization researchers may know the user psychology well when it comes to certain dimensions of a graph’s effectiveness (such as quick and accurate responses), but I wouldn’t agree with this statement as a gene
4 0.082824618 2124 andrew gelman stats-2013-12-05-Stan (quietly) passes 512 people on the users list
Introduction: Stan is alive and well. We’re up to 523 people on the users list . [We're sure there are many more than 523 actual users, since it's easy to download and use Stan directly without joining the list.] We’re working on a v2.1.0 release now and we hope to release it in within the next couple of weeks.
5 0.08255025 2325 andrew gelman stats-2014-05-07-Stan users meetup next week
Introduction: We have a Stan users meetup for NYC. We’ll have monthly sessions where we can discuss modeling, success stories, pain points, and really have a chance for the user base and the developers to interact in NYC. The first meetup will be on Tuesday, 5/13. I’ll be giving a overview of Stan aimed at a general audience. If you’re interested, please register for the group / talk. Space is limited.
6 0.081437528 268 andrew gelman stats-2010-09-10-Fighting Migraine with Multilevel Modeling
7 0.081114545 2178 andrew gelman stats-2014-01-20-Mailing List Degree-of-Difficulty Difficulty
8 0.079663813 1009 andrew gelman stats-2011-11-14-Wickham R short course
9 0.079259619 463 andrew gelman stats-2010-12-11-Compare p-values from privately funded medical trials to those in publicly funded research?
10 0.07443656 908 andrew gelman stats-2011-09-14-Type M errors in the lab
11 0.073433213 1920 andrew gelman stats-2013-06-30-“Non-statistical” statistics tools
12 0.072468519 1661 andrew gelman stats-2013-01-08-Software is as software does
13 0.07084766 18 andrew gelman stats-2010-05-06-$63,000 worth of abusive research . . . or just a really stupid waste of time?
14 0.070198983 1447 andrew gelman stats-2012-08-07-Reproducible science FAIL (so far): What’s stoppin people from sharin data and code?
15 0.069760911 1933 andrew gelman stats-2013-07-10-Please send all comments to -dev-ripley
16 0.069685206 1019 andrew gelman stats-2011-11-19-Validation of Software for Bayesian Models Using Posterior Quantiles
17 0.06825573 946 andrew gelman stats-2011-10-07-Analysis of Power Law of Participation
18 0.06682992 1948 andrew gelman stats-2013-07-21-Bayes related
19 0.064391516 1749 andrew gelman stats-2013-03-04-Stan in L.A. this Wed 3:30pm
20 0.063887149 304 andrew gelman stats-2010-09-29-Data visualization marathon
topicId topicWeight
[(0, 0.109), (1, -0.001), (2, -0.035), (3, -0.011), (4, 0.052), (5, 0.028), (6, -0.054), (7, -0.044), (8, -0.063), (9, -0.001), (10, -0.03), (11, -0.022), (12, -0.002), (13, -0.019), (14, -0.032), (15, 0.034), (16, 0.026), (17, -0.048), (18, 0.013), (19, 0.002), (20, 0.004), (21, 0.024), (22, -0.02), (23, -0.008), (24, -0.033), (25, -0.031), (26, 0.028), (27, -0.021), (28, 0.036), (29, 0.035), (30, -0.016), (31, -0.052), (32, 0.029), (33, 0.029), (34, 0.001), (35, 0.057), (36, 0.006), (37, 0.008), (38, 0.006), (39, 0.01), (40, 0.045), (41, -0.04), (42, -0.02), (43, -0.015), (44, -0.003), (45, 0.037), (46, 0.014), (47, -0.044), (48, 0.003), (49, -0.001)]
simIndex simValue blogId blogTitle
same-blog 1 0.94547427 714 andrew gelman stats-2011-05-16-NYT Labs releases Openpaths, a utility for saving your iphone data
Introduction: Jake Porway writes: We launched Openpaths the other week. It’s a site where people can privately upload and view their iPhone location data (at least until an Apple update wipes it out) and also download their data for their own use. More than just giving people a neat tool to view their data with, however, we’re also creating an option for them to donate their data to research projects at varying levels of anonymity. We’re still working out the terms for that, but we’d love any input and to get in touch with anyone who might want to use the data. I don’t have any use for this personally but maybe it will interest some of you. From the webpage: Openpaths is an anonymous, user-contributed database for the personal location data files recorded by iOS devices. Users securely store, explore, and manage their personal location data, and grant researchers access to portions of that data as they choose. All location data stored in openpaths is kept separate from user profi
2 0.83124101 1853 andrew gelman stats-2013-05-12-OpenData Latinoamerica
Introduction: Miguel Paz writes : Poderomedia Foundation and PinLatam are launching OpenDataLatinoamerica.org, a regional data repository to free data and use it on Hackathons and other activities by HacksHackers chapters and other organizations. We are doing this because the road to the future of news has been littered with lost datasets. A day or so after every hackathon and meeting where a group has come together to analyze, compare and understand a particular set of data, someone tries to remember where the successful files were stored. Too often, no one is certain. Therefore with Mariano Blejman we realized that we need a central repository where you can share the data that you have proved to be reliable: OpenData Latinoamerica, which we are leading as ICFJ Knight International Journalism Fellows. If you work in Latin America or Central America your organization can take part in OpenDataLatinoamerica.org. To apply, go to the website and answer a simple form agreeing to meet the standard
3 0.79786712 1175 andrew gelman stats-2012-02-19-Factual – a new place to find data
Introduction: Factual collects data on a variety of topics, organizes them, and allows easy access. If you ever wanted to do a histogram of calorie content in Starbucks coffees or plot warnings with a live feed of earthquake data – your life should be a bit simpler now. Also see DataMarket , InfoChimps , and a few older links in The Future of Data Analysis . If you access the data through the API, you can build live visualizations like this: Of course, you could just go to the source. Roy Mendelssohn writes (with minor edits): Since you are both interested in data access, please look at our service ERDDAP: http://coastwatch.pfel.noaa.gov/erddap/index.html http://upwell.pfeg.noaa.gov/erddap/index.html Please do not be fooled by the web pages. Everything is a service (including search and graphics) and the URL completely defines the request, and response formats are easily changed just by changing the “file extension”. The web pages are just html and javascript that u
4 0.79095668 211 andrew gelman stats-2010-08-17-Deducer update
Introduction: A year ago we blogged about Ian Fellows’s R Gui called Deducer (oops, my bad, I meant to link to this ). Fellows sends in this update: Since version 0.1, I [Fellows] have added: 1. A nice plug-in interface, so that people can extend Deducer’s capability without leaving the comfort of R. (see: http://www.deducer.org/pmwiki/pmwiki.php?n=Main.Development ) 2. Several new dialogs. 3. A one-step installer for windows. 4. A plug-in package (DeducerExtras) which extends the scope of analyses covered. 5. A plotting GUI that can create anything from simple histograms to complex custom graphics. Deducer is designed to be a free easy to use alternative to proprietary data analysis software such as SPSS, JMP, and Minitab. It has a menu system to do common data manipulation and analysis tasks, and an excel-like spreadsheet in which to view and edit data frames. The goal of the project is two fold. Provide an intuitive interface so that non-technical users can learn and p
5 0.7902391 192 andrew gelman stats-2010-08-08-Turning pages into data
Introduction: There is a lot of data on the web, meant to be looked at by people, but how do you turn it into a spreadsheet people could actually analyze statistically? The technique to turn web pages intended for people into structured data sets intended for computers is called “screen scraping.” It has just been made easier with a wiki/community http://scraperwiki.com/ . They provide libraries to extract information from PDF, Excel files, to automatically fill in forms and similar. Moreover, the community aspect of it should allow researchers doing similar things to get connected. It’s very good. Here’s an example of scraping road accident data or port of London ship arrivals . You can already find collections of structured data online, examples are Infochimps (“find the world’s data”), and Freebase (“An entity graph of people, places and things, built by a community that loves open data.”). There’s also a repository system for data, TheData (“An open-source application for pub
6 0.78656185 275 andrew gelman stats-2010-09-14-Data visualization at the American Evaluation Association
7 0.7747131 1990 andrew gelman stats-2013-08-20-Job opening at an organization that promotes reproducible research!
9 0.74302322 951 andrew gelman stats-2011-10-11-Data mining efforts for Obama’s campaign
10 0.74135852 2016 andrew gelman stats-2013-09-11-Zipfian Academy, A School for Data Science
12 0.73637694 1434 andrew gelman stats-2012-07-29-FindTheData.org
13 0.73350477 946 andrew gelman stats-2011-10-07-Analysis of Power Law of Participation
14 0.73201656 1711 andrew gelman stats-2013-02-07-How Open Should Academic Papers Be?
15 0.72564965 1014 andrew gelman stats-2011-11-16-Visualizations of NYPD stop-and-frisk data
16 0.7245993 1920 andrew gelman stats-2013-06-30-“Non-statistical” statistics tools
18 0.70733243 1837 andrew gelman stats-2013-05-03-NYC Data Skeptics Meetup
19 0.70700055 465 andrew gelman stats-2010-12-13-$3M health care prediction challenge
20 0.70563984 2307 andrew gelman stats-2014-04-27-Big Data…Big Deal? Maybe, if Used with Caution.
topicId topicWeight
[(2, 0.021), (8, 0.011), (9, 0.032), (14, 0.019), (15, 0.041), (16, 0.045), (24, 0.088), (28, 0.019), (30, 0.036), (45, 0.028), (59, 0.011), (61, 0.206), (65, 0.056), (68, 0.01), (89, 0.011), (90, 0.011), (92, 0.01), (95, 0.033), (99, 0.175)]
simIndex simValue blogId blogTitle
1 0.9074204 1558 andrew gelman stats-2012-11-02-Not so fast on levees and seawalls for NY harbor?
Introduction: I was talking with June Williamson and mentioned offhand that I’d seen something in the paper saying that if only we’d invested a few billion dollars in levees we would’ve saved zillions in economic damage from the flood. (A quick search also revealed this eerily prescient article from last month and, more recently, this online discussion.) June said, No, no, no: levees are not the way to go: Here and here are the articles on “soft infrastructure” for the New York-New Jersey Harbor I was mentioning, summarizing work that is more extensively published in two books, “Rising Currents” and “On the Water: Palisade Bay”: The hazards posed by climate change, sea level rise, and severe storm surges make this the time to transform our coastal cities through adaptive design. The conventional response to flooding, in recent history, has been hard engineering — fortifying the coastal infrastructure with seawalls and bulkheads to protect real estate at the expense of natural t
same-blog 2 0.86600482 714 andrew gelman stats-2011-05-16-NYT Labs releases Openpaths, a utility for saving your iphone data
Introduction: Jake Porway writes: We launched Openpaths the other week. It’s a site where people can privately upload and view their iPhone location data (at least until an Apple update wipes it out) and also download their data for their own use. More than just giving people a neat tool to view their data with, however, we’re also creating an option for them to donate their data to research projects at varying levels of anonymity. We’re still working out the terms for that, but we’d love any input and to get in touch with anyone who might want to use the data. I don’t have any use for this personally but maybe it will interest some of you. From the webpage: Openpaths is an anonymous, user-contributed database for the personal location data files recorded by iOS devices. Users securely store, explore, and manage their personal location data, and grant researchers access to portions of that data as they choose. All location data stored in openpaths is kept separate from user profi
3 0.86323911 1028 andrew gelman stats-2011-11-26-Tenure lets you handle students who cheat
Introduction: The other day, a friend of mine who is an untenured professor (not in statistics or political science) was telling me about a class where many of the students seemed to be resubmitting papers that they had already written for previous classes. (The supposition was based on internal evidence of the topics of the submitted papers.) It would be possible to check this and then kick the cheating students out of the program—but why do it? It would be a lot of work, also some of the students who are caught might complain, then word would get around that my friend is a troublemaker. And nobody likes a troublemaker. Once my friend has tenure it would be possible to do the right thing. But . . . here’s the hitch: most college instructors do not have tenure, and one result, I suspect, is a decline in ethical standards. This is something I hadn’t thought of in our earlier discussion of job security for teachers: tenure gives you the freedom to kick out cheating students.
4 0.85590106 16 andrew gelman stats-2010-05-04-Burgess on Kipling
Introduction: This is my last entry derived from Anthony Burgess’s book reviews , and it’ll be short. His review of Angus Wilson’s “The Strange Ride of Rudyard Kipling: His Life and Works” is a wonderfully balanced little thing. Nothing incredibly deep–like most items in the collection, the review is only two pages long–but I give it credit for being a rare piece of Kipling criticism I’ve seen that (a) seriously engages with the politics, without (b) congratulating itself on bravely going against the fashions of the politically incorrect chattering classes by celebrating Kipling’s magnificent achievement blah blah blah. Instead, Burgess shows respect for Kipling’s work and puts it in historical, biographical, and literary context. Burgess concludes that Wilson’s book “reminds us, in John Gross’s words, that Kipling ‘remains a haunting, unsettling presence, with whom we still have to come to terms.’ Still.” Well put, and generous of Burgess to end his review with another’s quote. Other cri
Introduction: Commenter Rahul asked what I thought of this note by Scott Firestone ( link from Tyler Cowen) criticizing a recent discussion by Kevin Drum suggesting that lead exposure causes violent crime. Firestone writes: It turns out there was in fact a prospective study done—but its implications for Drum’s argument are mixed. The study was a cohort study done by researchers at the University of Cincinnati. Between 1979 and 1984, 376 infants were recruited. Their parents consented to have lead levels in their blood tested over time; this was matched with records over subsequent decades of the individuals’ arrest records, and specifically arrest for violent crime. Ultimately, some of these individuals were dropped from the study; by the end, 250 were selected for the results. The researchers found that for each increase of 5 micrograms of lead per deciliter of blood, there was a higher risk for being arrested for a violent crime, but a further look at the numbers shows a more mixe
6 0.82904148 1975 andrew gelman stats-2013-08-09-Understanding predictive information criteria for Bayesian models
7 0.82508743 1370 andrew gelman stats-2012-06-07-Duncan Watts and the Titanic
8 0.81844139 2349 andrew gelman stats-2014-05-26-WAIC and cross-validation in Stan!
9 0.81340206 9 andrew gelman stats-2010-04-28-But it all goes to pay for gas, car insurance, and tolls on the turnpike
10 0.80996341 1433 andrew gelman stats-2012-07-28-LOL without the CATS
11 0.80201364 21 andrew gelman stats-2010-05-07-Environmentally induced cancer “grossly underestimated”? Doubtful.
12 0.7713865 827 andrew gelman stats-2011-07-28-Amusing case of self-defeating science writing
13 0.76762319 696 andrew gelman stats-2011-05-04-Whassup with glm()?
14 0.76215744 561 andrew gelman stats-2011-02-06-Poverty, educational performance – and can be done about it
15 0.75908267 1714 andrew gelman stats-2013-02-09-Partial least squares path analysis
17 0.75073546 729 andrew gelman stats-2011-05-24-Deviance as a difference
18 0.74965638 1739 andrew gelman stats-2013-02-26-An AI can build and try out statistical models using an open-ended generative grammar
19 0.74549198 776 andrew gelman stats-2011-06-22-Deviance, DIC, AIC, cross-validation, etc
20 0.73359823 2134 andrew gelman stats-2013-12-14-Oswald evidence