andrew_gelman_stats andrew_gelman_stats-2010 andrew_gelman_stats-2010-347 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Our “arm” package in R requires Doug Bates’s “lme4″ which fits multilevel models. lme4 is currently having some problems on the Mac. But installation on the Mac can be done; it just takes a bit of work. I have two sets of instructions below. From Yu-Sung: If you have MAC OS DVD, you should install developer X code packages from it. Otherwise, install them from here . After this, do the following in R: install.packages(“lme4″, type = “source”) Then you will have lme4 in R and you can install arm without a problem. And, from David Ozonoff: I installed the lme4 package via the Package Installer but this didn’t work, of course. I then installed, via this link , gfortran which seemed to put the libraries in the right place (I had earlier installed via Fink the gcc42 compiler, so I’m not sure if this is required or not). I then ran, in R, this: install.packages(c(“Matrix”,”lme4″), repos=”http://R-Forge.R-project.org”) This does not appear to work since it wi
sentIndex sentText sentNum sentScore
1 Our “arm” package in R requires Doug Bates’s “lme4″ which fits multilevel models. [sent-1, score-0.445]
2 lme4 is currently having some problems on the Mac. [sent-2, score-0.11]
3 But installation on the Mac can be done; it just takes a bit of work. [sent-3, score-0.203]
4 From Yu-Sung: If you have MAC OS DVD, you should install developer X code packages from it. [sent-5, score-0.631]
5 packages(“lme4″, type = “source”) Then you will have lme4 in R and you can install arm without a problem. [sent-8, score-0.586]
6 And, from David Ozonoff: I installed the lme4 package via the Package Installer but this didn’t work, of course. [sent-9, score-1.02]
7 I then installed, via this link , gfortran which seemed to put the libraries in the right place (I had earlier installed via Fink the gcc42 compiler, so I’m not sure if this is required or not). [sent-10, score-1.556]
8 org”) This does not appear to work since it will say lme4 is not available, but since I already installed it and it was just looking for the fortran link in the right place, everything worked, as did arm. [sent-14, score-1.31]
9 To give credit where credit is due, I found the solution here . [sent-15, score-0.369]
wordName wordTfidf (topN-words)
[('installed', 0.592), ('install', 0.35), ('package', 0.233), ('mac', 0.229), ('via', 0.195), ('arm', 0.173), ('credit', 0.151), ('installer', 0.148), ('bates', 0.148), ('installation', 0.14), ('os', 0.125), ('developer', 0.125), ('compiler', 0.125), ('fortran', 0.125), ('libraries', 0.119), ('place', 0.108), ('doug', 0.107), ('instructions', 0.106), ('link', 0.095), ('packages', 0.091), ('matrix', 0.088), ('since', 0.084), ('ran', 0.079), ('fits', 0.079), ('sets', 0.072), ('requires', 0.071), ('required', 0.071), ('source', 0.07), ('otherwise', 0.069), ('due', 0.069), ('currently', 0.069), ('right', 0.067), ('solution', 0.067), ('http', 0.067), ('code', 0.065), ('takes', 0.063), ('type', 0.063), ('appear', 0.062), ('multilevel', 0.062), ('worked', 0.06), ('available', 0.06), ('seemed', 0.058), ('earlier', 0.056), ('everything', 0.055), ('david', 0.054), ('work', 0.051), ('looking', 0.048), ('already', 0.047), ('done', 0.045), ('problems', 0.041)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000001 347 andrew gelman stats-2010-10-17-Getting arm and lme4 running on the Mac
Introduction: Our “arm” package in R requires Doug Bates’s “lme4″ which fits multilevel models. lme4 is currently having some problems on the Mac. But installation on the Mac can be done; it just takes a bit of work. I have two sets of instructions below. From Yu-Sung: If you have MAC OS DVD, you should install developer X code packages from it. Otherwise, install them from here . After this, do the following in R: install.packages(“lme4″, type = “source”) Then you will have lme4 in R and you can install arm without a problem. And, from David Ozonoff: I installed the lme4 package via the Package Installer but this didn’t work, of course. I then installed, via this link , gfortran which seemed to put the libraries in the right place (I had earlier installed via Fink the gcc42 compiler, so I’m not sure if this is required or not). I then ran, in R, this: install.packages(c(“Matrix”,”lme4″), repos=”http://R-Forge.R-project.org”) This does not appear to work since it wi
2 0.316688 198 andrew gelman stats-2010-08-11-Multilevel modeling in R on a Mac
Introduction: Peter Goff wrote: I’m using your text, Data Analysis Using Regression & Multilevel/Hierarchical Models as the basis for an independent study class this fall. I am fairly adapt with Stata, however I have no expertise in R (changing this condition is a goal of the independent study!). I’m working to get up and running with the examples from the book, but I’m running into several problems, all apparently stemming from my having a Mac as opposed to a PC. Specifically I cannot load the “arm” library because I cannot install the lme4 library as lme4 is not available for Macs. Yu-Sung replied: Here are steps for you to install lme4: 1. update your x11 code for Mac system (so that you have gcc and g77 complier) 2. download source code for lme4 from the CRAN. 3. install lme4 from the source you just downloaded. I am not a Mac user. I am adapting steps from installing lme4 in a linux OS. But we have colleagues here following the same instructions and make lme4 working on
3 0.23246872 975 andrew gelman stats-2011-10-27-Caffeine keeps your Mac awake
Introduction: Sometimes my computer goes blank when I’m giving a presentation and I haven’t clicked on anything for awhile. I mentioned this to Malecki and he installed Caffeine on my computer; problem solved.
4 0.17398512 1682 andrew gelman stats-2013-01-19-R package for Bayes factors
Introduction: Richard Morey writes: You and your blog readers may be interested to know that a we’ve released a major new version of the BayesFactor package to CRAN. The package computes Bayes factors for linear mixed models and regression models. Of course, I’m aware you don’t like point-null model comparisons, but the package does more than that; it also allows sampling from posterior distributions of the compared models, in much the same way that your arm package does with lmer objects. The sampling (both for the Bayes factors and posteriors) is quite fast, since the back end is written in C. Some basic examples using the package can be found here , and the CRAN page is here . Indeed I don’t like point-null model comparisons . . . but maybe this will be useful to some of you!
5 0.15257336 1134 andrew gelman stats-2012-01-21-Lessons learned from a recent R package submission
Introduction: R has zillions of packages, and people are submitting new ones each day . The volunteers who keep R going are doing an incredibly useful service to the profession, and they’re busy . A colleague sends in some suugestions based on a recent experience with a package update: 1. Always use the R dev version to write a package. Not the current stable release. The R people use the R dev version to check your package anyway. If you don’t use the R dev version, there is chance that your package won’t pass the check. In my own experience, every time R has a major change, it tends to have new standards and find new errors in your package with these new standards. So better use the dev version to find out the potential errors in advance. 2. After submission, write an email to claim it. I used to submit the package to the CRAN without writing an email. This was standard operating procedure, but it has changed. Writing an email to claim about the submission is now a requir
6 0.11172132 867 andrew gelman stats-2011-08-23-The economics of the mac? A paradox of competition
7 0.10797872 535 andrew gelman stats-2011-01-24-Bleg: Automatic Differentiation for Log Prob Gradients?
8 0.088033475 2069 andrew gelman stats-2013-10-19-R package for effect size calculations for psychology researchers
9 0.085065871 1475 andrew gelman stats-2012-08-30-A Stan is Born
10 0.084412307 501 andrew gelman stats-2011-01-04-A new R package for fititng multilevel models
11 0.077652246 1907 andrew gelman stats-2013-06-20-Amazing retro gnu graphics!
12 0.076981224 25 andrew gelman stats-2010-05-10-Two great tastes that taste great together
13 0.075817809 2066 andrew gelman stats-2013-10-17-G+ hangout for test run of BDA course
14 0.074507274 1423 andrew gelman stats-2012-07-21-Optimizing software in C++
15 0.070375994 1710 andrew gelman stats-2013-02-06-The new Stan 1.1.1, featuring Gaussian processes!
16 0.066986129 953 andrew gelman stats-2011-10-11-Steve Jobs’s cancer and science-based medicine
17 0.063798703 2296 andrew gelman stats-2014-04-19-Index or indicator variables
18 0.063591473 681 andrew gelman stats-2011-04-26-Worst statistical graphic I have seen this year
19 0.063497342 1736 andrew gelman stats-2013-02-24-Rcpp class in Sat 9 Mar in NYC
20 0.062160853 481 andrew gelman stats-2010-12-22-The Jumpstart financial literacy survey and the different purposes of tests
topicId topicWeight
[(0, 0.077), (1, -0.001), (2, -0.005), (3, 0.012), (4, 0.068), (5, 0.036), (6, 0.015), (7, -0.067), (8, 0.011), (9, -0.028), (10, -0.006), (11, -0.031), (12, 0.013), (13, -0.005), (14, 0.011), (15, 0.015), (16, -0.018), (17, -0.007), (18, -0.024), (19, -0.022), (20, 0.01), (21, 0.009), (22, 0.017), (23, -0.002), (24, -0.03), (25, -0.006), (26, 0.011), (27, 0.02), (28, 0.043), (29, -0.006), (30, -0.012), (31, 0.018), (32, 0.037), (33, 0.003), (34, 0.043), (35, -0.019), (36, -0.051), (37, -0.005), (38, 0.01), (39, 0.03), (40, 0.009), (41, 0.02), (42, 0.022), (43, 0.004), (44, 0.004), (45, 0.037), (46, -0.05), (47, 0.068), (48, -0.01), (49, -0.047)]
simIndex simValue blogId blogTitle
same-blog 1 0.96922743 347 andrew gelman stats-2010-10-17-Getting arm and lme4 running on the Mac
Introduction: Our “arm” package in R requires Doug Bates’s “lme4″ which fits multilevel models. lme4 is currently having some problems on the Mac. But installation on the Mac can be done; it just takes a bit of work. I have two sets of instructions below. From Yu-Sung: If you have MAC OS DVD, you should install developer X code packages from it. Otherwise, install them from here . After this, do the following in R: install.packages(“lme4″, type = “source”) Then you will have lme4 in R and you can install arm without a problem. And, from David Ozonoff: I installed the lme4 package via the Package Installer but this didn’t work, of course. I then installed, via this link , gfortran which seemed to put the libraries in the right place (I had earlier installed via Fink the gcc42 compiler, so I’m not sure if this is required or not). I then ran, in R, this: install.packages(c(“Matrix”,”lme4″), repos=”http://R-Forge.R-project.org”) This does not appear to work since it wi
2 0.74318975 198 andrew gelman stats-2010-08-11-Multilevel modeling in R on a Mac
Introduction: Peter Goff wrote: I’m using your text, Data Analysis Using Regression & Multilevel/Hierarchical Models as the basis for an independent study class this fall. I am fairly adapt with Stata, however I have no expertise in R (changing this condition is a goal of the independent study!). I’m working to get up and running with the examples from the book, but I’m running into several problems, all apparently stemming from my having a Mac as opposed to a PC. Specifically I cannot load the “arm” library because I cannot install the lme4 library as lme4 is not available for Macs. Yu-Sung replied: Here are steps for you to install lme4: 1. update your x11 code for Mac system (so that you have gcc and g77 complier) 2. download source code for lme4 from the CRAN. 3. install lme4 from the source you just downloaded. I am not a Mac user. I am adapting steps from installing lme4 in a linux OS. But we have colleagues here following the same instructions and make lme4 working on
3 0.66259265 1134 andrew gelman stats-2012-01-21-Lessons learned from a recent R package submission
Introduction: R has zillions of packages, and people are submitting new ones each day . The volunteers who keep R going are doing an incredibly useful service to the profession, and they’re busy . A colleague sends in some suugestions based on a recent experience with a package update: 1. Always use the R dev version to write a package. Not the current stable release. The R people use the R dev version to check your package anyway. If you don’t use the R dev version, there is chance that your package won’t pass the check. In my own experience, every time R has a major change, it tends to have new standards and find new errors in your package with these new standards. So better use the dev version to find out the potential errors in advance. 2. After submission, write an email to claim it. I used to submit the package to the CRAN without writing an email. This was standard operating procedure, but it has changed. Writing an email to claim about the submission is now a requir
4 0.63050878 535 andrew gelman stats-2011-01-24-Bleg: Automatic Differentiation for Log Prob Gradients?
Introduction: We need help picking out an automatic differentiation package for Hamiltonian Monte Carlo sampling from the posterior of a generalized linear model with deep interactions. Specifically, we need to compute gradients for log probability functions with thousands of parameters that involve matrix (determinants, eigenvalues, inverses), stats (distributions), and math (log gamma) functions. Any suggestions? The Application: Hybrid Monte Carlo for Posteriors We’re getting serious about implementing posterior sampling using Hamiltonian Monte Carlo. HMC speeds up mixing by including gradient information to help guide the Metropolis proposals toward areas high probability. In practice, the algorithm requires a handful or of gradient calculations per sample, but there are many dimensions and the functions are hairy enough we don’t want to compute derivaties by hand. Auto Diff: Perhaps not What you Think It may not have been clear to readers of this blog that automatic diffe
5 0.61454052 1907 andrew gelman stats-2013-06-20-Amazing retro gnu graphics!
Introduction: Bill Harris writes: Speaking of strange graphics, http://makingsense.facilitatedsystems.com/2007/03/making-musical-sense-by-email-part-2.html shows an example of text (gnuplot’s dumb terminal) graphics of data from MCSim (code and other material available from http://makingsense.facilitatedsystems.com/2007/03/making-musical-sense-by-email-table-of.html). At another extreme, slide 20 of https://docs.google.com/viewer?a=v&pid;=sites&srcid;=ZGVmYXVsdGRvbWFpbnx3c2hhcnJpczEzfGd4OjZkNGFjZWZhOTAyYTFkMDg shows a stereogram of more MCSim output (I was a bit more naive back then). I included the stereogram as a bit of humor just to show what could be done with J graphics. Surprisingly, one person in the audience focused intently on that slide and, after a moment, said “Got it!” We spoke afterwards, and it turned out that he was on the board or at least a volunteer at the Portland (OR) 3D Center of Art & Photography (http://www.3dcenterusa.com/index.html). Regarding mcsim, the
6 0.60261387 1682 andrew gelman stats-2013-01-19-R package for Bayes factors
7 0.59415156 1799 andrew gelman stats-2013-04-12-Stan 1.3.0 and RStan 1.3.0 Ready for Action
8 0.58812523 1716 andrew gelman stats-2013-02-09-iPython Notebook
9 0.58745468 667 andrew gelman stats-2011-04-19-Free $5 gift certificate!
10 0.58248097 612 andrew gelman stats-2011-03-14-Uh-oh
11 0.578812 290 andrew gelman stats-2010-09-22-Data Thief
12 0.57741308 869 andrew gelman stats-2011-08-24-Mister P in Stata
13 0.57163614 1710 andrew gelman stats-2013-02-06-The new Stan 1.1.1, featuring Gaussian processes!
14 0.57042843 2066 andrew gelman stats-2013-10-17-G+ hangout for test run of BDA course
15 0.56985158 555 andrew gelman stats-2011-02-04-Handy Matrix Cheat Sheet, with Gradients
16 0.56577229 501 andrew gelman stats-2011-01-04-A new R package for fititng multilevel models
17 0.55986345 2089 andrew gelman stats-2013-11-04-Shlemiel the Software Developer and Unknown Unknowns
18 0.55710119 1318 andrew gelman stats-2012-05-13-Stolen jokes
19 0.55592144 1871 andrew gelman stats-2013-05-27-Annals of spam
20 0.55414337 154 andrew gelman stats-2010-07-18-Predictive checks for hierarchical models
topicId topicWeight
[(9, 0.017), (16, 0.056), (24, 0.106), (27, 0.321), (31, 0.027), (69, 0.035), (73, 0.019), (82, 0.031), (86, 0.086), (99, 0.169)]
simIndex simValue blogId blogTitle
1 0.9161154 1490 andrew gelman stats-2012-09-09-I’m still wondering . . .
Introduction: Why can’t I buy train and plane tickets through Amazon? That would be so much more convenient than the current system where I have to keep entering information into the damn forms over and over again.
same-blog 2 0.88713121 347 andrew gelman stats-2010-10-17-Getting arm and lme4 running on the Mac
Introduction: Our “arm” package in R requires Doug Bates’s “lme4″ which fits multilevel models. lme4 is currently having some problems on the Mac. But installation on the Mac can be done; it just takes a bit of work. I have two sets of instructions below. From Yu-Sung: If you have MAC OS DVD, you should install developer X code packages from it. Otherwise, install them from here . After this, do the following in R: install.packages(“lme4″, type = “source”) Then you will have lme4 in R and you can install arm without a problem. And, from David Ozonoff: I installed the lme4 package via the Package Installer but this didn’t work, of course. I then installed, via this link , gfortran which seemed to put the libraries in the right place (I had earlier installed via Fink the gcc42 compiler, so I’m not sure if this is required or not). I then ran, in R, this: install.packages(c(“Matrix”,”lme4″), repos=”http://R-Forge.R-project.org”) This does not appear to work since it wi
3 0.86434454 802 andrew gelman stats-2011-07-13-Super Sam Fuld Needs Your Help (with Foul Ball stats)
Introduction: I was pleasantly surprised to have my recreational reading about baseball in the New Yorker interrupted by a digression on statistics. Sam Fuld of the Tampa Bay Rays, was the subjet of a Ben McGrath profile in the 4 July 2011 issue of the New Yorker , in an article titled Super Sam . After quoting a minor-league trainer who described Fuld as “a bit of a geek” (who isn’t these days?), McGrath gets into that lovely New Yorker detail: One could have pointed out the more persuasive and telling examples, such as the fact that in 2005, after his first pro season, with the Class-A Peoria Chiefs, Fuld applied for a fall internship with Stats, Inc., the research firm that supplies broadcasters with much of the data anad analysis that you hear in sports telecasts. After a description of what they had him doing, reviewing footage of games and cataloguing, he said “I thought, They have a stat for everything, but they don’t have any stats regarding foul balls.” Fuld’s
Introduction: Someone passed on to a message from his university library announcing that the journal “Wiley Interdisciplinary Reviews: Computational Statistics” is no longer free. Librarians have to decide what to do, so I thought I’d offer the following consumer guide: Wiley Computational Statistics journal Wikipedia Frequency 6 issues per year Continuously updated Includes articles from Wikipedia? Yes Yes Cites the Wikipedia sources it uses? No Yes Edited by recipient of ASA Founders Award? Yes No Articles are subject to rigorous review? No Yes Errors, when discovered, get fixed? No Yes Number of vertices in n-dimensional hypercube? 2n 2 n Easy access to Brady Bunch trivia? No Yes Cost (North America) $1400-$2800 $0 Cost (UK) £986-£1972 £0 Cost (Europe) €1213-€2426 €0 The choice seems pretty clear to me! It’s funny for the Wiley journal to start charging now
5 0.76549882 134 andrew gelman stats-2010-07-08-“What do you think about curved lines connecting discrete data-points?”
Introduction: John Keltz writes: What do you think about curved lines connecting discrete data-points? (For example, here .) The problem with the smoothed graph is it seems to imply that something is going on in between the discrete data points, which is false. However, the straight-line version isn’t representing actual events either- it is just helping the eye connect each point. So maybe the curved version is also just helping the eye connect each point, and looks better doing it. In my own work (value-added modeling of achievement test scores) I use straight lines, but I guess I am not too bothered when people use smoothing. I’d appreciate your input. Regular readers will be unsurprised that, yes, I have an opinion on this one, and that this opinion is connected to some more general ideas about statistical graphics. In general I’m not a fan of the curved lines. They’re ok, but I don’t really see the point. I can connect the dots just fine without the curves. The more general id
6 0.75195324 1727 andrew gelman stats-2013-02-19-Beef with data
7 0.73390615 1472 andrew gelman stats-2012-08-28-Migrating from dot to underscore
8 0.73318267 465 andrew gelman stats-2010-12-13-$3M health care prediction challenge
9 0.72663724 343 andrew gelman stats-2010-10-15-?
10 0.72097927 173 andrew gelman stats-2010-07-31-Editing and clutch hitting
11 0.7121315 708 andrew gelman stats-2011-05-12-Improvement of 5 MPG: how many more auto deaths?
12 0.70765835 1255 andrew gelman stats-2012-04-10-Amtrak sucks
13 0.70209992 1113 andrew gelman stats-2012-01-11-Toshiro Kageyama on professionalism
14 0.68066418 1238 andrew gelman stats-2012-03-31-Dispute about ethics of data sharing
16 0.67705178 1869 andrew gelman stats-2013-05-24-In which I side with Neyman over Fisher
17 0.66042387 804 andrew gelman stats-2011-07-15-Static sensitivity analysis
18 0.65880537 1982 andrew gelman stats-2013-08-15-Blaming scientific fraud on the Kuhnians
19 0.64522606 2079 andrew gelman stats-2013-10-27-Uncompressing the concept of compressed sensing
20 0.64081597 341 andrew gelman stats-2010-10-14-Confusion about continuous probability densities