nips nips2006 nips2006-91 nips2006-91-reference knowledge-graph by maker-knowledge-mining

91 nips-2006-Hierarchical Dirichlet Processes with Random Effects


Source: pdf

Author: Seyoung Kim, Padhraic Smyth

Abstract: Data sets involving multiple groups with shared characteristics frequently arise in practice. In this paper we extend hierarchical Dirichlet processes to model such data. Each group is assumed to be generated from a template mixture model with group level variability in both the mixing proportions and the component parameters. Variabilities in mixing proportions across groups are handled using hierarchical Dirichlet processes, also allowing for automatic determination of the number of components. In addition, each group is allowed to have its own component parameters coming from a prior described by a template mixture model. This group-level variability in the component parameters is handled using a random effects model. We present a Markov Chain Monte Carlo (MCMC) sampling algorithm to estimate model parameters and demonstrate the method by applying it to the problem of modeling spatial brain activation patterns across multiple images collected via functional magnetic resonance imaging (fMRI). 1


reference text

Gelman, A., Carlin, J., Stern, H. & Rubin, D. (2004) Bayesian Data Analysis, New York: Chapman & Hall/CRC. Gelman, A. (2006). Prior distribution for variance parameters in hierarchical models. Bayesian Analysis, 1(3):515–533. Kim, S., Smyth, P., & Stern, H. (2006). A nonparametric Bayesian approach to detecting spatial activation patterns in fMRI data. Proceedings of the 9th International Conference on Medical Image Computing and Computer Assisted Intervention, vol. 2, pp.217–224. Neal, R.M. (1998) Markov chain sampling methods for Dirichlet process mixture models. Technical Report 4915, Department of Statistics, University of Toronto. Penny, W. & Friston, K. (2003) Mixtures of general linear models for functional neuroimaging. IEEE Transactions on Medical Imaging, 22(4):504–514. Rasmussen, C.E. (2000) The inÄ?Ĺš nite Gaussian mixture model. Advances in Neural Information Processing Systems 12, pp. 554–560. MIT Press. Rasmussen, C.E. & Ghahramani, Z. (2002) InÄ?Ĺš nite mixtures of Gaussian process experts. Advances in Neural Information Processing Systems 14, pp. 881–888. MIT Press. Sethuraman, J. (1994) A constructive deÄ?Ĺš nition of Dirichlet priors. Statistica Sinica, 4:639–650. Sudderth, E., Torralba, A., Freeman, W. & Willsky, A. (2005). Describing visual scenes using transformed Dirichlet Processes. Advances in Neural Information Processing Systems 18, pp. 1297–1304. MIT Press. Teh, Y.W., Jordan, M.I., Beal, M.J. & Blei, D.M. (2006). Hierarchical Dirichlet processes. Journal of American Statistical Association, To appear.