nips nips2011 nips2011-285 nips2011-285-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Lu Ren, Yingjian Wang, Lawrence Carin, David B. Dunson
Abstract: A new L´ vy process prior is proposed for an uncountable collection of covariatee dependent feature-learning measures; the model is called the kernel beta process (KBP). Available covariates are handled efficiently via the kernel construction, with covariates assumed observed with each data sample (“customer”), and latent covariates learned for each feature (“dish”). Each customer selects dishes from an infinite buffet, in a manner analogous to the beta process, with the added constraint that a customer first decides probabilistically whether to “consider” a dish, based on the distance in covariate space between the customer and dish. If a customer does consider a particular dish, that dish is then selected probabilistically as in the beta process. The beta process is recovered as a limiting case of the KBP. An efficient Gibbs sampler is developed for computations, and state-of-the-art results are presented for image processing and music analysis tasks. 1
[1] D. Applebaum. Levy Processes and Stochastic Calculus. Cambridge University Press, 2009.
[2] D. B. Dunson and J.-H. Park. Kernel stick-breaking processes. Biometrika, 95:307–323, 2008.
[3] T. Ferguson. A Bayesian analysis of some nonparametric problems. The Annals of Statistics, 1973.
[4] T. L. Griffiths and Z. Ghahramani. Infinite latent feature models and the Indian buffet process. In NIPS, 2005.
[5] N. L. Hjort. Nonparametric Bayes estimators based on beta processes in models for life history data. Annals of Statistics, 1990.
[6] J.F.C. Kingman. Poisson Processes. Oxford Press, 2002.
[7] D. Knowles and Z. Ghahramani. Infinite sparse factor analysis and infinite independent components analysis. In Independent Component Analysis and Signal Separation, 2007.
[8] S. N. MacEachern. Dependent Nonparametric Processes. In In Proceedings of the Section on Bayesian Statistical Science, 1999.
[9] K. Miller, T. Griffiths, and M. I. Jordan. The phylogenetic Indian buffet process: A non-exchangeable nonparametric prior for latent features. In UAI, 2008.
[10] C.E. Rasmussen and C. Williams. Gaussian Processes for Machine Learning. MIT Press, 2006.
[11] L. Ren, L. Du, L. Carin, and D. B. Dunson. Logistic stick-breaking process. J. Machine Learning Research, 2011.
[12] L. Ren, D. Dunson, S. Lindroth, and L. Carin. Dynamic nonparametric bayesian models for analysis of music. Journal of The American Statistical Association, 105:458–472, 2010.
[13] A. Rodriguez and D. B. Dunson. Nonparametric bayesian models through probit stickbreaking processes. Univ. California Santa Cruz Technical Report, 2009.
[14] J. Sethuraman. A constructive definition of dirichlet priors. 1994.
[15] R. Thibaux and M. I. Jordan. Hierarchical beta processes and the Indian buffet process. In AISTATS, 2007.
[16] S. Williamson, P. Orbanz, and Z. Ghahramani. Dependent Indian buffet processes. In AISTATS, 2010.
[17] M. Zhou, H. Chen, J. Paisley, L. Ren, G. Sapiro, and L. Carin. Non-parametric Bayesian dictionary learning for sparse image representations. In NIPS, 2009.
[18] M. Zhou, H. Yang, G. Sapiro, D. Dunson, and L. Carin. Dependent hierarchical beta process for image interpolation and denoising. In AISTATS, 2011. 9