nips nips2009 nips2009-140 nips2009-140-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Mikkel Schmidt
Abstract: We present a general Bayesian approach to probabilistic matrix factorization subject to linear constraints. The approach is based on a Gaussian observation model and Gaussian priors with bilinear equality and inequality constraints. We present an efficient Markov chain Monte Carlo inference procedure based on Gibbs sampling. Special cases of the proposed model are Bayesian formulations of nonnegative matrix factorization and factor analysis. The method is evaluated on a blind source separation problem. We demonstrate that our algorithm can be used to extract meaningful and interpretable features that are remarkably different from features extracted using existing related matrix factorization techniques.
[1] A. T. Cemgil. Bayesian inference for nonnegative matrix factorisation models. Computational Intelligence and Neuroscience, 2009. doi: 10.1155/2009/785152.
[2] J. Geweke. Efficient simulation from the multivariate normal and student-t distributions subject to linear constraints and the evaluation of constraint probabilities. In Computer Sciences and Statistics, Proceedings the 23rd Symposium on the Interface between, pages 571–578, 1991. doi: 10.1.1.26.6892.
[3] D. D. Lee and H. S. Seung. Learning the parts of objects by non-negative matrix factorization. Nature, pages 788–791, October 1999. doi: 10.1038/44565.
[4] S. Moussaoui, D. Brie, A. Mohammad-Djafari, and C. Carteret. Separation of non-negative mixture of non-negative sources using a Bayesian approach and MCMC sampling. Signal Processing, IEEE Transactions on, 54(11):4133–4145, Nov 2006. doi: 10.1109/TSP.2006.880310.
[5] R. M. Neal. Slice sampling. Annals of Statistics, 31(3):705–767, 2003.
[6] G. Rodriguez-Yam, R. Davis, and L. Scharf. Efficient gibbs sampling of truncated multivariate normal with application to constrained linear regression. Technical report, Colorado State University, Fort Collins, 2004.
[7] R. Salakhutdinov and A. Mnih. Probabilistic matrix factorization. In Neural Information Processing Systems, Advances in (NIPS), pages 1257–1264, 2008.
[8] R. Salakhutdinov and A. Mnih. Bayesian probabilistic matrix factorization using Markov chain Monte Carlo. In Machine Learning, International Conference on (ICML), pages 880–887, 2008.
[9] M. N. Schmidt, O. Winther, and L. K. Hansen. Bayesian non-negative matrix factorization. In Independent Component Analysis and Signal Separation, International Conference on, volume 5441 of Lecture Notes in Computer Science (LNCS), pages 540–547. Springer, 2009. doi: 10. 1007/978-3-642-00599-2 68. 9