nips nips2003 nips2003-193 nips2003-193-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Manfred Opper, Ole Winther
Abstract: A general linear response method for deriving improved estimates of correlations in the variational Bayes framework is presented. Three applications are given and it is discussed how to use linear response as a general principle for improving mean field approximations.
[1] M. Opper and D. Saad, Advanced Mean Field Methods: Theory and Practice, MIT Press, 2001.
[2] H. Attias, “A variational Bayesian framework for graphical models,” in Advances in Neural Information Processing Systems 12, T. Leen et al., Ed. 2000, MIT Press, Cambridge.
[3] J. W. Miskin and D. J. C. MacKay, “Ensemble learning for blind image separation and deconvolution,” in Advances in Independent Component Analysis, M Girolami, Ed. 2000, SpringerVerlag Scientific Publishers.
[4] Z. Ghahramani and M. J. Beal, “Propagation algorithms for variational Bayesian learning,” in Advances in Neural Information Processing Systems 13. 2001, pp. 507–513, MIT Press, Cambridge.
[5] C. M. Bishop, D. Spiegelhalter, and J. Winn, “VIBES: A variational inference engine for Bayesian networks,” in Advances in Neural Information Processing Systems 15, 2002.
[6] C. M. Bishop and J. Winn, “Structured variational distributions in VIBES,” in Artificial Intelligence and Statistics, Key West, Florida, 2003.
[7] D. J. C. MacKay, Information Theory, Inference, and Learning Algorithms, Cambridge University Press, 2003.
[8] G. Parisi, Statistical Field Theory, Addison-Wesley, 1988.
[9] H.J. Kappen and F.B. Rodr´guez, “Efficient learning in Boltzmann machines using ’ linear ı response theory,” Neural Computation, vol. 10, pp. 1137–1156, 1998.
[10] P. A.d.F.R. Hojen-Sorensen, O. Winther, and L. K. Hansen, “Mean field approaches to independent component analysis,” Neural Computation, vol. 14, pp. 889–918, 2002.
[11] M. Opper and O. Winther, “Adaptive and self-averaging Thouless-Anderson-Palmer mean field theory for probabilistic modeling,” Physical Review E, vol. 64, pp. 056131, 2001.
[12] M. Welling and Y. W. Teh, “Linear response algorithms for approximate inference,” Artificial Intelligence Journal, 2003.
[13] M. Welling and Y. W. Teh, “Propagation rules for linear response estimates of joint pairwise probabilities,” preprint, 2003.