nips nips2001 nips2001-58 nips2001-58-reference knowledge-graph by maker-knowledge-mining

58 nips-2001-Covariance Kernels from Bayesian Generative Models


Source: pdf

Author: Matthias Seeger

Abstract: We propose the framework of mutual information kernels for learning covariance kernels, as used in Support Vector machines and Gaussian process classifiers, from unlabeled task data using Bayesian techniques. We describe an implementation of this framework which uses variational Bayesian mixtures of factor analyzers in order to attack classification problems in high-dimensional spaces where labeled data is sparse, but unlabeled data is abundant. 1


reference text

[1] Avrim Blum and Tom Mitchell. Combining labeled and unlabeled data with CoTraining. In Proceedings of COLT, 1998.

[2] Z. Ghahramani and M. Beal. Variational inference for Bayesian mixtures of factor analysers. In Advances in NIPS 12. MIT Press, 1999.

[3] David Haussler. Convolution kernels on discrete structures. Technical Report UCSCCRL-99-10 , University of California, Santa Cruz, July 1999.

[4] Tommi S. Jaakkola and David Haussler. Exploiting generative models in discriminative classifiers. In Advances in N eural Information Processing Systems 11, 1998.

[5] Matthias Seeger. Covariance kernels from Bayesian generative models. Technical report , 2000. Available at http : //yyy . dai . ed. ac . ukr seeger /papers . html.

[6] Matthias Seeger. Learning with labeled and unlabeled data. Technical report, 2000. Available at http://yyy .dai. ed. ac. ukrseeger/papers .html.

[7] Martin Szummer and Tommi Jaakkola. Partially labeled classification with Markov random walks. In Advances in NIPS 14. MIT Press, 200l.

[8] Koji Tsuda, Motoaki Kawanabe, Gunnar Ratsch, Soeren Sonnenburg, and KlausRobert Muller. A new discriminative kernel from probabilistic models . In Advances in NIPS 14. MIT Press, 200l.

[9] Chris Watkins. Dynamic alignment kernels. Technical Report CSD-TR-98-11 , Royal Holloway, University of London, 1999.

[10] Christopher K.1. Williams and David Barber. Bayesian classification with Gaussian processes. IEEE Trans. PAMI, 20(12):1342- 1351, 1998.

[11] Peter Yianilos. Metric learning via normal mixtures. Technical report , NEC Research , Princeton, 1995. 17The a parameter in this work is related to MTS in this case.