nips nips2006 nips2006-82 nips2006-82-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Risi Kondor, Tony Jebara
Abstract: We propose a new method for constructing hyperkenels and define two promising special cases that can be computed in closed form. These we call the Gaussian and Wishart hyperkernels. The former is especially attractive in that it has an interpretable regularization scheme reminiscent of that of the Gaussian RBF kernel. We discuss how kernel learning can be used not just for improving the performance of classification and regression methods, but also as a stand-alone algorithm for dimensionality reduction and relational or metric learning. 1
[1] N. Cristianini, J. Shawe-Taylor, A. Elisseeff, and J. Kandola. On kernel-target alignment. In T. G. Dietterich, S. Becker, and Z. Ghahramani, editors, Advances in Neural Information Processing Systems 14, pages 367 – 373, Cambridge, MA, 2002. MIT Press.
[2] G. S. Kimeldorf and G. Wahba. Some results on Tchebycheffian spline functions. J. Math. Anal. Applic., 33:82–95, 1971.
[3] R. Kondor and T. Jebara. A kernel between sets of vectors. In Machine Learning: Tenth International Conference, ICML 2003, 2003.
[4] R. Kondor and J. Lafferty. Diffusion kernels on graphs and other discrete input spaces. In Machine Learning: Proceedings of the Nineteenth International Conference (ICML ’02), 2002.
[5] G. Lanckriet, N. Cristianini, P. Bartlett, L. El Ghaoui, and M. I. Jordan. Learning the kernel matrix with semi-definite programming. Journal of Machine Learning Research, 5:27 – 72, 2004.
[6] T. P. Minka. Inferring a Gaussian distribution, 2001. http://www.stat.cmu.edu/ minka/papers/learning.html. Tutorial paper available at
[7] C. S. Ong and A. J. Smola. Machine learning using hyperkernels. In Proceedings of the International Conference on Machine Learning, 2003.
[8] Cheng Soon Ong, Alexander J. Smola, and Robert C. Williamson. Hyperkernels. In S. Thrun S. Becker and K. Obermayer, editors, Advances in Neural Information Processing Systems 15, pages 478–485. MIT Press, Cambridge, MA, 2003.
[9] Cheng Soon Ong, Alexander J. Smola, and Robert C. Williamson. Learning the kernel with hyperkernels. Sumbitted to the Journal of Machine Learning Research, 2003.
[10] B. Sch¨lkopf and A. J. Smola. Learning with Kernels. MIT Press, 2002. o