jmlr jmlr2006 jmlr2006-93 jmlr2006-93-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Charles A. Micchelli, Yuesheng Xu, Haizhang Zhang
Abstract: In this paper we investigate conditions on the features of a continuous kernel so that it may approximate an arbitrary continuous target function uniformly on any compact subset of the input space. A number of concrete examples are given of kernels with this universal approximating property. Keywords: density, translation invariant kernels, radial kernels
A. Argyriou, C. A. Micchelli and M. Pontil. Learning convex combinations of continuously parameterized basic kernels. Proceeding of the 18th Annual Conference on Learning Theory (COLT’05), Bertinoro, Italy, 2005. A. Argyriou, R. Hauser, C. A. Micchelli and M. Pontil. A DC-programming algorithm for kernel selection. Proceeding of the 23rd International Conference on Machine Learning (ICML’06), forthcoming (see also Research Note RN/06/04, Department of Computer Science, UCL, 2006). N. Aronszajn. Theory of reproducing kernels. Trans. Amer. Math. Soc., 68: 337–404, 1950. F. R. Bach, G. R. G. Lanckriet and M. I. Jordan. Multiple kernel learning, conic duality and the SMO algorithm. Proceeding of the 21st International Conference on Machine learning (ICML’04), 2004. A. Beurling and P. Malliavin. On the closure of characters and the zeros of entire functions. Acta. Math., 118: 79–93, 1967. C. M. Bishop. Neural Networks for Pattern Recognition. Clarendon Press, Oxford, 1995. 2665 M ICCHELLI , X U AND Z HANG S. Bochner. Lectures on Fourier Integrals With an author’s supplement on monotonic functions, Stieltjes integrals, and harmonic analysis. Annals of Mathematics Studies, no. 42, Princeton University Press, New Jersey, 1959. T. Evgeniou, M. Pontil and T. Poggio. Regularization networks and support vector machines. Adv. Comput. Math., 13: 1–50, 2000. C. H. FitzGerald, C. A. Micchelli and A. Pinkus. Functions that preserve families of positive semidefinite matrices. Linear Algebra Appl., 221: 83–102, 1995. T. Hastie, R. Tibshirani and J. Friedman. The Elements of Statistical Learning. Springer, New York, 2001. G. R. G. Lanckriet, N. Cristianini, P. Bartlett, L. El-Ghaoui and M. I. Jordan. Learning the kernel matrix with semi-definite programming. Journal of Machine Learning Research, 5: 27–72, 2004. P. Lax. Functional Analysis. Wiley, New York, 2002. J. Mercer. Functions of positive and negative type and their connection with the theory of integral equations. Philos. Trans. Royal Soc. London, 209: 415–446, 1909. C. A. Micchelli and M. Pontil. A function representation for learning in Banach spaces. Proceeding of the 17th Annual Conference on Learning (COLT’04), 2004. C. A. Micchelli and M. Pontil. Feature space perspectives for learning the kernel. Machine Learning, forthcoming (see also: Research Note RN/05/11, Department of Computer Science, UCL, June, 2005). C. A. Micchelli, M. Pontil, Q. Wu and D. X. Zhou. Error bounds for learning the kernel. Research Note RN/05/04, Department of Computer Science, UCL, 2006. C. A. Micchelli, Y. Xu and P. Ye. Cucker Smale learning theory in Besov spaces. Advances in Learning Theory: Methods, Models and Applications. J. Suykens, G. Horvath, S. Basu, C. A. Micchelli and J. Vandewalle, editors. IOS Press, Amsterdam, The Netherlands, 2003, 47–68. J. Neumann, C. Schn¨ rr and G. Steidl. SVM-based feature selection by direct objective minimizao ¨ tion. C.E. Rasmussen, H. H. Bulthoff, B. Sch¨ lkopf and M. A. Giese, editors. Lecture Notes in o Computer Science, 3175: 212–219, Proceeding of the 26th DAGM Symposium, 2004. C. S. Ong, A. J. Smola and R. C. Williamson. Learning the kernel with hyperkernels. Journal of Machine Learning Research, 6: 1043–1071, 2005. T. Poggio, S. Mukherjee, R. Rifkin, A. Raklin and A. Verri. B. Uncertainty in geometric computations, J. Winkler and M. Niranjan, editors. Kluwer Academic Publishers, 22: 131–141, 2002. R. M. Redheffer. Completeness of sets of complex exponentials. Adv. Math., 24: 1–62, 1977. T. J. Rivlin. Chebyshev Polynomials. 2nd Edition, John Wiley, New York, 1990. H. Royden. Real Analysis. 3rd Edition, Macmillan Publishing Company, New York, 1988. 2666 U NIVERSAL K ERNELS W. Rudin. Functional Analysis. 2nd Edition, McGraw Hill, New York, 1991. I. J. Schoenberg. Metric spaces and completely monotone functions. Ann. of Math. (2), 39: 811–841, 1938. I. J. Schoenberg. Positive definite functions on spheres. Duke. Math. J., 9: 96–108, 1942. B. Sch¨ lkopf, C. J. C. Burges and A. Smola. Advances in Kernel Methods: Support Vector Learning. o MIT Press, Cambridge, Mass, 1999. B. Sch¨ lkopf and A. Smola. Learning with Kernels. MIT Press, Cambridge, Mass, 2002. o J. Shawe-Taylor and N. Cristianini. Kernel Methods for Pattern Analysis. Cambridge University Press, Cambridge, 2004. S. Sonnenburg, G. R¨ tsch and C. Sch¨ fer. A general and efficient multiple kernel learning algorithm. a a Y. Weiss, B. Sch¨ lkopf and J. Platt, editors. Advances in Neural Information Processing Systems, o 18. MIT Press, Cambridge, Mass, 2006. E. M. Stein and G. Weiss. Introduction to Fourier Analysis on Euclidean Spaces. Princeton University Press, New Jersey, 1971. I. Steinwart. On the influence of kernel on the consistency of support vector machines. Journal of Machine Learning Research, 2: 67–93, 2001. H. Sun. Mercer theorem for RKHS on noncompact sets. J. Complexity, 21: 337–349, 2005. G. Szeg¨ . Orthogonal Polynomials. American Mathematical Society Colloquium Publications 23. o Revised Edition, Providence, RI, 1959. G. Wahba. Splines Models for Observational Data. Series in Applied Mathematics 59. SIAM, Philadelphia, 1990. D. X. Zhou. Density problem and approximation error in learning theory. preprint, 2003. 2667