jmlr jmlr2009 jmlr2009-80 jmlr2009-80-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Haizhang Zhang, Yuesheng Xu, Jun Zhang
Abstract: We introduce the notion of reproducing kernel Banach spaces (RKBS) and study special semiinner-product RKBS by making use of semi-inner-products and the duality mapping. Properties of an RKBS and its reproducing kernel are investigated. As applications, we develop in the framework of RKBS standard learning schemes including minimal norm interpolation, regularization network, support vector machines, and kernel principal component analysis. In particular, existence, uniqueness and representer theorems are established. Keywords: reproducing kernel Banach spaces, reproducing kernels, learning theory, semi-innerproducts, representer theorems
A. Argyriou, C. A. Micchelli and M. Pontil. When is there a representer theorem? Vector versus matrix regularizers. arXiv:0809.1590v1. N. Aronszajn. Theory of reproducing kernels. Trans. Amer. Math. Soc., 68: 337–404, 1950. K. P. Bennett and E. J. Bredensteiner. Duality and geometry in SVM classifiers. In Proceeding of the Seventeenth International Conference on Machine Learning, pages 57–64, Morgan Kaufmann, San Francisco, 2000. S. Canu, X. Mary and A. Rakotomamonjy. Functional learning through kernel. In Advances in Learning Theory: Methods, Models and Applications, pages 89–110, NATO Science Series III: Computer and Systems Sciences, Volume 190, IOS Press, Amsterdam, 2003. A. Caponnetto, C. A. Micchelli, M. Pontil and Y. Ying. Universal multi-task kernels. Journal of Machine Learning Research, 9: 1615–1646, 2008. J. B. Conway. A Course in Functional Analysis. 2nd Edition, Springer-Verlag, New York, 1990. F. Cucker and S. Smale. On the mathematical foundations of learning. Bull. Amer. Math. Soc., 39: 1–49, 2002. D. F. Cudia. On the localization and directionalization of uniform convexity. Bull. Amer. Math. Soc., 69: 265–267, 1963. R. Der and D. Lee. Large-margin classification in Banach spaces. JMLR Workshop and Conference Proceedings, 2: AISTATS: 91–98, 2007. T. Evgeniou, M. Pontil and T. Poggio. Regularization networks and support vector machines. Adv. Comput. Math., 13: 1–50, 2000. M. J. Fabian, P. Habala, P. Hajek and J. Pelant. Functional Analysis and Infinite-Dimensional Geometry. Springer, New York, 2001. 2773 Z HANG , X U AND Z HANG C. Gentile. A new approximate maximal margin classification algorithm. Journal of Machine Learning Research, 2: 213–242, 2001. J. R. Giles. Classes of semi-inner-product spaces. Trans. Amer. Math. Soc., 129: 436–446, 1967. M. Hein, O. Bousquet and B. Sch¨ lkopf. Maximal margin classification for metric spaces. J. Como put. System Sci., 71: 333–359, 2005. V. I. Istrˇ¸escu. Strict Convexity and Complex Strict Convexity: Theory and Applications. Lecture at Notes in Pure and Applied Mathematics 89, Marcel Dekker, New York, 1984. D. Kimber and P. M. Long. On-line learning of smooth functions of a single variable. Theoret. Comput. Sci., 148: 141–156, 1995. G. Kimeldorf and G. Wahba. Some results on Tchebycheffian spline functions. J. Math. Anal. Appl., 33: 82–95, 1971. G. Lumer. Semi-inner-product spaces. Trans. Amer. Math. Soc., 100: 29–43, 1961. J. Mercer. Functions of positive and negative type and their connection with the theorey of integral equations. Philos. Trans. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci., 209: 415–446, 1909. C. A. Micchelli and M. Pontil. A function representation for learning in Banach spaces. In Learning Theory, pages 255–269, Lecture Notes in Computer Science 3120, Springer, Berlin, 2004. C. A. Micchelli and M. Pontil. On learning vector-valued functions. Neural Comput., 17: 177–204, 2005. C. A. Micchelli and M. Pontil. Feature space perspectives for learning the kernel. Machine Learning, 66: 297–319, 2007. C. A. Micchelli, Y. Xu and P. Ye. Cucker Smale learning theory in Besov spaces. In Advances in Learning Theory: Methods, Models and Applications, pages 47–68, IOS Press, Amsterdam, The Netherlands, 2003. C. A. Micchelli, Y. Xu and H. Zhang. Universal kernels. Journal of Machine Learning Research, 7: 2651–2667, 2006. C. A. Micchelli, Y. Xu and H. Zhang. Optimal learning of bandlimited functions from localized sampling. J. Complexity, 25: 85–114, 2009. W. Rudin. Real and Complex Analysis. 3rd Edition, McGraw-Hill, New York, 1987. S. Saitoh. Integral Transforms, Reproducing Kernels and Their Applications. Pitman Research Notes in Mathematics Series 369, Longman, Harlow, 1997. B. Sch¨ lkopf, R. Herbrich and A. J. Smola. A generalized representer theorem. In Proceeding of the o 14th Annual Conference on Computational Learning Theory and the 5th European Conference on Computational Learning Theory, pages 416–426, Springer-Verlag, London, UK, 2001. B. Sch¨ lkopf and A. J. Smola. Learning with Kernels: Support Vector Machines, Regularization, o Optimization, and Beyond. MIT Press, Cambridge, Mass, 2002. 2774 R EPRODUCING K ERNEL BANACH S PACES FOR M ACHINE L EARNING B. Sch¨ lkopf, A. J. Smola and K.-R. M¨ ller. Nonlinear component analysis as a kernel eigenvalue o u problem. Neural Comput., 10: 1299–1319, 1998. J. Shawe-Taylor and N. Cristianini. Kernel Methods for Pattern Analysis. Cambridge University Press, Cambridge, 2004. I. Steinwart. On the influence of the kernel on the consistency of support vector machines. Journal of Machine Learning Research, 2: 67–93, 2001. J. A. Tropp. Just relax: convex programming methods for identifying sparse signals in noise. IEEE Trans. Inform. Theory, 52: 1030–1051, 2006. V. N. Vapnik. Statistical Learning Theory. Wiley, New York, 1998. U. von Luxburg and O. Bousquet. Distance-based classification with Lipschitz functions. Journal of Machine Learning Research, 5: 669–695, 2004. G. Wahba. Support vector machines, reproducing kernel Hilbert spaces and the randomized GACV. In Advances in Kernel Methods–Support Vector Learning, pages 69–86, MIT Press, Cambridge, Mass, 1999. Y. Xu and H. Zhang. Refinable kernels. Journal of Machine Learning Research, 8: 2083–2120, 2007. Y. Xu and H. Zhang. Refinement of reproducing kernels. Journal of Machine Learning Research, 10: 107–140, 2009. T. Zhang. On the dual formulation of regularized linear systems with convex risks. Machine Learning, 46: 91–129, 2002. D. Zhou, B. Xiao, H. Zhou and R. Dai. Global geometry of SVM classifiers. Technical Report 30-5-02, Institute of Automation, Chinese Academy of Sciences, 2002. 2775