nips nips2009 nips2009-207 nips2009-207-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Matthias Hein
Abstract: Motivated by recent developments in manifold-valued regression we propose a family of nonparametric kernel-smoothing estimators with metric-space valued output including several robust versions. Depending on the choice of the output space and the metric the estimator reduces to partially well-known procedures for multi-class classification, multivariate regression in Euclidean space, regression with manifold-valued output and even some cases of structured output learning. In this paper we focus on the case of regression with manifold-valued input and output. We show pointwise and Bayes consistency for all estimators in the family for the case of manifold-valued output and illustrate the robustness properties of the estimators with experiments. 1
[1] I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun. Large margin methods for structured and interdependent output variables. JMLR, 6:1453–1484, 2005.
[2] J. Weston, G. BakIr, O. Bousquet, B. Sch¨ lkopf, T. Mann, and W. S. Noble. Joint kernel maps. o In Predicting Structured Data, pages 67–84. MIT Press, 2007.
[3] E. Ricci, T. De Bie, and N. Cristianini. Magic moments for structured output prediction. JMLR, 9:2803–2846, 2008.
[4] K.V. Mardia and P.E. Jupp. Directional statistics. Wiley New York, 2000.
[5] Inam Ur Rahman, Iddo Drori, Victoria C. Stodden, David L. Donoho, and Peter Schroder. Multiscale representations for manifold-valued data. Multiscale Modeling and Simulation, 4(4):1201–1232, 2005.
[6] B. C. Davis, P. T. Fletcher, E. Bullitt, and S. Joshi. Population shape regression from random design data. Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, pages 1–7, 2007.
[7] F. Steinke and M. Hein. Non-parametric regression between Riemannian manifolds. In Advances in Neural Information Processing Systems (NIPS) 21, pages 1561 – 1568, 2009.
[8] P. T. Fletcher, S. Venkatasubramanian, and S. Joshi. The geometric median on Riemannian manifolds with application to robust atlas estimation. NeuroImage, 45:143 – 152, 2009.
[9] C. G. Small. A survey of multidimensional medians. International Statistical Review, 58:263– 277, 1990.
[10] D. Blackwell and M. Maitra. Factorization of probability measures and absolutely measurable sets. Proc. Amer. Math. Soc., 92(2):251–254, 1984.
[11] R. Bhattacharya and V. Patrangenaru. Large sample theory of intrinsic and extrinsic sample means on manifolds I. Ann. Stat., 31(1):1–29, 2003.
[12] H. Karcher. Riemannian center of mass and mollifier smoothing. Communications on Pure and Applied Mathematics, 30:509–541, 1977.
[13] W. Kendall. Probability, convexity, and harmonic maps with small image. I. Uniqueness and fine existence. Proc. London Math. Soc., 61(2):371–406, 1990.
[14] P. Indyk. Sublinear time algorithms for metric space problems. In Proceedings of the 31st Symposium on Theory of computing (STOC), pages 428 – 434, 1999.
[15] L. Gy¨ rfi, M. Kohler, A. Krzy˙ ak, and H. Walk. A Distribution-Free Theory of Nonparametric o z Regression. Springer, New York, 2004.
[16] W. Greblicki and M. Pawlak. Nonparametric System Identification. Cambridge University Press, Cambrige, 2008.
[17] B. Pelletier. Nonparametric regression estimation on closed Riemannian manifolds. J. of Nonparametric Stat., 18:57–67, 2006.
[18] S. Dabo-Niang and N. Rhomari. Estimation non parametrique de la regression avec variable explicative dans un espace metrique. C. R. Math. Acad. Sci. Paris, 1:75–80, 2003.
[19] D. P. Bertsekas. Nonlinear Programming. Athena Scientific, Belmont, Mass., 1999.
[20] M. Hein. Uniform convergence of adaptive graph-based regularization. In G. Lugosi and H. Simon, editors, Proc. of the 19th Conf. on Learning Theory (COLT), pages 50–64, Berlin, 2006. Springer.
[21] N. Glick. Consistency conditions for probability estimators and integrals of density estimators. Utilitas Math., 6:61–74, 1974. 9