nips nips2003 nips2003-172 nips2003-172-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Charles Kemp, Thomas L. Griffiths, Sean Stromsten, Joshua B. Tenenbaum
Abstract: We describe a nonparametric Bayesian approach to generalizing from few labeled examples, guided by a larger set of unlabeled objects and the assumption of a latent tree-structure to the domain. The tree (or a distribution over trees) may be inferred using the unlabeled data. A prior over concepts generated by a mutation process on the inferred tree(s) allows efficient computation of the optimal Bayesian classification function from the labeled examples. We test our approach on eight real-world datasets. 1
[1] X. Zhu, Z. Ghahramani, and J. Lafferty. Semi-supervised learning using Gaussian fields and harmonic functions. In ICML, volume 20, 2003.
[2] M. Szummer and T. Jaakkola. Partially labeled classification with Markov random walks. In NIPS, volume 14, 2002.
[3] A. Blum and S. Chawla. Learning from labeled and unlabeled data using graph mincuts. In ICML, volume 18, 2001.
[4] M. Belkin and P. Niyogi. Semi-supervised learning on manifolds. 2003. To appear in Machine Learning, Special Issue on Theoretical Advances in Data Clustering. ¨
[5] O. Chapelle, J. Weston, and B. Scholkopf. Cluster kernels for semi-supervised learning. In NIPS, volume 15, 2003.
[6] T. M. Mitchell. Machine Learning. McGraw-Hill, 1997.
[7] D. Haussler, M. Kearns, and R. Schapire. Bounds on the sample complexity of Bayesian learning using information theory and the VC dimension. Machine Learning, 14(1), 1994.
[8] C. Kemp and J. B. Tenenbaum. Theory-based induction. In Proceedings of the 25th Annual Conference of the Cognitive Science Society, 2003.
[9] L. Shih and D. Karger. Learning classes correlated to a hierarchy. 2003. Unpublished manuscript.
[10] J.-P. Vert. A tree kernel to analyze phylogenetic profiles. Bioinformatics, 1(1):1–9, 2002.
[11] R. Neal. Defining priors for distributions using Dirichlet diffusion trees. Technical Report 0108, University of Toronto, 2001.
[12] H. Jow, C. Hudelot, M. Rattray, and P. Higgs. Bayesian phylogenetics using an RNA substitution model applied to early mammalian evolution. Molecular Biology and Evolution, 19(9):1951–1601, 2002.