iccv iccv2013 iccv2013-126 iccv2013-126-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Bo Wang, Zhuowen Tu, John K. Tsotsos
Abstract: In graph-based semi-supervised learning approaches, the classification rate is highly dependent on the size of the availabel labeled data, as well as the accuracy of the similarity measures. Here, we propose a semi-supervised multi-class/multi-label classification scheme, dynamic label propagation (DLP), which performs transductive learning through propagation in a dynamic process. Existing semi-supervised classification methods often have difficulty in dealing with multi-class/multi-label problems due to the lack in consideration of label correlation; our algorithm instead emphasizes dynamic metric fusion with label information. Significant improvement over the state-of-the-art methods is observed on benchmark datasets for both multiclass and multi-label tasks.
[1] E. Allwlein, R. Schapire, and Y. Singer. Reducing multiclass to binary: A unifying approach for margin classifier. Journal of Machine Learning Research, (1): 113 –141, 2000.
[2] A. Azran. The rendezvous algorithm: multiclass semisupervised lenaring with markov random walks. Proc. of ICML, pages 49–56, 2007. 43 1
[3] M. Belkin, P. Niyogi, and V. Sindhwani. On Manifold Regularization. In Proc. of AISTAT, 2005.
[4] M. B. Blaschko, C. H. Lampert, and A. Gretton. Semisupervised laplacian regularization of kernel canonical correlation analysis. In Proceedings of ECMLKDD, pages 133– 145, 2008.
[5] A. Blum and T. Mitchell. Combining labeled and unlabeled data with co-training. In Proc. of COLT, 1998.
[6] O. Chapelle, B. Sch o¨lkopf, and A. Zien, editors. SemiSupervised Learning. MIT Press, Cambridge, MA, 2006.
[7] G. Chen, Y. Song, and F. Wang. Semi-supervised multilabel learning by solving a sylvester equation. Proc of SDM, 6(10):28–30, 2008.
[8] K. Crammer and Y. Singer. A new family of online algirithms for category ranking. Proc. of SIGIR, 2002.
[9] L. Fei-Fei, R. Fergus, and P. Perona. One-shot learning of object categories. IEEE Trans. Pattern Anal. Mach. Intell. ,
[10]
[11]
[12]
[13]
[14]
[15]
[16]
[17]
[18]
[19] 28:594–61 1, April 2006. A. Goldberg, X. J. Zhu, B. Recht, J. Xu, and R. Nowak. Transduction with matrix completion: Three birds with one stone. In Advances in Neural Information Processing Systems 23, pages 757–765, 2010. S. Har-peled, D. Roth, and D. Zimak. Constraint classification for multiclass classification and ranking. In Proc.of NIPS, pages 785–792. MIT Press, 2003. J. Jiang, B. Wang, and Z. Tu. Unsupervised metric learning by self-smoothing operator. In ICCV, pages 794–801, 2011. F. Kang, R. Jin, and R. Sukthankar. Correlated label propagation with application to multi-label learning. In Proc. of CVPR, pages 1719–1726, 2006. X. Kong, M. K. Ng, and Z.-H. Zhou. Transductive multilabel learning via label set propagation. TKDE, 99, 2011. S. Lafon and A. B. Lee. Diffusion maps and coarse-graining: A unified framework for dimensionality reduction, graph partitioning, and data set parameterization. IEEE Trans. on PAMI, 28(9): 1393–1403, 2006. S. Lazebnik and C. Schmid. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In Proc. of CVPR, 2006. Y. Liu, R. Jin, and L. Yang. Semi-supervised multi-label learning by constrained non-negative matrix factorization. In Proc. of AAAI, pages 421–426, 2006. S. Rogers and M. Girolami. Multi-class semi-supervised learning with the e-truncted multinomial probit gaussian process. Journal of Machine Learning Research, (1): 17 –32, 2007. J. Rousu, C. Saunders, S. Szedmak, and J. Shawe-Taylor. On maximum margin hierarchical multi-label classification.
[20]
[21]
[22]
[23]
[24]
[25]
[26]
[27]
[28]
[29] Proc. of NIPS Workshop on Learning With Structured Outputs, 2004. S. T. Roweis and L. K. Saul. Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500):2323– 2326, 2000. A. Saffari, C. Leistner, and H. Bischof. Regularized multiclass semi-supervised boosting. In CVPR, 2009. Y. Song, C. Zhang, and J. Lee. Graph based multi-class semi-supervised leanring using gaussian process. In In IAPR workshop on Structural, Syntactic, and Statistical Pattern Recognition, pages 450–458, 2006. A. Subramanya, S. Petrov, and F. Pereira. Efficient graphbased semi-supervised learning of structured tagging models. In Proc. of EMNLP, pages 167–176, 2010. J. B. Tenenbaum, V. de Silva, and J. C. Langford. A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319–2322, 2000. H. Valizadegan, R. Jin, and A. K. Jain. Semi-supervised boosting for multi-class classification. In Proc. of ECML PKDD, pages 522–537, 2008. B. Wang, J. Jiang, W. Wang, Z.-H. Zhou, and Z. Tu. Unsupervised metric fusion by cross diffusion. In CVPR, pages 2997–3004, 2012. B. Wang and Z. Tu. Affinity learning via self-diffusion for image segmentation and clustering. In CVPR, pages 23 12– 2319, 2012. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong. Locality-constrained linear coding for image classification. In Proc. of CVPR, 2010. K. Q. Weinberger, J. Blitzer, and L. K. Saul. Distance metric learning for large margin nearest neighbor classification. In
[30] [3 1]
[32]
[33]
[34] Proceedings of NIPS, pages 1473–1480, 2006. E. P. Xing, A. Y. Ng, M. I. Jordan, and S. J. Russell. Distance metric learning with application to clustering with side-information. In Proc. of NIPS, pages 505–5 12, 2002. L. Xu and D. Schuurmans. Unsupervised and semisupervised multi-class support vector machines. In Proc. of AAAI, 2005. X. Yang, X. Bai, L. Latecki, and Z. Tu. Improving shape retrieval by learning graph transduction. In Proc. of ECCV, 2008. K. Yu, S. Yu, and V. Tresp. Multi-label informed latent semantic indexing. In Proc. of SIGIR, pages 258–265, 2005. Z.-J. Zha, T. Mei, J. Wang, Z. Wang, and X.-S. Hua. Graphbased semi-supervised learning with multiple labels. Journal of Visual Communication and Image Representation, 20(2):97 103, 2009. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Sch o¨lkopf. Learning with local and global consistency. In Proc. of NIPS, pages 321–328. MIT Press, 2004. S. Zhu, X. Ji, W. Xu, and Y. Gong. Multi-labelled classification using maximum entropy method. In Proc. of SIGIR, pages 274–281, 2005. X. Zhu. Semi-supervised Learning with Graphs. Doctoral thesis, Department of Computer Science, Carnegie Mellon University, 2005. X. Zhu. Semi-supervised learning literature survey. Computer Science TR 1530, University of Wisconsin-Madison, 2008. –
[35]
[36]
[37]
[38] 432