nips nips2010 nips2010-59 nips2010-59-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Yuanqing Lin, Zhang Tong, Shenghuo Zhu, Kai Yu
Abstract: This paper proposes a principled extension of the traditional single-layer flat sparse coding scheme, where a two-layer coding scheme is derived based on theoretical analysis of nonlinear functional approximation that extends recent results for local coordinate coding. The two-layer approach can be easily generalized to deeper structures in a hierarchical multiple-layer manner. Empirically, it is shown that the deep coding approach yields improved performance in benchmark datasets.
[1] http://yann.lecun.com/exdb/mnist/.
[2] Samy Bengio, Fernando Pereira, Yoram Singer, and Dennis Strelow. Group sparse coding. In NIPS’ 09, 2009.
[3] D P. Bertsekas. Projected newton methods for optimization problems with simple constraints. SIAM J. Control Optim., 20(2):221–246, 1982.
[4] Dimitri P. Bertsekas. Nonlinear programming. Athena Scientific, 2003.
[5] David Bradley and J. Andrew (Drew) Bagnell. Differentiable sparse coding. In Proceedings of Neural Information Processing Systems 22, December 2008.
[6] M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results. http://www.pascalnetwork.org/challenges/VOC/voc2007/workshop/index.html.
[7] Mark Everingham. Overview and results of the classification challenge. The PASCAL Visual Object Classes Challenge Workshop at ICCV, 2009.
[8] G. E. Hinton and R. R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313(5786):504 – 507, July 2006. 8
[9] Honglak Lee, Alexis Battle, Rajat Raina, and Andrew Y. Ng. Efficient sparse coding algorithms. In Proceedings of the Neural Information Processing Systems (NIPS) 19, 2007.
[10] Michael S. Lewicki and Terrence J. Sejnowski. Learning overcomplete representations. Neural Computation, 12:337–365, 2000.
[11] J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman. Supervised dictionary learning. In NIPS’ 08, 2008.
[12] B.A. Olshausen and D.J. Field. Emergence of simple-cell receptive field properties by learning a sparse code for nature images. Nature, 381:607–609, 1996.
[13] Rajat Raina, Alexis Battle, Honglak Lee, Benjamin Packer, and Andrew Y. Ng. Self-taught learning: Transfer learning from unlabeled data. International Conference on Machine Learning, 2007.
[14] Marc Aurelio Ranzato, Y-Lan Boureau, and Yann LeCun. Sparse feature learning for deep belief networks. In NIPS’ 07, 2007.
[15] Jianchao Yang, Kai Yu, Yihong Gong, and Thomas Huang. Linear spatial pyramid matching using sparse coding for image classification. In IEEE Conference on Computer Vision and Pattern Recognition, 2009.
[16] Kai Yu and Tong Zhang. Improved local coordinate coding using local tangents. In ICML’ 09, 2010.
[17] Kai Yu, Tong Zhang, and Yihong Gong. Nonlinear learning using local coordinate coding. In NIPS’ 09, 2009. 9