nips nips2001 nips2001-76 nips2001-76-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: K. Wong, F. Li
Abstract: We propose a method for the fast estimation of hyperparameters in large networks, based on the linear response relation in the cavity method, and an empirical measurement of the Green's function. Simulation results show that it is efficient and precise, when compared with cross-validation and other techniques which require matrix inversion. 1
[1] C. M. Bishop, Neural Networks for Pattern Recognition, Clarendon Press, Oxford (1995).
[2] G. B. Orr and K-R. Muller, eds., Neural Networks: Tricks of th e Trad e, Springer, Berlin (1998).
[3] O. Chapelle and V. N. Vapnik, Advances in Neural Information Processing Systems 12, S. A. Solla, T. KLeen and K-R. Muller, eds., MIT Press, Cambridge, 230 (2000).
[4] S. S. Keerthi, Technical Report CD-OI-02, http://guppy.mpe.nus. edu .sg/ mpessk/nparm.html (2001).
[5] M. Opper and O. Winther , Advances in Large Margin Classifiers, A. J. Smola, P. Bartlett, B. Sch6lkopf and D. Schuurmans, eds., MIT Press, Cambridge, 43 (1999) .
[6] J. Larsen and L. K Hansen , Advances in Computational Math ematics 5 , 269 (1996).
[7] M. Opper and O. Winther , Phys. R ev. Lett. 76 , 1964 (1996).
[8] A. L. Fetter and J. D. Walecka, Quantum Theory of Many-Particle Systems, McGrawHill, New York (1971).
[9] K Y. M. Wong, S. Li and Y. W . Tong, Phys. Rev. E 62 , 4036 (2000).
[10] D. Saad and S. A. Solla, Phys. R ev. Lett. 74, 4337 (1995).
[11] W. H. Press, B. P. Flannery, S. A. Teukolsky and W . T. Vett erling, Num erical R ecipes in C: Th e Art of Sci entific Computing, Cambridge University Press, Cambridge (1990).
[12] A. Krogh and J. A. Hertz , J. Phys. A 25 , 1135 (1992).
[13] S. Amari, N. Murata, K-R. Muller , M. Finke and H. H. Yang, IEEE Trans. on N eural N etworks 8, 985 (1997) .