nips nips2012 nips2012-233 nips2012-233-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: David B. Dunson, Emily B. Fox
Abstract: We propose a multiresolution Gaussian process to capture long-range, nonMarkovian dependencies while allowing for abrupt changes and non-stationarity. The multiresolution GP hierarchically couples a collection of smooth GPs, each defined over an element of a random nested partition. Long-range dependencies are captured by the top-level GP while the partition points define the abrupt changes. Due to the inherent conjugacy of the GPs, one can analytically marginalize the GPs and compute the marginal likelihood of the observations given the partition tree. This property allows for efficient inference of the partition itself, for which we employ graph-theoretic techniques. We apply the multiresolution GP to the analysis of magnetoencephalography (MEG) recordings of brain activity.
[1] F. Bach. High-dimensional non-linear variable selection through hierarchical kernel learning. Technical Report 0909.0844v1, arXiv, 2009.
[2] J. Beran and Y. Shumeyko. On asymptotically optimal wavelet estimation of trend functions under longrange dependence. Bernoulli, 18(1):137–176, 2012.
[3] C. Blundell, Y. W. Teh, and K. A. Heller. Bayesian rose trees. In Proc. Uncertainty in Artificial Intelligence, pages 65–72, 2010.
[4] P. Del Moral, A. Doucet, and A. Jasra. Sequential Monte Carlo samplers. Journal of the Royal Statistical Society, Series B, 68(3):411–436, 2006.
[5] F. X. Diebold and G. D. Rudebusch. Long memory and persistence in aggregate output. Journal of Monetary Economics, 24:189–209, 1989.
[6] D. Duvenaud, H. Nickisch, and C. E. Rasmussen. Additive Gaussian processes. In Advances in Neural Information Processing Systems, volume 24, pages 226–234, 2011.
[7] A. Y. Fyshe, E. B. Fox, D. B. Dunson, and T. Mitchell. Hierarchical latent dictionaries for models of brain activation. In Proc. International Conference on Artificial Intelligence and Statistics, pages 409– 421, 2012.
[8] R. .B. Gramacy and H. K. H. Lee. Bayesian treed Gaussian process models with an application to computer modeling. Journal of the American Statistical Association, 103(483):1119–1130, 2008.
[9] P. Hansen, M. Kringelbach, and R. Salmelin. MEG: An Introduction to Methods. Oxford University Press, USA, 2010. ISBN 0195307232.
[10] R. Henao and J. E. Lucas. Efficient hierarchical clustering for continuous data. Technical Report 1204.4708v1, arXiv, 2012.
[11] N. S. Jones and J. Moriarty. Evolutionary inference for function-valued traits: Gaussian process regression on phylogenies. Technical Report 1004.4668v2, arXiv, 2011.
[12] H. M. Kim, B. K. Mallick, and C. C. Holmes. Analyzing nonstationary spatial data using piecewise Gaussian processes. Journal of the American Statistical Association, 100(470):653–668, 2005.
[13] P. S. Kokoszka and M. S. Taqqu. Parameter estimation for infinite variance fractional ARIMA. The Annals of Statistics, 24(5):1880–1913, 1996.
[14] E. Meeds and S. Osindero. An alternative mixture of Gaussian process experts. In Advances in Neural Information Processing Systems, volume 18, pages 883–890, 2006.
[15] J. S. Morris and R. J. Carroll. Wavelet-based functional mixed models. Journal of the Royal Statistical Society, Series B, 68(2):179–199, 2006.
[16] S. Park and S. Choi. Hierarchical Gaussian process regression. In Proc. Asian Conference on Machine Learning, pages 95–110, 2010.
[17] C. E. Rasmussen and Z. Ghahramani. Infinite mixtures of Gaussian process experts. In Advances in Neural Information Processing Systems, volume 2, pages 881–888, 2002.
[18] C. E. Rasmussen and C. K. .I. Williams. Gaussian Processes for Machine Learning. MIT Press, 2006.
[19] C. P. Robert and G. Casella. Monte Carlo Statistical Methods. Springer, 2005.
[20] D. M. Roy and Y. W. Teh. The Mondrian process. In Advances in Neural Information Processing Systems, volume 21, pages 1377–1384, 2009.
[21] Y. Saatci, R. Turner, and C. E. Rasmussen. Gausssian process change point models. In Proc. International Conference on Machine Learning, pages 927–934, 2010.
[22] J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8):888–905, 2000.
[23] G. Sudre, D. Pomerleaum, M. Palatucci, L. Wehbe, A. Fyshe, R. Salmelin, and T. Mitchell. Tracking neural coding of perceptual and semantic features of concrete nouns. Neuroimage, 62(1):451–463, 2012.
[24] U. von Luxburg. A tutorial on spectral clustering. Statistics and Computing, 17(4):395–416, 2007.
[25] A. S. Willsky. Multiresolution Markov models for signal and image processing. Proceedings of the IEEE, 90(8):1396–1458, 2002. 9