nips nips2011 nips2011-144 nips2011-144-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Tzu-kuo Huang, Jeff G. Schneider
Abstract: Vector Auto-regressive models (VAR) are useful tools for analyzing time series data. In quite a few modern time series modelling tasks, the collection of reliable time series turns out to be a major challenge, either due to the slow progression of the dynamic process of interest, or inaccessibility of repetitive measurements of the same dynamic process over time. In those situations, however, we observe that it is often easier to collect a large amount of non-sequence samples, or snapshots of the dynamic process of interest. In this work, we assume a small amount of time series data are available, and propose methods to incorporate non-sequence data into penalized least-square estimation of VAR models. We consider non-sequence data as samples drawn from the stationary distribution of the underlying VAR model, and devise a novel penalization scheme based on the Lyapunov equation concerning the covariance of the stationary distribution. Experiments on synthetic and video data demonstrate the effectiveness of the proposed methods. 1
[1] P. Antsaklis and A. Michel. Linear systems. Birkhauser, 2005. 2
[2] D. P. Bertsekas. Nonlinear Programming. Athena Scientific, Belmont, MA 02178-9998, second edition, 1999. 4
[3] Y. Chen, A. Wiesel, Y. C. Eldar, and A. O. Hero. Shrinkage algorithms for mmse covariance estimation. IEEE Transactions on Signal Processing, 58:5016–5029, 2010. 5
[4] Y. Chen, A. Wiesel, and A. O. Hero. Robust shrinkage estimation of high-dimensional covariance matrices. Technical report, arXiv:1009.5331v1 [stat.ME], September 2010. 5
[5] J. Duchi, S. Shalev-Shwartz, Y. Singer, and T. Chandra. Efficient projections onto the ℓ1 ball for learning in high dimensions. In Proceedings of the 25th International Conference on Machine Learning, pages 272–279, 2008. 4
[6] A. Gupta and Z. Bar-Joseph. Extracting dynamics from static cancer expression data. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 5:172–182, 2008. 2
[7] J. Hamilton. Time series analysis. Princeton Univ Pr, 1994. 2
[8] T.-K. Huang and J. Schneider. Learning linear dynamical systems without sequence information. In Proceedings of the 26th International Conference on Machine Learning, pages 425–432, 2009. 2
[9] T.-K. Huang, L. Song, and J. Schneider. Learning nonlinear dynamic models from nonsequenced data. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, 2010. 2
[10] O. Ledoit and M. Wolf. Improved estimation of the covariance matrix of stock returns with an application to portfolio selection. Journal of Empirical Finance, 10:603–621, 2003. 5
[11] O. Ledoit and M. Wolf. A well-conditioned estimator for large-dimensional covariance matrices. Journal of Multivariate Analysis, 88:365–411, 2004. 5
[12] A. Lozano, N. Abe, Y. Liu, and S. Rosset. Grouped graphical granger modeling for gene expression regulatory networks discovery. Bioinformatics, 25(12):i110, 2009. 1
[13] T. C. Mills. The Econometric Modelling of Financial Time Series. Cambridge University Press, second edition, 1999. 1
[14] D. Noll, O. Prot, and A. Rondepierre. A proximity control algorithm to minimize nonsmooth and nonconvex functions. Pacific Journal of Optimization, 4(3):569–602, 2008. 4
[15] J. Sch¨ fer and K. Strimmer. A shrinkage approach to large-scale covariance matrix estimation a and implications for functional genomics. Statistical Applications in Genetics and Molecular Biology, 4, 2005. 5
[16] S. M. Siddiqi, B. Boots, and G. J. Gordon. Reduced-rank hidden Markov models. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, 2010. 8
[17] C. Stein. Estimation of a covariance matrix. In Rietz Lecture, 39th Annual Meeting, Atlanta, GA, 1975. 5
[18] R. S. Tsay. Analysis of financial time series. Wiley-Interscience, 2005. 1
[19] B. P. Tu, A. Kudlicki, M. Rowicka, and S. L. McKnight. Logic of the yeast metabolic cycle: Temporal compartmentalization of cellular processes. Science, 310(5751):1152–1158, 2005. 1
[20] R. Yang and J. O. Berger. Estimation of a covariance matrix using the reference prior. Annals of Statistics, 22:1195–1211, 1994. 5 9