jmlr jmlr2008 jmlr2008-84 jmlr2008-84-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Tianjiao Chu, Clark Glymour
Abstract: Pointwise consistent, feasible procedures for estimating contemporaneous linear causal structure from time series data have been developed using multiple conditional independence tests, but no such procedures are available for non-linear systems. We describe a feasible procedure for learning a class of non-linear time series structures, which we call additive non-linear time series. We show that for data generated from stationary models of this type, two classes of conditional independence relations among time series variables and their lags can be tested efficiently and consistently using tests based on additive model regression. Combining results of statistical tests for these two classes of conditional independence relations and the temporal structure of time series data, a new consistent model specification procedure is able to extract relatively detailed causal information. We investigate the finite sample behavior of the procedure through simulation, and illustrate the application of this method through analysis of the possible causal connections among four ocean indices. Several variants of the procedure are also discussed. Keywords: conditional independence test, contemporaneous causation, additive model regression, Granger causality, ocean indices
H. An and F. Huang. The geometrical ergodicity of nonlinear autoregression models. Statistica Sinica, 6:943–956, 1996. E. Baek and W. Brock. A general test for nonlinear Granger causality: A bivariate model. URL http://www.ssc.wisc.edu/∼wbrock/Baek Brock Granger.pdf. January 1992. F. Bandi and P. Phillips. Fully nonparametric estimation of scalar diffusion models. Econometrica, 71:241–283, 2003. D. Bell, J. Kay, and J. Malley. A non-parametric approach to non-linear causality testing. Economics Letters, 51:7–18, 1996. D. Bessler, J. Yang, and M. Wongcharupan. Price dynamics in the international wheat market: Modeling with error correction and directed acyclic graphs. Journal of Regional Science, 42: 793–825, 2002. Z. Cai and E. Masry. Nonparametric estimation of additive nonlinear arx time series: Local linear fitting and projections. Journal of Econometric Theory, 16:465–501, 2000. K. Chan and H. Tong. A note on noisy chaos. Journal of the Royal Statistical Society B, 56:301–311, 1994. R. Chen and R. Tsay. Functional-coefficient autoregressive models. Journal of the American Statistical Association, 88:298–308, 1993. D. Chickering. Learning equivalence classes of Bayesian-network structures. Journal of Machine Learning Research, 2:445–498, 2002a. D. Chickering. Optimal structure identification with greedy search. Journal of Machine Learning Research, 3:507–554, 2002b. D. Cline and H. Pu. Geometric ergodicity of nonlinear time series. Statistica Sinica, 9:1103–1118, 1999. Y. Davydov. Mixing conditions for Markov chains. Theory of Probability and its Applications, 18: 312–328, 1973. S. Demiralp and K. Hoover. Searching for the causal structure of a vector autoregression. Oxford Bulletin of Economics and Statistics, 65:745–767, 2003. 989 C HU AND G LYMOUR C. Diks and V. Panchenko. A new statistic and practical guidelines for nonparametric Granger causality testing. Journal of Economic Dynamics and Control, 30:1647–1669, 2006. M. Drton, M. Eichler, and T. S. Richardson. Identification and Likelihood Inference for Recursive Linear Models with Correlated Errors. ArXiv Mathematics e-prints, August 2006. URL http://arxiv.org/abs/math/0601631v3. R. Engle and C. Granger. Cointegration and error correction: Representation, estimation, and testing. Econometrica, 55:251–276, 1987. W. H¨ rdle, H. L¨ tkepohl, and R. Chen. A review of nonparametric time series analysis. Internaa u tional Statistical Review, 65:49–72, 1997. T. Hastie and R. Tibshirani. Generalized Additive Models. Chapman and Hall, New York, NY, 1990. C. Hiemstra and J. Jones. Testing for linear and nonlinear Granger causality in the stock pricevolume relation. Journal of Finance, 49:1639–1664, 1994. K. Hoover. Automatic inference of the contemporaneous causal order of a system of equations. Econometric Theory, 21:69–77, 2005. P. O. Hoyer, S. Shimizu, and A. J. Kerminen. Estimation of linear, non-Gaussian causal models in the presence of confounding latent variables. pages 155–162, Prague, Czech Republic, 2006. J. Huang and L. Yang. Identification of non-linear additive autoregressive models. Journal of the Royal Statistical Society: Series B, 66:463–477, 2004. S. Johansen. Estimation and hypothesis testing of cointegration vectors in Gaussian vector autoregressive models. Econometrica, 59:1551–1580, 1991. H. Karlsen and D. Tjøstheim. Nonparametric estimation in null recurrent time series. The Annals of Statistics, 29:372–416, 2001. H. Karlsen, T. Myklebust, and D. Tjøstheim. Nonparametric estimation in a nonlinear cointegration type model. Working paper, 2005. URL http://www.mi.uib.no/∼karlsen/working paper/NonlinCoint05.pdf. C. Meek. Graphical Models: Selecting Causal and Statistical Models. PhD thesis, Carnegie Mellon University, Philosophy Department, 1996. A. Moneta. Graphic models for structural vector autoregressions. Working paper, Laboratory of Economics and Management, Sant‘Anna School of Advanced Studies, Pisa, Italy, 2003. L. Oxley, M. Reale, and G. Tunnicliffe-Wilson. Finding directed acyclic graphs for vector autoregressions. In Proceedings in Computational Statistics 2004, pages 1621–1628, 2004. J. Pearl. Causality. Cambridge University Press, Cambridge, UK, 2000. P. Phillips and J. Park. Nonstationary density estimation and kernel autoregression. Discussion Paper 1181, Cowles Foundation, Yale University, 1998. 990 A DDITIVE N ON -L INEAR T IME S ERIES C AUSAL I NFERENCE T. Richardson and P. Spirtes. Automated discovery of linear feedback models. In C. Glymour and G. Cooper, editors, Computation, Causation and Discovery, chapter 7, pages 253–302. MIT Press, Cambridge, MA, 1999. P. Robinson. Nonparametric estimation for time series models. Journal of Time Series Analysis, 4: 185–208, 1983. R. Silva, R. Scheines, C. Glymour, and P. Spirtes. Learning the structure of linear latent variable models. Journal of Machine Learning Research, 7:191–246, 2006. P. Spirtes and C. Meek. Learning Bayesian networks with discrete variables from data. In Proceedings of the First International Conference on Knowledge Discovery and Data Mining, pages 294–299, 1995. P. Spirtes, C. Glymour, and R. Scheines. Causation, Prediction, and Search. MIT Press, New York, NY, second edition, 2000. C. Stone. Additive regression and other nonparametric models. The Annals of Statistics, 13:689– 705, 1985. L. Su and H. White. A nonparametric Hellinger metric test for conditional independence. Econometric Theory, (forthcoming), 2007. N.R. Swanson and C.W.J. Granger. Impulse response functions based on a causal approach to residual orthogonalization in vector autoregressions. Journal of the American Statistical Association, 92:357–367, 1997. D. Tjøstheim and B. Auestad. Nonparametric identification of nonlinear time series: Projections. Journal of the American Statistical Association, 89:1398–1409, 1994. Y. Truong and C. Stone. Nonparametric function estimation involving time series. The Annals of Statistics, 20:77–97, 1992. Y. Xia and H. An. Projection pursuit autoregression in time series. Journal of Time Series Analysis, 20:693–714, 1999. 991