nips nips2010 nips2010-53 nips2010-53-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Gal Elidan
Abstract: We present the Copula Bayesian Network model for representing multivariate continuous distributions, while taking advantage of the relative ease of estimating univariate distributions. Using a novel copula-based reparameterization of a conditional density, joined with a graph that encodes independencies, our model offers great flexibility in modeling high-dimensional densities, while maintaining control over the form of the univariate marginals. We demonstrate the advantage of our framework for generalization over standard Bayesian networks as well as tree structured copula models for varied real-life domains that are of substantially higher dimension than those typically considered in the copula literature. 1
[1] K. Aas, C. Czado, A. Frigessi, and H. Bakken. Pair-copula constructions of multiple dependencies. Insurance: Mathematics and Economics, 44:182–198, 2009.
[2] R. Accioly and F. Chiyoshi. Modeling dependence with copulas: a useful tool for field development decision process. Journal of Petroleum Science and Engineering, 44:83–91, 2004.
[3] T. Bedford and R. Cooke. Vines - a new graphical model for dependent random variables. Annals of Statistics, 30(4):1031–1068, 2002.
[4] P. Cortez, A. Cerdeira, F. Almeida, T. Matos, and J. Reis. Modeling wine preferences by data mining from physicochemical properties. Decision Support Systems, 47(4):547–553, 2009.
[5] W. Darsow, B. Nguyen, and E. Olsen. Copulas and Markov processes. Illinois J Math, 36:600–642, 1992.
[6] G. Elidan. Inference-less density estimation using Copula Bayesian Networks. In Uncertainty in Artificial Intelligence (UAI), 2010.
[7] P. Embrechts, F. Lindskog, and A. McNeil. Modeling dependence with copulas and applications to risk management. Handbook of Heavy Tailed Distributions in Finance, 2003.
[8] M. Fischer and C. Kock. Constructing and generalizing given multivariate copulas. Technical report, Working paper, University of Erlangen-Nurnberg, Nurnberg, 2007.
[9] N. Friedman and I. Nachman. Gaussian Process Networks. In Uncertainty in AI (UAI), 2000.
[10] F. Glover and M. Laguna. Tabu search. In C. Reeves, editor, Modern Heuristic Techniques for Combinatorial Problems, Oxford, England, 1993. Blackwell Scientific Publishing.
[11] A. Heinen and A. Alfonso. Asymmetric CAPM dependence for large dimensions: The canonical vine autoregressive copula model. ECORE Discussion Paper, 2008.
[12] J. Huang and B. Frey. Cumulative distribution networks and the derivative-sum-product algorithm. In Uncertainty in Artificial Intelligence (UAI), 2008.
[13] H. Joe and J. Xu. The estimation method of inference functions for margins for multivariate models. Technical Report 166, Department of Statistics, University of British Columbia, 1996.
[14] S. Kirshner. Learning with tree-averaged densities and distributions. In Neural Information Processing Systems (NIPS), 2007.
[15] K. Koehler and J. Symanowski. Constructing multivariate distributions with specific marginal distributions. Journal of Multivariate Distributions, 55:261–282, 1995.
[16] D. Koller and N. Friedman. Probabilistic Graphical Models: Principles and Techniques. MIT, 2009.
[17] D. Kurwicka and R. Cooke. The vine copula method for representing high dimensional dependent distributions: Applications to continuous belief nets. In The Winter Simulation Conference, 2002.
[18] E. Liebscher. Modelling and estimation of multivariate copulas. Technical report, Working paper, University of Applied Sciences, Merseburg, 2006.
[19] F. Lindskog, A. McNeil, and U. Schmock. Kendall’s tau for elliptical distributions. Credit Risk - measurement, evaluation and management, pages 149–156, 2003.
[20] H. Liu, J. Lafferty, and L. Wasserman. The nonparanormal: Semiparametric estimation of high dimensional undirected graphs. Journal of Machine Learning Research, 10:22952328, 2010.
[21] M. Meila and M. Jordan. Estimating dependency structure as a hidden variable. In Neural Information Processing Systems (NIPS), 1998.
[22] P. Morillas. A method to obtain new copulas from a given one. Metrika, 61:169–184, 2005.
[23] R. Nelsen. An Introduction to Copulas. Springer, 2007.
[24] E. Parzen. On estimation of a probability density function and mode. Annals of Mathematical Statistics, 33:1065–1076, 1962.
[25] J. Pearl. Probabilistic Reasoning in Intelligent Systems. Morgan Kaufmann, 1988.
[26] C. Savu and M. Trede. Hierarchical archimedean copulas. In the Conf on High Frequency Finance, 2006.
[27] A. Schwaighofer, M. Dejori, V. Tresp, and M. Stetter. Structure Learning with Nonparametric Decomposable Models. In the International Conference on Artificial Neural Networks, 2007.
[28] G. Schwarz. Estimating the dimension of a model. Annals of Statistics, 6:461–464, 1978.
[29] A. Sklar. Fonctions de repartition a n dimensions et leurs marges. Publications de l’Institut de Statistique de L’Universite de Paris, 8:229–231, 1959. 9