nips nips2004 nips2004-158 nips2004-158-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Rob Fergus, Andrew Zisserman, Pietro Perona
Abstract: We present an algorithm to overcome the local maxima problem in estimating the parameters of mixture models. It combines existing approaches from both EM and a robust fitting algorithm, RANSAC, to give a data-driven stochastic learning scheme. Minimal subsets of data points, sufficient to constrain the parameters of the model, are drawn from proposal densities to discover new regions of high likelihood. The proposal densities are learnt using EM and bias the sampling toward promising solutions. The algorithm is computationally efficient, as well as effective at escaping from local maxima. We compare it with alternative methods, including EM and RANSAC, on both challenging synthetic data and the computer vision problem of alpha-matting. 1
[1] Ondˇej Chum, Jiˇ´ Matas, and Josef Kittler. Locally optimized ransac. In DAGM r rı 2003: Proceedings of the 25th DAGM Symposium, pages 236–243, 2003.
[2] A. Dempster, N. Laird, and D. Rubin. Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society, 39:1–38, 1976.
[3] M. A. Fischler and R. C. Bolles. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Comm. ACM, 24(6):381–395, 1981.
[4] S. Richardson and P.J. Green. On bayesian analysis of mixtures with an unknown number of components. Journal of the Royal Statistical Society, 59(4):731–792, 1997.
[5] C.V. Stewart. Robust parameter estimation. SIAM Review, 41(3):513–537, Sept. 1999.
[6] B. Tordoff and D.W. Murray. Guided sampling and consensus for motion estimation. In Proc. ECCV, 2002.
[7] P. H. S. Torr and A. Zisserman. MLESAC: A new robust estimator with application to estimating image geometry. CVIU, 78:138–156, 2000.
[8] N. Ueda and R. Nakano. Deterministic Annealing EM algorithm. Neural Networks, 11(2):271–282, 1998.
[9] N. Ueda, R. Nakano, Z. Ghahramani, and G. E. Hinton. SMEM algorithm for mixture models. Neural Computation, 12(9):2109–2128, 2000.
[10] G. Wei and M. Tanner. A Monte Carlo implementation of the EM algorithm. Journal American Statistical Society, 85:699–704, 1990.