nips nips2006 nips2006-3 nips2006-3-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Andrea Vedaldi, Stefano Soatto
Abstract: Image Congealing (IC) is a non-parametric method for the joint alignment of a collection of images affected by systematic and unwanted deformations. The method attempts to undo the deformations by minimizing a measure of complexity of the image ensemble, such as the averaged per-pixel entropy. This enables alignment without an explicit model of the aligned dataset as required by other methods (e.g. transformed component analysis). While IC is simple and general, it may introduce degenerate solutions when the transformations allow minimizing the complexity of the data by collapsing them to a constant. Such solutions need to be explicitly removed by regularization. In this paper we propose an alternative formulation which solves this regularization issue on a more principled ground. We make the simple observation that alignment should simplify the data while preserving the useful information carried by them. Therefore we trade off fidelity and complexity of the aligned ensemble rather than minimizing the complexity alone. This eliminates the need for an explicit regularization of the transformations, and has a number of other useful properties such as noise suppression. We show the modeling and computational benefits of the approach to the some of the problems on which IC has been demonstrated. 1
[1] P. Ahammad, C. L. Harmon, A. Hammonds, S. S. Sastry, and G. M. Rubin. Joint nonparametric alignment for analizing spatial gene expression patterns in drosophila imaginal discs. In Proc. CVPR, 2005.
[2] K. Branson. The information bottleneck method. Lecture Slides, 2003.
[3] J. Buhmann and H. K¨ hnel. Vector quantization with complexity costs. IEEE Trans. on Inforu mation Theory, 39, 1993.
[4] P. A. Chou, T. Lookabaugh, and R. M. Gray. Entropy-constrained vector quantization. In 37, editor, IEEE Trans. on Acoustics, Speech, and Signal Processing, volume 1, 1989.
[5] T. M. Cover and J. A. Thomson. Elements of Information Theory. Wiley, 2006.
[6] R. O. Duda, P. E. Hart, and D. G. Stork. Pattern Classification. Wiley Inerscience, 2001.
[7] B. J. Frey and N. Jojic. Transformation-invariant clustering and dimensionality reduction using EM. PAMI, 2000.
[8] G. H. Golub and C. F. Van Loan. Matrix Computations. The Johns Hopkins University Press, 1996.
[9] E. G. Learned-Miller. Data driven image models through continuous joint alignment. PAMI, 28(2), 2006.
[10] M. E. Tipping and C. M. Bishop. Probabilistic principal component analysis. Journal of The Royal Statistical Society, Series B, 61(3), 1999.