nips nips2006 nips2006-42 nips2006-42-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Lyndsey C. Pickup, David P. Capel, Stephen J. Roberts, Andrew Zisserman
Abstract: This paper develops a multi-frame image super-resolution approach from a Bayesian view-point by marginalizing over the unknown registration parameters relating the set of input low-resolution views. In Tipping and Bishop’s Bayesian image super-resolution approach [16], the marginalization was over the superresolution image, necessitating the use of an unfavorable image prior. By integrating over the registration parameters rather than the high-resolution image, our method allows for more realistic prior distributions, and also reduces the dimension of the integral considerably, removing the main computational bottleneck of the other algorithm. In addition to the motion model used by Tipping and Bishop, illumination components are introduced into the generative model, allowing us to handle changes in lighting as well as motion. We show results on real and synthetic datasets to illustrate the efficacy of this approach.
[1] S. Baker and T. Kanade. Limits on super-resolution and how to break them. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(9):1167–1183, 2002.
[2] S. Borman. Topics in Multiframe Superresolution Restoration. PhD thesis, University of Notre Dame, Notre Dame, Indiana, May 2004.
[3] D. Capel. Image Mosaicing and Super-resolution (Distinguished Dissertations). Springer, ISBN: 1852337710, 2004.
[4] S. Farsiu, M. Elad, and P. Milanfar. A practical approach to super-resolution. In Proc. of the SPIE: Visual Communications and Image Processing, San-Jose, 2006.
[5] R. C. Hardie, K. J. Barnard, and E. A. Armstrong. Joint map registration and high-resolution image estimation using a sequence of undersampled images. IEEE Transactions on Image Processing, 6(12):1621–1633, 1997.
[6] R. I. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, ISBN: 0521540518, second edition, 2004.
[7] M. Irani and S. Peleg. Super resolution from image sequences. ICPR, 2:115–120, June 1990.
[8] M. Irani and S. Peleg. Improving resolution by image registration. Graphical Models and Image Processing, 53:231–239, 1991.
[9] I. Nabney. Netlab algorithms for pattern recognition. Springer, 2002.
[10] N. Nguyen, P. Milanfar, and G. Golub. Efficient generalized cross-validation with applications to parametric image restoration and resolution enhancement. IEEE Transactions on Image Processing, 10(9):1299–1308, September 2001.
[11] L. C. Pickup, S. J. Roberts, and A. Zisserman. A sampled texture prior for image superresolution. In Advances in Neural Information Processing Systems, pages 1587–1594, 2003.
[12] L. C. Pickup, S. J. Roberts, and A. Zisserman. Optimizing and learning for super-resolution. In Proceedings of the British Machine Vision Conference, 2006. to appear.
[13] D. Robinson and P. Milanfar. Fundamental performance limits in image registration. IEEE Transactions on Image Processing, 13(9):1185—1199, September 2004.
[14] R. R. Schultz and R. L. Stevenson. A bayesian approach to image expansion for improved definition. IEEE Transactions on Image Processing, 3(3):233–242, 1994.
[15] Salient Stills. http://www.salientstills.com/.
[16] M. E. Tipping and C. M. Bishop. Bayesian imge super-resolution. In S. Thrun, S. Becker, and K. Obermayer, editors, Advances in Neural Information Processing Systems, volume 15, pages 1279–1286, Cambridge, MA, 2003. MIT Press.