nips nips2010 nips2010-245 nips2010-245-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Stefan Harmeling, Hirsch Michael, Bernhard Schölkopf
Abstract: Modelling camera shake as a space-invariant convolution simplifies the problem of removing camera shake, but often insufficiently models actual motion blur such as those due to camera rotation and movements outside the sensor plane or when objects in the scene have different distances to the camera. In an effort to address these limitations, (i) we introduce a taxonomy of camera shakes, (ii) we build on a recently introduced framework for space-variant filtering by Hirsch et al. and a fast algorithm for single image blind deconvolution for space-invariant filters by Cho and Lee to construct a method for blind deconvolution in the case of space-variant blur, and (iii), we present an experimental setup for evaluation that allows us to take images with real camera shake while at the same time recording the spacevariant point spread function corresponding to that blur. Finally, we demonstrate that our method is able to deblur images degraded by spatially-varying blur originating from real camera shake, even without using additionally motion sensor information. 1
[1] M. Hirsch, S. Sra, B. Sch¨ lkopf, and S. Harmeling. Efficient Filter Flow for Space-Variant o Multiframe Blind Deconvolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2010.
[2] S. Cho and S. Lee. Fast Motion Deblurring. ACM Transactions on Graphics (SIGGRAPH ASIA 2009), 28(5), 2009.
[3] D. Krishnan and R. Fergus. Fast image deconvolution using hyper-Laplacian priors. In Advances in Neural Information Processing Systems (NIPS), 2009.
[4] R. Fergus, B. Singh, A. Hertzmann, S.T. Roweis, and W.T. Freeman. Removing camera shake from a single photograph. In ACM SIGGRAPH, page 794. ACM, 2006.
[5] Q. Shan, J. Jia, and A. Agarwala. High-quality motion deblurring from a single image. ACM Transactions on Graphics (SIGGRAPH), 2008.
[6] D. Kundur and D. Hatzinakos. Blind image deconvolution. IEEE Signal Processing Mag., 13(3):43–64, May 1996.
[7] A. Levin, Y. Weiss, F. Durand, and W.T. Freeman. Understanding and evaluating blind deconvolution algorithms. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2009.
[8] Y. W. Tai, P. Tan, L. Gao, and M. S. Brown. Richardson-Lucy deblurring for scenes under projective motion path. Technical report, KAIST, 2009.
[9] Qi Shan, Wei Xiong, and Jiaya Jia. Rotational motion deblurring of a rigid object from a single image. In Proc. Int. Conf. on Computer Vision, 2007.
[10] J. Bardsley, S. Jeffries, J. Nagy, and B. Plemmons. A computational method for the restoration of images with an unknown, spatially-varying blur. Optics Express, 14(5):1767–1782, 2006.
[11] J.G. Nagy and D.P. O’Leary. Restoring images degraded by spatially variant blur. SIAM Journal on Scientific Computing, 19(4):1063–1082, 1998.
[12] N. Joshi, S.B. Kang, C.L. Zitnick, and R. Szeliski. Image deblurring using inertial measurement sensors. In ACM SIGGRAPH 2010 Papers. ACM, 2010.
[13] A. Levin. Blind motion deblurring using image statistics. In Advances in Neural Information Processing Systems (NIPS), 2006.
[14] S. Cho, Y. Matsushita, and S. Lee. Removing non-uniform motion blur from images. In IEEE 11th International Conference on Computer Vision, 2007, 2007. ˇ ˇ
[15] M. Sorel and F. Sroubek. Space-variant deblurring using one blurred and one underexposed image. In Proceedings of the International Conference on Image Processing (ICIP), 2009.
[16] T.G. Stockham Jr. High-speed convolution and correlation. In Proceedings of the Spring joint computer conference, pages 229–233. ACM, 1966.
[17] N. Joshi, R. Szeliski, and D.J. Kriegman. Image/video deblurring using a hybrid camera. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2008.
[18] R. Fergus, B. Singh, A. Hertzmann, S.T. Roweis, and W.T. Freeman. Removing camera shake from a single image. ACM Transactions on Graphics (SIGGRAPH), 2006. 9