cvpr cvpr2013 cvpr2013-37 cvpr2013-37-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Shaodi You, Robby T. Tan, Rei Kawakami, Katsushi Ikeuchi
Abstract: Raindrops adhered to a windscreen or window glass can significantly degrade the visibility of a scene. Detecting and removing raindrops will, therefore, benefit many computer vision applications, particularly outdoor surveillance systems and intelligent vehicle systems. In this paper, a method that automatically detects and removes adherent raindrops is introduced. The core idea is to exploit the local spatiotemporal derivatives ofraindrops. First, it detects raindrops based on the motion and the intensity temporal derivatives of the input video. Second, relying on an analysis that some areas of a raindrop completely occludes the scene, yet the remaining areas occludes only partially, the method removes the two types of areas separately. For partially occluding areas, it restores them by retrieving as much as possible information of the scene, namely, by solving a blending function on the detected partially occluding areas using the temporal intensity change. For completely occluding areas, it recovers them by using a video completion technique. Experimental results using various real videos show the effectiveness of the proposed method.
[1] P. Barnum, S. Narasimhan, and T. Kanade. Analysis of rain and snow in frequency space. IJCV, 86(2-3):256–274, 2010. 2 1 1 10 0 03 34 91 9 Ground truth Input Our method method Wexler al. (2004) Error: Wexler et al. xperiment 1 E xperiment 2 E nmetierxp3EFigure1 .TheraindropremovalresultsusingourmethodsandthemethodofWexleretal.[21]. u I pntHand held camera Car mounted camera anually labeledM FimtcFolaulgtau re12.Theraindropremovalusingtheourmethod.First ow:theinputsequence.Secondrow:ther movalresultwith eraindrops Error: our et manually labeled. Third row: the removal result with the raindrops automatically detected.
[2] R. Fattal. Single image dehazing. SIGGRAPH, 2008. 2
[3] K. Garg and S. Nayar. Photometric model of a raindrop. CMU Technical Report, 2003. 2
[4] K. Garg and S. Nayar. Detection and removal of rain from video. CVPR, 2004. 2
[5] K. Garg and S. Nayar. Vision and rain. IJCV, 75(1):3–27, 2007. 2
[6] T. Hara, H. Saito, and T. Kanade. Removal of glare caused by water droplets. Conference for Visual Media Production, 2009. 2
[7] K. He, J. Sun, and X. Tang. Single image haze removal using dark channel prior. CVPR, 2009. 2
[8] J. Jia, Y. Tai, T. Wu, and C. Tang. Video repairing under variable illumination using cyclic motions. TPAMI, 28(5):832–839, 2006. 2
[9] J. Jia, T. Wu, Y. Tai, and C. Tang. Video repairing: Inference of foreground and background under severe occlusion. CVPR, 2004. 2
[10] L. Kang, C. Lin, and Y. Fu. Automatic single-image-based rain streaks removal via image decomposition. TIP, 21(4): 1742–1755, 2012. 2
[11] H. Kurihata, T. Takahashi, I. Ide, Y. Mekada, H. Murase, Y. Tamatsu, and T. Miyahara. Rainy weather recognition from in-vehicle camera images for driver assistance. IEEE Intelligent Vehicles Symposium, 2005. 2, 6
[12] C. Liu, J. Yuen, and A. Torralba. Sift flow: Dense correspondence across scenes and its applications. TPAMI, 33(5):978–994, 2006. 4
[13] M. Liu, S. Chen, J. Liu, and X. Tang. Video completion via motion guided spatial-temporal global optimization. ACMM, 2009. 2
[14] M. Roser and A. Geiger. Video-based raindrop detection for improved image registration. ICCV Workshops, 2009. 2, 5, 6
[15] M. Roser, J. Kurz, and A. Geiger. Realistic modeling of water droplets for monocular adherent raindrop recognition using bezier curves. ACCV, 2010. 2
[16] G. Sapiro and M. Bertalmio. Video inpainting under constrained camera motion. TIP, 16(2):545–553, 2007. 2
[17] T. Shiratori, Y. Matsushita, S. B. Kang, and X. Tang. Video completion by motion field transfer. CVPR, 2006. 2
[18] O. Stanley and F. Ronald. Level set methods and dynamic implicit surfaces. Springer-Verlag, ISBN 0-387-95482-1, 2002. 4
[19] M. Subbarao. Depth recovery from blurred edges. CVPR, 1988. 5
[20] R. Tan. Visibility in bad weather from a single image. CVPR, 2008. 2
[21] Y. Wexler, E. Shechtman, and M. Irani. Space-time video completion. CVPR, 2004. 2, 6, 8
[22] A. Yamashita, I. Fukuchi, and T. Kaneko. Noises removal from image sequences acquired with moving camera by estimating camera motion from spatio-temporal information. IROS, 2009. 2, 5, 6
[23] A. Yamashita, Y. Tanaka, and T. Kaneko. Removal of adherent waterdrops from images acquired with stereo camera. IROS, 2005. 2, 6 1 1 10 0 04 4 402 0