iccv iccv2013 iccv2013-404 iccv2013-404-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Piotr Dollár, C. Lawrence Zitnick
Abstract: Edge detection is a critical component of many vision systems, including object detectors and image segmentation algorithms. Patches of edges exhibit well-known forms of local structure, such as straight lines or T-junctions. In this paper we take advantage of the structure present in local image patches to learn both an accurate and computationally efficient edge detector. We formulate the problem of predicting local edge masks in a structured learning framework applied to random decision forests. Our novel approach to learning decision trees robustly maps the structured labels to a discrete space on which standard information gain measures may be evaluated. The result is an approach that obtains realtime performance that is orders of magnitude faster than many competing state-of-the-art approaches, while also achieving state-of-the-art edge detection results on the BSDS500 Segmentation dataset and NYU Depth dataset. Finally, we show the potential of our approach as a general purpose edge detector by showing our learned edge models generalize well across datasets.
[1] P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik. Contour detection and hierarchical image segmentation. PAMI, 33, 2011. 1, 2, 4, 6
[2] M. Blaschko and C. Lampert. Learning to localize objects with structured output regression. In ECCV, 2008. 2
[3] K. Bowyer, C. Kranenburg, and S. Dougherty. Edge detector evaluation using empirical roc curves. Computer Vision and Image Understanding, 84(1):77–103, 2001. 2
[4] L. Breiman, J. Friedman, C. J. Stone, and R. A. Olshen. Classiffication and Regression Trees. Chapman and Hall/CRC, 1984. 2, 3
[5] J. Canny. A computational approach to edge detection. PAMI, 8(6):679–698, November 1986. 1, 2, 6
[6] B. Catanzaro, B.-Y. Su, N. Sundaram, Y. Lee, M. Murphy, and K. Keutzer. Efficient, high-quality image contour detection. In ICCV, 2009. 2, 6
[7] A. Criminisi, J. Shotton, and E. Konukoglu. Decision forests: A unified framework for classification, regression, density estimation, manifold learning and semi-supervised learning. Foundations and Trends in Computer Graphics and Vision, 7(2-3):81–227, February 2012. 2, 3, 4
[8] P. Doll a´r, S. Belongie, and P. Perona. The fastest pedestrian detector in the west. In BMVC, 2010. 5
[9] P. Doll a´r, Z. Tu, and S. Belongie. Supervised learning of edges and object boundaries. In CVPR, 2006. 1, 2, 6
[10] R. O. Duda, P. E. Hart, et al. Pattern classification and scene analysis, volume 3. Wiley New York, 1973. 1, 2
[11] P. F. Felzenszwalb and D. P. Huttenlocher. Efficient graphbased image segmentation. IJCV, 59(2): 167–181, 2004. 6
[12] V. Ferrari, L. Fevrier, F. Jurie, and C. Schmid. Groups of adjacent contour segments for object detection. PAMI, 30(1):36–51, 2008. 1
[13] J. R. Fram and E. S. Deutsch. On the quantitative evaluation of edge detection schemes and their comparison with human performance. IEEE TOC, 100(6), 1975. 1, 2
[14] W. T. Freeman and E. H. Adelson. The design and use of steerable filters. PAMI, 13:891–906, 1991 . 1, 2
[15] P. Geurts, D. Ernst, and L. Wehenkel. Extremely randomized trees. Machine Learn, 63(1):3–42, Apr. 2006. 2, 3
[16] R. Hidayat and R. Green. Real-time texture boundary detection from ridges in the standard deviation space. In BMVC, 2009. 6
[17] T. K. Ho. The random subspace method for constructing decision forests. PAMI, 20(8):832–844, 1998. 3
[18] I. T. Joliffe. Principal Component Analysis. Springer-Verlag, 1986. 4
[19] M. Kass, A. Witkin, and D. Terzopoulos. Snakes: Active contour models. IJCV, 1(4):321–33 1, 1988. 1
[20] P. Kontschieder, S. Bulo, H. Bischof, and M. Pelillo. Structured class-labels in random forests for semantic image labelling. In ICCV, 2011. 1, 2, 3, 4
[21] J. Lim, C. L. Zitnick, and P. Doll a´r. Sketch tokens: A learned mid-level representation for contour and object detection. In CVPR, 2013. 1, 2, 4, 5, 6
[22] J. Mairal, M. Leordeanu, F. Bach, M. Hebert, and J. Ponce. Discriminative sparse image models for class-specific edge detection and image interpretation. In ECCV, 2008. 2
[23] J. Malik, S. Belongie, T. Leung, and J. Shi. Contour and texture analysis for image segmentation. IJCV, 43, 2001 . 1
[24] D. Martin, C. Fowlkes, and J. Malik. Learning to detect natural image boundaries using local brightness, color, and tex-
[25]
[26]
[27]
[28]
[29]
[30] [3 1]
[32]
[33]
[34]
[35]
[36]
[37] ture cues. PAMI, 26(5):530–549, 2004. 1, 2 D. Martin, C. Fowlkes, D. Tal, and J. Malik. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In ICCV, 2001. 6 S. Nowozin and C. H. Lampert. Structured learning and prediction in computer vision. Foundations and Trends in Computer Graphics and Vision, 6: 185–365, 2011. 1, 2 P. Perona and J. Malik. Scale-space and edge detection using anisotropic diffusion. PAMI, 12(7):629–639, 1990. 2 X. Ren. Multi-scale improves boundary detection in natural images. In ICCV, 2008. 5 X. Ren, C. Fowlkes, and J. Malik. Scale-invariant contour completion using cond. random fields. In ICCV, 2005. 1 X. Ren, C. Fowlkes, and J. Malik. Figure/ground assignment in natural images. In ECCV, 2006. 1, 2 X. Ren and B. Liefeng. Discriminatively trained sparse code gradients for contour detection. In NIPS, 2012. 1, 2, 5, 6 G. S. Robinson. Color edge detection. Optical Engineering, 16(5), 1977. 1 N. Silberman and R. Fergus. Indoor scene segmentation using a structured light sensor. In ICCV Workshop on 3D Representation and Recognition, 2011. 2, 4, 6 B. Taskar, V. Chatalbashev, D. Koller, and C. Guestrin. Learning structured prediction models: a large margin approach. In ICML, 2005. 2 I. Tsochantaridis, T. Hofmann, T. Joachims, and Y. Altun. Learning for interdependent and structured output spaces. In ICML, 2004. 2 S. Ullman and R. Basri. Recognition by linear combinations of models. PAMI, 13(10), 1991 . 1 S. Zheng, Z. Tu, and A. Yuille. Detecting object bound- aries using low-, mid-, and high-level information. In CVPR, 2007. 1, 2
[38] D. Ziou, S. Tabbone, et al. Edge detection techniques-an overview. Pattern Recognition and Image Analysis, 8:537– 559, 1998. 1, 2 11884488