iccv iccv2013 iccv2013-208 iccv2013-208-reference knowledge-graph by maker-knowledge-mining

208 iccv-2013-Image Co-segmentation via Consistent Functional Maps


Source: pdf

Author: Fan Wang, Qixing Huang, Leonidas J. Guibas

Abstract: Joint segmentation of image sets has great importance for object recognition, image classification, and image retrieval. In this paper, we aim to jointly segment a set of images starting from a small number of labeled images or none at all. To allow the images to share segmentation information with each other, we build a network that contains segmented as well as unsegmented images, and extract functional maps between connected image pairs based on image appearance features. These functional maps act as general property transporters between the images and, in particular, are used to transfer segmentations. We define and operate in a reduced functional space optimized so that the functional maps approximately satisfy cycle-consistency under composition in the network. A joint optimization framework is proposed to simultaneously generate all segmentation functions over the images so that they both align with local segmentation cues in each particular image, and agree with each other under network transportation. This formulation allows us to extract segmentations even with no training data, but can also exploit such data when available. The collective effect of the joint processing using functional maps leads to accurate information sharing among images and yields superior segmentation results, as shown on the iCoseg, MSRC, and PASCAL data sets.


reference text

[1] http://sedumi.ie.lehigh.edu/. 5

[2] M. Ankerst, G. Kastenmller, H.-P. Kriegel, and T. Seidl. 3D shape histograms for similarity search and classification in spatial databases. LNCS, 1651:207–226, 1999. 7

[3] D. Batra, A. Kowdle, D. Parikh, J. Luo, and T. Chen. iCoseg: Interactive co-segmentation with intelligent scribble guidance. In CVPR, 2010. 2, 6

[4] A. Berg, T. Berg, and J. Malik. Shape matching and object recognition using low distortion correspondence. In CVPR, 2005. 2

[5] K.-Y. Chang, T.-L. Liu, and S.-H. Lai. From co-saliency to cosegmentation: An efficient and fully unsupervised energy minimization model. In CVPR, 2011. 2

[6] R. R. Coifman and S. Lafon. Diffusion maps. Applied and Computational Harmonic Analysis, 21(1):5–30, 2006. 2

[7] O. Duchenne, A. Joulin, and J. Ponce. A graph-matching kernel for object categorization. In ICCV, 2011. 2

[8] M. Everingham, L. V. Gool, C. K. Williams, J. Winn, and A. Zisserman. The PASCAL visual object classes (VOC) challenge. IJCV, 88:303–338, 2010. 2

[9] D. S. Hochbaum and V. Singh. An efficient algorithm for cosegmentation. In ICCV, 2009. 2

[10] A. Joulin, F. Bach, and J. Ponce. Discriminative clustering for image co-segmentation. In CVPR, 2010. 1, 2, 6, 7, 8

[11] D. Kuettel and V. Ferrari. Figure-ground segmentation by transferring window masks. In CVPR, 2012. 2

[12] D. Kuettel, M. Guillaumin, and V. Ferrari. Segmentation propagation

[13]

[14]

[15]

[16]

[17]

[18]

[19]

[20]

[21]

[22]

[23]

[24]

[25] in ImageNet. In ECCV, 2012. 2, 6, 7, 8 M. Leordeanu and M. Hebert. A spectral technique for correspondence problems using pairwise constraints. In ICCV, 2005. 2 L. Mukherjee, V. Singh, and C. R. Dryer. Scale invariant cosegmentation for image groups. In CVPR, 2011. 2 A. Oliva and A. Torralba. Modeling the shape of the scene: a holistic representation of the spatial envelope. IJCV, 42(3): 145–175, 2001 . 4 M. Ovsjanikov, M. Ben-Chen, J. Solomon, A. Butscher, and L. Guibas. Functional maps: A flexible representation of maps between shapes. In SIGGRAPH, 2012. 1, 2, 3 R. Roberts, S. N. Sinha, R. Szeliski, and D. Steedly. Structure from motion for scenes with large duplicate structures. In CVPR, pages 3137–3144, 2011. 2 C. Rother, V. Kolmogorov, T. Minka, and A. Blake. Cosegmentation of image pairs by histogram matching - incorporating a global constraint into MRFs. In CVPR, 2006. 2 J. C. Rubio, J. Serrat, A. Lopez, and N. Paragios. Unsupervised cosegmentation through region matching. In CVPR, 2012. 1, 2, 6, 7, 8 J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE TPAMI, 22:888–905, 2000. 3, 4, 6 J. Shotton, J. Winn, C. Rother, and A. Criminisi. TextonBoost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation. In ECCV, 2006. 2 A. Singer and H.-T. Wu. Vector diffusion maps and the connection Laplacian. CPAM, 65(8): 1067–1 144, 2012. 2 L. Torresani, V. Kolmogorov, and C. Rother. Feature correspondence via graph matching: Models and global optimization. In ECCV, 2008. 2 S. Vicente, C. Rother, and V. Kolmogorov. Object cosegmentation. In CVPR, 2011. 1, 2, 6, 7, 8 C. Zach, M. Klopschitz, and M. Pollefeys. Disambiguating visual relations using loop constraints. In CVPR, 2010. 2 885566