iccv iccv2013 iccv2013-282 iccv2013-282-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Abdelaziz Djelouah, Jean-Sébastien Franco, Edmond Boyer, François Le_Clerc, Patrick Pérez
Abstract: In this paper, we address the problem of object segmentation in multiple views or videos when two or more viewpoints of the same scene are available. We propose a new approach that propagates segmentation coherence information in both space and time, hence allowing evidences in one image to be shared over the complete set. To this aim the segmentation is cast as a single efficient labeling problem over space and time with graph cuts. In contrast to most existing multi-view segmentation methods that rely on some form of dense reconstruction, ours only requires a sparse 3D sampling to propagate information between viewpoints. The approach is thoroughly evaluated on standard multiview datasets, as well as on videos. With static views, results compete with state of the art methods but they are achieved with significantly fewer viewpoints. With multiple videos, we report results that demonstrate the benefit of segmentation propagation through temporal cues.
[1] R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Susstrunk. SLIC Superpixels Compared to State-of-theart Superpixel Methods. IEEE PAMI, 2012.
[2] X. Bai, J. Wang, D. Simons, and G. Sapiro. Video snapcut: robust video object cutout using localized classifiers. ACM Trans. Graph., 2009.
[3] D. Batra, A. Kowdle, D. Parikh, J. Luo, and T. Chen. icoseg: Interactive co-segmentation with intelligent scribble guidance. In CVPR, 2010.
[4] Y. Boykov and V. Kolmogorov. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE PAMI, 2004.
[5] I. Budvytis, V. Badrinarayanan, and R. Cipolla. Mixture of trees probabilistic graphical model for video segmentation. In BMVC’09.
[6] N. Campbell, G. Vogiatzis, C. Hernandez, and R. Cipolla. Automatic object segmentation from calibrated images. In Visual Media Production (CVMP), 2011.
[7] N. D. F. Campbell, G. Vogiatzis, C. Hern a´ndez, and R. Cipolla. Automatic 3d object segmentation in multiple views using volumetric graph-cuts. Image Vision Comput., 2010.
[8] A. Criminisi, G. Cross, A. Blake, and V. Kolmogorov. Bilayer segmentation of live video. In CVPR, 2006.
[9] A. Djelouah, J.-S. Franco, E. Boyer, F. L. Clerc, and P. P ´erez. N-tuple color segmentation for multi-view silhouette extraction. In ECCV, 2012.
[10] B. Goldl ¨ucke and M. A. Magnor. Joint 3d-reconstruction and background separation in multiple views using graph cuts. In CVPR, 2003.
[14] A. Joulin, F. R. Bach, and J. Ponce. Discriminative clustering for image co-segmentation. In CVPR, 2010.
[15] K. Kolev, T. Brox, and D. Cremers. Fast joint estimation of silhouettes and dense 3d geometry from multiple images. IEEE PAMI, 2011.
[16] A. Kowdle, S. N. Sinha, and R. Szeliski. Multiple view object cosegmentation using appearance and stereo cues. In ECCV, 2012.
[17] W. Lee, W. Woo, and E. Boyer. Silhouette Segmentation in Multiple Views. IEEE PAMI, 2010.
[18] S. Nobuhara, Y. Tsuda, I. Ohama, and T. Matsuyama. Multiviewpoint silhouette extraction with 3d context-aware error detection, correction, and shadow suppression. Information and Media Technologies, 2009.
[19] C. Reinbacher, M. Rother, and H. Bischof. Fast variational multi-view segmentation through backprojection of spatial constraints. Image and Vision Computing, 2012.
[20] C. Rother, V. Kolmogorov, and A. Blake. ”grabcut”: interactive foreground extraction using iterated graph cuts. In ACM
[21]
[22]
[23]
[24]
[25]
[26] SIGGRAPH, 2004. C. Rother, T. Minka, A. Blake, and V. Kolmogorov. Cosegmentation of image pairs by histogram matching - incorporating a global constraint into mrfs. In CVPR, 2006. M. Sarim, A. Hilton, J.-Y. Guillemaut, H. Kim, and T. Takai. Wide-baseline multi-view video segmentation for 3d reconstruction. In 3DVP, 2010. N. Snavely, S. M. Seitz, and R. Szeliski. Modeling the world from internet photo collections. Int. J. Comput. Vision, 2008. M. Sormann, C. Zach, and K. Karner. Graph cut based multiple view segmentation for 3d reconstruction. In 3DPVT, 2006. S. Vicente, C. Rother, and V. Kolmogorov. Object cosegmentation. In CVPR, 2011. J. Wang, P. Bhat, R. A. Colburn, M. Agrawala, and M. F. Cohen. Interactive video cutout. ACM Trans. Graph., 2005. [1 ]tJia.ot-niYo.sn.G IauJniCldVer,me2ca0ou1nts1.atrnudctAio.nHfiolrtofnre. -Jvoienwtpmouinlti-vlaidye orsaepgpmliecna-
[27]T of.raWlnasbanaelgctin aogn dspJroi.Pon.rMsCfuo ltriom coeodhseiasr,e 2.nt0P1rvo2ibd.aeboilsiestgimcmenotaito n d.ifuIEsiEoEn
[132]ncaDNion.z-deSsHd ea.gsm HlPeo. rSv,nchietBnabd.gioRueclnmo.as MeIan rhIdaCkshVe.CnrIlV,enSTs,Ci2n.mV0gTPho9.Rtio,rAmn20a¨ch el9pf.tnuic,reMwn.tiWahlgunodrs,iytJhn.mcGharflo-, [298]iJGgm.atXiZgoaenosf,go Jrfa. mnWdualLntig.pk,lQnePou.wvaTineaw.nb,saSceiklgnhmdorueLn.t Qaedtiu.oeaIxn t.rAaInJcCotIiConVtCa,Vf2r0,oi2nm0i4ty.m7pu.rlotipae2647