iccv iccv2013 iccv2013-370 iccv2013-370-reference knowledge-graph by maker-knowledge-mining

370 iccv-2013-Saliency Detection in Large Point Sets


Source: pdf

Author: Elizabeth Shtrom, George Leifman, Ayellet Tal

Abstract: While saliency in images has been extensively studied in recent years, there is very little work on saliency of point sets. This is despite the fact that point sets and range data are becoming ever more widespread and have myriad applications. In this paper we present an algorithm for detecting the salient points in unorganized 3D point sets. Our algorithm is designed to cope with extremely large sets, which may contain tens of millions of points. Such data is typical of urban scenes, which have recently become commonly available on the web. No previous work has handled such data. For general data sets, we show that our results are competitive with those of saliency detection of surfaces, although we do not have any connectivity information. We demonstrate the utility of our algorithm in two applications: producing a set of the most informative viewpoints and suggesting an informative city tour given a city scan.


reference text

[1] O. Akman and P. Jonker. Computing saliency map from spatial information in point cloud data. In Advanced Concepts for Intelligent Vision Systems, pages 290–299, 2010. 1

[2] A. Borji, S. D. N., and L. Itti. Salient object detection: A benchmark. In ECCV, pages 414 –429, 2012. 1

[3] D. Borrmann and J. Elseberg. http://kos.informatik.uniosnabrueck.de/3Dscans. 1, 5

[4] U. Castellani, M. Cristani, S. Fantoni, and V. Murino. Sparse points matching by combining 3d mesh saliency with statistical descriptors. CGF, 27(2):643–652, 2008. 5

[5] X. Chen, A. Saparov, B. Pang, and T. Funkhouser. Schelling points on 3D surface meshes. ACM Transactions on Graphics, 31(4):29, 2012. 1

[6] H. Dutagaci, C. Cheung, and A. Godil. Evaluation of 3D interest point detection techniques via human-generated ground truth. The Visual Computer, 28:901–917, 2012. 5

[7] R. Gal and D. Cohen-Or. Salient geometric features for partial shape matching and similarity. ACM Transactions on Graphics, 25(1): 150, 2006. 1

[8] A. Godil and A. I. Wagan. Salient local 3d features for 3d shape retrieval. In IS&T;/SPIE Electronic Imaging, pages 78640S–78640S, 2011. 5

[9] S. Goferman, L. Zelnik-Manor, and A. Tal. Context-Aware

[10]

[11]

[12]

[13]

[14]

[15]

[16]

[17]

[18]

[19]

[20]

[21] Saliency Detection. In CVPR, pages 2376–2383, 2010. 1, 4 K. Grill-Spector and R. Malach. The human visual cortex. Annu. Rev. Neurosci., 27:649–677, 2004. 2 X. Hou and L. Zhang. Dynamic visual attention: Searching for coding length increments. Advances in neural information processing systems, 21:681–688, 2008. 1 L. Itti, C. Koch, and E. Niebur. A Model of Saliency-Based Visual Attention for Rapid Scene Analysis. PAMI, pages 1254–1259, 1998. 1 A. Johnson and M. Hebert. Using spin images for efficient object recognition in cluttered 3D scenes. PAMI, 21(5):433– 449, 1999. 3 T. Judd, K. Ehinger, F. Durand, and A. Torralba. Learning to predict where humans look. In ICCV, pages 2106–21 13, 2010. 1 S. Katz, A. Tal, and R. Basri. Direct Visibility of Point Sets. ACM Transactions on Graphics, 26(3):24: 1–1 1, 2007. 6 G. Kim, D. Huber, and M. Hebert. Segmentation of salient regions in outdoor scenes using imagery and 3D data. In Workshop on Applications of Computer Vision, 2008. 1 C. Lee, A. Varshney, and D. Jacobs. Mesh saliency. ACM Transactions on Graphics, 24(3):659–666, 2005. 1, 5 G. Leifman, E. Shtrom, and A. Tal. Surface regions of interest for viewpoint selection. In CVPR, pages 414 –421, 2012. 5, 6, 7 V. Mahadevan and N. Vasconcelos. Spatiotemporal saliency in dynamic scenes. PAMI, 32(1): 171–177, 2010. 1 J. Novatnack and K. Nishino. Scale-dependent 3d geometric features. In ICCV, pages 1–8. IEEE, 2007. 5 I. Pratikakis, M. Spagnuolo, T. Theoharis, and R. Veltkamp. A robust 3d interest points detector based on harris operator.

[22]

[23]

[24]

[25]

[26]

[27]

[28]

[29] In Eurographics Workshop on 3D Object Retrieval, 2010. 5 D. Rudoy, D. Goldman, E. Shechtman, and L. Zelnik-Manor. Learning video saliency from human gaze using candidate selection. In CVPR, 2013. 1 R. Rusu and S. Cousins. 3D is here: Point cloud library (PCL). In ICRA, pages 1–4, 2011. 7 R. B. Rusu, N. Blodow, and M. Beetz. Fast Point Feature Histograms (FPFH) for 3D Registration. In ICRA, 2009. 3 H. J. Seo and P. Milanfar. Static and space-time visual saliency detection by self-resemblance. Journal of vision, 9(12): 171–177, 2009. 1 J. Sun, M. Ovsjanikov, and L. Guibas. A concise and provably informative multi-scale signature based on heat diffusion. CGF, 28(5): 1383–1392, 2009. 5 F. Tombari, S. Salti, and L. Di Stefano. Unique signatures of histograms for local surface description. In ECCV, 2010. 3 D. Walther and C. Koch. Modeling attention to salient protoobjects. Neural Networks, 19(9): 1395–1407, 2006. 1 Y. Yeshurun, R. Kimchi, G. Sha’shoua, and T. Carmel. Perceptual objects capture attention. Vision research, 49(10): 1329–1335, 2009. 2 33559981