iccv iccv2013 iccv2013-446 iccv2013-446-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Shi Qiu, Xiaogang Wang, Xiaoou Tang
Abstract: This paper proposes modeling the complex web image collections with an automatically generated graph structure called visual semantic complex network (VSCN). The nodes on this complex network are clusters of images with both visual and semantic consistency, called semantic concepts. These nodes are connected based on the visual and semantic correlations. Our VSCN with 33, 240 concepts is generated from a collection of 10 million web images. 1 A great deal of valuable information on the structures of the web image collections can be revealed by exploring the VSCN, such as the small-world behavior, concept community, indegree distribution, hubs, and isolated concepts. It not only helps us better understand the web image collections at a macroscopic level, but also has many important practical applications. This paper presents two application examples: content-based image retrieval and image browsing. Experimental results show that the VSCN leads to significant improvement on both the precision of image retrieval (over 200%) and user experience for image browsing.
[1] S. Boccaletti, V. Latora, Y. Moreno, M. Chavez, and D.-U. Hwang. Complex networks: Structure and dynamics. Physics Reports, (45), 2006.
[2] G. Chechik, V. Sharma, U. Shalit, and S. Bengio. An online algorithm for large scale image similarity learning. In Proc. NIPS, 2009.
[3] J. Cui, F. Wen, and X. Tang. Intentsearch: interactive on-line image search re-ranking. In Proc. ACM MM, 2008. 4In ANOVA, a smaller p-value indicates larger Normally, p < 0.01 is considered significant. statistical significance.
[4] J. Cui, F. Wen, and X. Tang. Real time google and live image search re-ranking. In Proc. ACM MM, 2008.
[5] J. Deng, A. Berg, and L. Fei-Fei. Hierarchical semantic indexing for large scale image retrieval. In Proc. CVPR, 2011.
[6] J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In Proc. CVPR, 2009.
[7] M. Douze, A. Ramisa, and C. Schmid. Combining attributes and fisher vectors for efficient image retrieval. In Proc. CVPR, 2011.
[8] Y. Gong and S. Lazebnik. Iterative quantization: A procrustean approach to learning binary codes. In Proc. CVPR, 2011.
[9] D. Howell. Statistical methods for psychology. Wadsworth Pub Co, 2009.
[10] H. J ´egou, M. Douze, C. Schmid, and P. P ´erez. Aggregating local descriptors into a compact image representation. In Proc. CVPR, 2010.
[11] A. Langville and C. Meyer. Deeper inside pagerank. Internet Mathematics, 1:335–380, 2004.
[12] D. Lewandowski. Search engine user behaviour: How can users be guided to
[13]
[14]
[15]
[16]
[17]
[18]
[19]
[20]
[21]
[22]
[23]
[24]
[25]
[26]
[27]
[28] quality content? Information Sevices & Use, 2008(28), 2008. H. Liu, X. Xie, X. Tang, Z.-W. Li, and W.-Y. Ma. Effective browsing of web image search results. In Proc. ACM MIR, 2004. Y. Lu, L. Zhang, J. Liu, and Q. Tian. Constructing concept lexica with small semantic gaps. TMM, 2010. G. Manku, A. Jain, and A. Das Sarma. Detecting near-duplicates for web crawling. In Proc. WWW, 2007. D. Nister and H. Stewenius. Scalable recognition with a vocabulary tree. In Proc. CVPR, 2006. S. Qiu, X. Wang, and X. Tang. Anchor concept graph distance for web image re-ranking. In Proc. ACM MM, 2013. M. Sahami and T. D. Heilman. A web-based kernel function for measuring the similarity of short text snippets. In Proc. WWW, 2006. X. Tang, K. Liu, J. Cui, F. Wen, and X. Wang. Intentsearch: Capturing user intention for one-click internet image search. TPAMI, 2012. A. Torralba, R. Fergus, and W. T. Freeman. 80 million tiny images: A large data set for nonparametric object and scene recognition. TPAMI, 2008. D. Tsai, Y. Jing, Y. Liu, H. Rowley, S. Ioffe, and J. Rehg. Large-scale image annotation using visual synset. In Proc. ICCV, 2011. N. Verma, D. Mahajan, S. Sellamanickam, and V. Nair. Learning hierarchical similarity metrics. In Proc. CVPR, 2012. S. Wang, F. Jing, J. He, Q. Du, and L. Zhang. Igroup: presenting web image search results in semantic clusters. In Proc. ACM SIGCHI, 2007. X. Wang, K. Liu, and X. Tang. Query-specific visual semantic spaces for web image re-ranking. In Proc. CVPR, 2011. X. Wang, S. Qiu, K. Liu, and X. Tang. Web image re-ranking using queryspecific semantic signatures. TPAMI, 2013. X.-J. Wang, Z. Xu, L. Zhang, C. Liu, and Y. Rui. Towards indexing representative images on the web. In Proc. ACM MM, 2012. Z. Wu, Q. Ke, M. Isard, and J. Sun. Bundling features for large scale partialduplicate web image search. In Proc. CVPR, 2009. W. Zhang, X. Wang, D. Zhao, and X. Tang. Graph degree linkage: Agglomerative clustering on a directed graph. In Proc. ECCV, 2012. 33662303