cvpr cvpr2013 cvpr2013-354 cvpr2013-354-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers
Abstract: We introduce the concept of relative volume constraints in order to account for insufficient information in the reconstruction of 3D objects from a single image. The key idea is to formulate a variational reconstruction approach with shape priors in form of relative depth profiles or volume ratios relating object parts. Such shape priors can easily be derived either from a user sketch or from the object’s shading profile in the image. They can handle textured or shadowed object regions by propagating information. We propose a convex relaxation of the constrained optimization problem which can be solved optimally in a few seconds on graphics hardware. In contrast to existing single view reconstruction algorithms, the proposed algorithm provides substantially more flexibility to recover shape details such as self-occlusions, dents and holes, which are not visible in the object silhouette.
[1] L. Ambrosio, N. Fusco, and D. Pallara. Functions of bounded variation and free discontinuity problems. Oxford Mathematical Monographs. The Clarendon Press Oxford University Press, New York, 2000. 3
[2] J. T. Barron and J. Malik. Color constancy, intrinsic images, and shape estimation. In Europ. Conf. on Computer Vision, pages 57–70, 2012. 1, 2
[3] Y. Chen and R. Cipolla. Single and sparse view 3d reconstruction by learning shape priors. Comput. Vis. Image Underst., 115:586–602, 2011. 1
[4] C. Colombo, A. D. Bimbo, A. Del, and F. Pernici. Metric 3d reconstruction and texture acquisition of surfaces of revolution from a single uncalibrated view. IEEE Transact. on Pattern Analysis and Machine Intelligence, 27:99–1 14, 2005. 1
[5] A. Criminisi, I. Reid, and A. Zisserman. Single view metrology. Int. J. Comput. Vision, 40(2): 123–148, 2000. 1, 2 111888333 a) Image b) Toeppe et al. [14] c) Reconstructions with volume ratio constraints Figure 7. 3D reconstruction results a) without further constraints [14] and b) with application of volume ratio constraints. Relative depth profiles are marked in red (location) and pink (depth function).
[6] D. Hoiem, A. A. Efros, and M. Hebert. Automatic photo pop-up. ACM Trans. Graph., 24(3):577–584, 2005. 2
[7] Y. Horry, K.-I. Anjyo, and K. Arai. Tour into the picture: using a spidery mesh interface to make animation from a single image. In SIGGRAPH ’97, pages 225–232, New York, NY, USA, 1997. ACM Press/Addison-Wesley Publishing Co. 2
[8] T. Igarashi, S. Matsuoka, and H. Tanaka. Teddy: a sketching interface for 3d freeform design. In SIGGRAPH ’99, pages 409–416, 1999. 2
[9] C. Nieuwenhuis and D. Cremers. Spatially varying color distributions for interactive multi-label segmentation. IEEE Trans. on Patt. Anal. and Mach. Intell., 35(5): 1234–1247, 2013. 3
[10] M. R. Oswald, E. Toeppe, and D. Cremers. Fast and globally optimal single view reconstruction of curved objects. In Int. Conf. on Computer Vision and Pattern Recognition, pages 534–541, 2012. 1
[11] T. Pock, D. Cremers, H. Bischof, and A. Chambolle. An algorithm for minimizing the piecewise smooth mumford-shah functional. In IEEE Int. Conf. on Computer Vision, 2009. 5
[12] M. Prasad, A. Zisserman, and A. W. Fitzgibbon. Single view reconstruction of curved surfaces. In CVPR, pages 1345– 1354, 2006. 1, 2, 7
[13] D. Terzopoulos, A. Witkin, and M. Kass. Symmetry-seeking models and 3d object reconstruction. Int. J. of Computer Vision, 1:211–221, 1987. 2
[14] E. Toeppe, M. R. Oswald, D. Cremers, and C. Rother. Imagebased 3d modeling via cheeger sets. In Asian Conference on Computer Vision (ACCV), pages 53–64, 2010. 1, 2, 3, 6, 7, 8
[15] L. Zhang, G. Dugas-Phocion, J.-S. Samson, and S. M. Seitz. Single view modeling of free-form scenes. In Int. Conf. on Computer Vision and Pattern Recognition, pages 990–997, 2001. 1, 7 111888444