cvpr cvpr2013 cvpr2013-27 cvpr2013-27-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Visesh Chari, Peter Sturm
Abstract: 3D reconstruction of transparent refractive objects like a plastic bottle is challenging: they lack appearance related visual cues and merely reflect and refract light from the surrounding environment. Amongst several approaches to reconstruct such objects, the seminal work of Light-Path triangulation [17] is highly popular because of its general applicability and analysis of minimal scenarios. A lightpath is defined as the piece-wise linear path taken by a ray of light as it passes from source, through the object and into the camera. Transparent refractive objects not only affect the geometric configuration of light-paths but also their radiometric properties. In this paper, we describe a method that combines both geometric and radiometric information to do reconstruction. We show two major consequences of the addition of radiometric cues to the light-path setup. Firstly, we extend the case of scenarios in which reconstruction is plausible while reducing the minimal re- quirements for a unique reconstruction. This happens as a consequence of the fact that radiometric cues add an additional known variable to the already existing system of equations. Secondly, we present a simple algorithm for reconstruction, owing to the nature of the radiometric cue. We present several synthetic experiments to validate our theories, and show high quality reconstructions in challenging scenarios.
[1] Photo-Light-Path Triangulation: Supplementary Material. http://www.di.ens.fr/chari/webpage/Research/phototechreport. 3, 4, 5
[2] D.G. Aliaga and Y. Xu. An adaptive correspondence algorithm for modeling scenes with strong interreflections. IEEE Transactions on Visualization and Computer Graphics, 15:465–480, 2009. 4, 6
[3] D.G. Aliaga and Y. Xu. A self-calibrating method for photogeometric acquisition of 3D objects. IEEE–PAMI, 32:747– 754, 2009. 5
[4] M. Ben-Ezra and S. Nayar. What Does Motion Reveal about Transparency? ICCV, 2:1025–1032, 2003. 2
[5] T. Chen, M. Goesele, and H.-P. Seidel. Mesostructure from specularity. CVPR, 2:1825–1832, 2006. 1
[6] A. Efros, V. Isler, J. Shi, and M. Visontai. Seeing through
[7]
[8]
[9]
[10]
[11]
[12]
[13]
[14]
[15]
[16]
[17] water. NIPS, 2004. 2 E. Hecht. Optics - 4th edition. Addison Wesley, 2002. M.B. Hullin, M. Fuchs, I. Ihrke, H.-P. Seidel, and H.P.A. Lensch. Fluorescent immersion range scanning. SIGGRAPH, 2008. 1, 2 C.P. Huynh, A. Robles-Kelly, and E.R. Hancock. Shape and refractive index recovery from single-view polarisation images. CVPR, 1229–1236, 2010. 2 I. Ihrke, K. N. Kutulakos, Hendrik P. A. Lensch, Marcus. A. Magnor, Wolfgang Heidrich. Transparent and Specular Object Reconsruction. Computer Graphics Forum, 2400– 2426, 2010. 1 D. Miyazaki and K. Ikeuchi. Shape estimation of transparent objects by using inverse polarization ray tracing. IEEE– PAMI, 29(1 1):2018–2030, 2007. 1, 2 D. Miyazaki, M. Kagesawa, and K. Ikeuchi. Transparent surface modeling by using a pair of polarization images. IEEE– PAMI, 26(1):73–82, 2004. 1 N. Morris and K. Kutulakos. Reconstructing the surface of inhomogeneous transparent scenes by scatter-trace photography. ICCV, 2007. 1, 2, 7 N. Morris and K. Kutulakos. Dynamic refraction stereo. IEEE–PAMI, 33(8): 1518–1531, 2011. 1 S.K. Nayar, G. Krishnan, M.D. Grossberg, and R. Raskar. Fast separation of direct and global components of a scene using high frequency illumination. SIGGRAPH, 2006. 6, 7, 8 M. Oren and S.K. Nayar. A theory of specular surface geometry. IJCV, 24(2):105–124, 1997. E. Steger and K. Kutulakos. A theory ofrefractive and specular 3D shape by light-path triangulation. IJCV, 76(1): 13–29,
[18]
[19]
[20]
[21] 2008. 1, 2, 3, 4, 5, 7 P. Sturm. Algorithms for plane based pose estimation. CVPR, 706–71 1, 2000. 5, 7 Y. Tian and S. Narasimhan. Seeing through water: Image restoration using model-based tracking. ICCV, 2303–23 10, 2009. 2 S.-K. Yeung, T.-P. Wu, C.-K. Tang, T.F. Chan, and S. Osher. Adequate reconstruction of transparent objects on a shoestring budget. CVPR, 2011. 1, 2 G. Wetzstein, G. Roodnick, W. Heidrich and R. Raskar. Refractive Shape from Light Field Distortion. ICCV, 2011. 2 111444444533