cvpr cvpr2013 cvpr2013-286 cvpr2013-286-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Miaomiao Liu, Richard Hartley, Mathieu Salzmann
Abstract: This paper tackles the problem of reconstructing the shape of a smooth mirror surface from a single image. In particular, we consider the case where the camera is observing the reflection of a static reference target in the unknown mirror. We first study the reconstruction problem given dense correspondences between 3D points on the reference target and image locations. In such conditions, our differential geometry analysis provides a theoretical proof that the shape of the mirror surface can be uniquely recovered if the pose of the reference target is known. We then relax our assumptions by considering the case where only sparse correspondences are available. In this scenario, we formulate reconstruction as an optimization problem, which can be solved using a nonlinear least-squares method. We demonstrate the effectiveness of our method on both synthetic and real images.
[1] Y. Adato, Y. Vasilyev, O. Ben-Shahar, and T. Zickler. Toward a theory of shape from specular flow. In ICCV, 2007.
[2] J. Balzer, S. H ¨ofer, and J. Beyerer. Multiview specular stereo reconstruction of large mirror surfaces. In CVPR, 2011.
[3] T. Bonfort and P. Sturm. Voxel carving for specular surfaces. In ICCV, 2003.
[4] T. Bonfort, P. Sturm, and P. Gargallo. General Specular Surface Triangulation. In ACCV, 2006.
[5] G. D. Canas, Y. Vasilyev, Y. Adato, T. Zickler, S. Gortler, and O. Ben-Shahar. A linear formulation of shape from specular flow. In Proc. ICCV, 2009.
[6] N. L. Earl A. Coddington. Theory of ordinary differential equations. McGraw-Hill, 1955.
[7] D. F. M. Endre Sli. An Introduction to Numerical Analysis. Cambridge University Press, 2003.
[8] T. A. Fleming, R. W. and E. H. Adelson. Specular reflections and the perception of shape. Journal of Vision, 2004.
[9] M. A. Halstead, B. A. Barsky, S. A. Klein, and R. B. Mandell. Reconstructing curved surfaces from specular reflection patterns using spline surface fitting of normals. In SIGGRAPH, 1996.
[10] K. N. Kutulakos and E. Steger. A theory of refractive and specular 3d shape by light-path triangulation. IJCV, 2008.
[11] M. Liu, K.-Y. K. Wong, Z. Dai, and Z. Chen. Pose estimation from reflections for specular surface recovery. In ICCV, 2011.
[12] D. Nehab, T. Weyrich, and S. Rusinkiewicz. Dense 3d reconstruction from specularity consistency. In CVPR, 2008.
[13] M. Oren and S. K. Nayar. A theory of specular surface geometry. IJCV, 1997.
[14] S. Roth and M. J. Black. Specular flow and the recovery of surface structure. In CVPR, 2006.
[15] S. Rozenfeld, I. Shimshoni, and M. Lindenbaum. Dense mirroring surface recovery from 1d homographies and sparse correspondences. In CVPR, 2007.
[16] A. C. Sankaranarayanan, A. Veeraraghavan, O. Tuzel, and A. Agrawal. Specular surface reconstruction from sparse reflection correspondences. In CVPR, 2010.
[17] S. Savarese, M. Chen, and P. Perona. Local shape from mirror reflections. IJCV, 2005.
[18] M. Tarini, H. P. A. Lensch, M. Goesele, and H.-P. Seidel. 3d acquisition of mirroring objects using striped patterns. Graphical Models, 2005.
[19] Y. Vasilyev, T. Zickler, S. J. Gortler, and O. Ben-Shahar. Shape from specular flow: Is one flow enough? In CVPR, 2011.
[20] A. Zisserman, P. Giblin, and A. Blake. The information available to a moving observer from specularities. IVC, 1989. 111333666