cvpr cvpr2013 cvpr2013-21 cvpr2013-21-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Thoma Papadhimitri, Paolo Favaro
Abstract: We investigate the problem of reconstructing normals, albedo and lights of Lambertian surfaces in uncalibrated photometric stereo under the perspective projection model. Our analysis is based on establishing the integrability constraint. In the orthographicprojection case, it is well-known that when such constraint is imposed, a solution can be identified only up to 3 parameters, the so-called generalized bas-relief (GBR) ambiguity. We show that in the perspective projection case the solution is unique. We also propose a closed-form solution which is simple, efficient and robust. We test our algorithm on synthetic data and publicly available real data. Our quantitative tests show that our method outperforms all prior work of uncalibrated photometric stereo under orthographic projection.
[1] A. Agrawal, R. Chellappa, and R. Raskar. An algebraic approach to surface reconstruction from gradient fields. In Proceedings of the Tenth IEEEInternational Conference on Computer Vision (ICCV’05) Volume 1- Volume 01, ICCV ’05, pages 174–181, Washington, DC, USA, 2005. IEEE Computer Society. 2
[2] A. Agrawal and R. Raskar. What is the range of surface reconstruc-
[3]
[4]
[5]
[6]
[7]
[8]
[9]
[10]
[11]
[12]
[13] tions from a gradient field. In In ECCV, pages 578–591. Springer, 2006. 5, 6 N. Alldrin, S. Mallick, and D. Kriegman. Resolving the generalized bas-relief ambiguity by entropy minimization. Computer Vision and Pattern Recognition, pages 1–7, 17-22 2007. 1, 2, 5, 6, 7 R. Basri and D. Jacobs. Photometric stereo with general, unknown lighting. IEEE Conference on Computer Vision and Pattern Recognition, pages II:374–381, 2001. 2 P. N. Belhumeur, D. J. Kriegman, and A. L. Yuille. The bas-relief ambiguity. Int’l Journal of Computer Vision, pages 35(1):33–44, 1999. 1, 2, 4 M. K. Chandraker, F. Kahl, and D. J. Kriegman. Reflections on the generalized bas-relief ambiguity. In Conference on Computer Vision and Pattern Recognition, pages 788–795, 2005. 2 F. Courteille, A. Crouzil, J. denis Durou, and P. Gurdjos. Towards shape from shading under realistic photographic conditions. In Proceedings of the 17th International Conference on Pattern Recognition - ICPR 2004, vol.2, pages 277–280, 2004. 1 O. Drbohlav. Towards uncalibrated photometric stereo for nonlambertian surfaces. PhD Thesis: Center for Machine Perception (CMP), Czech Technical University, Prague, Czech Republic, 2003. 5 O. Drbohlav and M. Chantler. Can two specular pixels calibrate photometric stereo? Proc. of Int’l Conf. on Computer Vision, pages 1850–1857, 2005. 1, 2 H. Du, D. Goldman, and S. Seitz. Binocular photometric stereo. In Proceedings of British Machine Vision Conference (BMVC), 2011. 2 P. Favaro and T. Papadhimitri. A closed-form solution to uncalibrated photometric stereo via diffuse maxima. IEEE Conference on Computer Vision and Pattern Recognition, 2012. 1, 2, 6, 7 M. Galo and C. Tozzi. Surface reconstruction using multiple light sources and perspective projection. In Image Processing, 1996. Proceedings., International Conference on, volume 1, pages 309 –312 vol.2, sep 1996. 1 A. Georghiades. Incorporating the torrance and sparrow model of reflectance in uncalibrated photometric stereo. Proc. of Int’l Conf.
[14]
[15]
[16]
[17]
[18]
[19] on Computer Vision, pages 816–823, 2003. 1, 2 H. Hayakawa. Photometric stereo under a light-source with arbitrary motion. Journal of the Optical Society of America, 11(11):3079– 3089, 1994. 2, 4 A. Hertzmann and S. Seitz. Example-based photometric stereo: Shape reconstruction with general, varying brdfs. Pattern Analysis and Machine Intelligence, 27(8): 1254–1264, 2005. 2 H. P. K. Sunkavalli, T. Zickler. Visibility subspaces: uncalibrated photometric stereo with shadows. European Conference on Computer Vision, Part II, pages 251–264, 2010. 2 K. Kondo, Y. Mukaigawa, and Y. Yagi. Free-Form Mirror Design Inspired by Photometric Stereo. In The 8th Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras - OMNIVIS, 2008. 2, 4 D. J. Kriegman and P. N. Belhumeur. What shadows reveal about object structure. Journal of the Optical Society of America, 18:2001, 1998. 2 K. M. Lee and C.-C. Kuo. Shape from photometric ratio and stereo. Journal of Visual Communication and Image Representation, 7(2):155 162, 1996. 2 Z. Lin, M. Chen, and Y. Ma. The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices. UIUC Technical Report UILU-ENG-09-2215, 2009. 6 D. Nehab, S. Rusinkiewicz, J. Davis, and R. Ramamoorthi. Efficiently combining positions and normals for precise 3D geometry. ACM Transactions on Graphics (Proc. of ACM SIGGRAPH 2005), 24(3), Aug. 2005. 2 T. Okabe, I. Sato, and Y. Sato. Attached shadow coding: Estimating surface normals from shadows under unknown reflectance and lighting conditions. Proc. of Int’l Conf. on Computer Vision, pages 1693–1700, 2009. 2 E. Prados and O. Faugeras. Perspective shape from shading and viscosity solutions. In International Conference on Computer Vision, 2003. 1, 4, 5 I. Sato, T. Okabe, Q. Yu, and Y. Sato. Shape reconstruction based on similarity in radiance changes under varying illumination. Proc. of –
[20]
[21]
[22]
[23]
[24]
[25]
[26]
[27]
[28]
[29]
[30]
[31]
[32]
[33]
[34]
[35] Int’l Conf. on Computer Vision, pages 1–8, 14-21 2007. 2 B. Shi, Y. Matsushita, Y. Wei, C. Xu, and P. Tan. Self-calibrating photometric stereo. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1118–1 125, 2010. 1, 2, 6, 7 P. Tan, S. Mallick, L. Quan, D. Kriegman, and T. Zickler. Isotropy, reciprocity and the generalized bas-relief ambiguity. In Computer Vision and Pattern Recognition Conference, pages 1–8, 17-22 2007. 1, 2 P. Tan and T. Zickler. A projective framework for radiometric image analysis. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 2977–2984, 2009. 2 A. Tankus and N. Kiryati. Photometric stereo under perspective projection. International Conference of Computer Vision, pages I: 611 616, 2005. 1, 2, 3, 4, 5 A. Tankus, N. Sochen, and Y. Yeshurun. Shape-from-shading under perspective projection. International Conference of Computer Vision, 2004. 1, 4, 5 R. Woodham. Photometric method for determining surface orientation from multiple images. Optical Engineering, 19(1): 139–144, 1980. 1 C. Wu, S. G. Narasimhan, and B. Jaramza. A multi-image shapefrom-shading framework for near-lighting perspective endoscopes. International Journal of Computer Vision, 2009. 2 L. Wu, A. Ganesh, B. Shi, Y. Matsushita, Y. Wang, and Y. Ma. Robust photometric stereo via low-rank matrix completion and recovery. In Asian Conference on Computer Vision, pages 703–717, 2011. 6 A. Yuille and D. Snow. Shape and albedo from multiple images using integrability. Computer Vision and Pattern Recognition, pages 158– 164, 1997. 1 Q. Zhang, M. Ye, R. Yang, Y. Matsushita, B. Wilburn, and H. Yu. Edge-preserving photometric stereo via depth fusion. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 2472 –2479, june 2012. 2 Z. Zhou and P. Tan. Ring-light photometric stereo. In Proceedings of the 11th European conference on Computer vision: Part II, ECCV’ 10, pages 265–279, Berlin, Heidelberg, 2010. SpringerVerlag. 1, 2
[36] T. Zickler, P. Belhumeur, and D. Kriegman. Helmholtz stereopsis: Exploiting reciprocity for surface reconstruction. Int’l Journal of Computer Vision, 49(2-3):215–227, 2002. 2 111444778199