cvpr cvpr2013 cvpr2013-443 cvpr2013-443-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Feng Lu, Yasuyuki Matsushita, Imari Sato, Takahiro Okabe, Yoichi Sato
Abstract: We propose an uncalibrated photometric stereo method that works with general and unknown isotropic reflectances. Our method uses a pixel intensity profile, which is a sequence of radiance intensities recorded at a pixel across multi-illuminance images. We show that for general isotropic materials, the geodesic distance between intensity profiles is linearly related to the angular difference of their surface normals, and that the intensity distribution of an intensity profile conveys information about the reflectance properties, when the intensity profile is obtained under uniformly distributed directional lightings. Based on these observations, we show that surface normals can be estimated up to a convex/concave ambiguity. A solution method based on matrix decomposition with missing data is developed for a reliable estimation. Quantitative and qualitative evaluations of our method are performed using both synthetic and real-world scenes.
[1] N. Alldrin and D. Kriegman. Toward reconstructing surfaces with arbitrary isotropic reflectance : A stratified photometric stereo approach. In Proc. of Int’l Conf. on Computer Vision (ICCV), pages 1–8, 2007. 2
[2] N. Alldrin, S. Mallick, and D. Kriegman. Resolving the generalized bas-relief ambiguity by entropy minimization. In Proc. ofIEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2007. 2
[3] N. Alldrin, T. Zickler, and D. Kriegman. Photometric stereo with non-parametric and spatially-varying reflectance. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pages 1–8, 2008. 2
[4] S. Barsky and M. Petrou. The 4-source photometric stereo technique for three-dimensional surfaces in the presence ofhighlights and shadows. IEEE Trans. on Pattern Analysis and Machine Intelligence, 25(10):1239–1252, 2003. 2
[5] R. Basri, D. Jacobs, and I. Kemelmacher. Photometric stereo with general, unknown lighting. Int’l Journal of Computer Vision, 72(3):239–257, 2007. 2
[6] P. N. Belhumeur, D. J. Kriegman, and A. L. Yuille. The bas-relief ambiguity. Int’l Journal of Computer Vision, 35(1):33–44, 1999. 2,
[7]
[8]
[9]
[10]
[11] 5 M. Chandraker, J. Bai, and R. Ramamoorthi. A theory of differential photometric stereo for unknown isotropic brdfs. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pages 2505–2512, 2011. 2 M. Chandraker, F. Kahl, and D. Kriegman. Reflections on the generalized bas-relief ambiguity. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pages 788–795, 2005. 2 H. Chung and J. Jia. Efficient photometric stereo on glossy surfaces with wide specular lobes. In Proc. of Int’l Conf. on Computer Vision (ICCV), pages 1–8, 2008. 2 O. Drbohlav and M. Chaniler. Can two specular pixels calibrate photometric stereo? In Proc. of Int’l Conf. on Computer Vision (ICCV), pages 1850–1857, 2005. 2 O. Drbohlav and R. Specularities reduce ambiguity of uncalibrated photometric stereo. In Proc. of European Conf. on Computer Vision (ECCV), pages 644–645, 2002. 2 ˇS´ ara. 111444999644 Figure 10. Real-world results. Rows: captured images; color-coded normal maps; depth maps via [20]; and two views of rendered surfaces.
[12] P. Favaro and T. Papadhimitri. A closed-form solution to uncalibrated
[13]
[14]
[15]
[16]
[17]
[18]
[19]
[20]
[21]
[24]
[25] photometric stereo via diffuse maxima. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pages 821–828, 2012. 2 A. Georghiades. Incorporating the torrance and sparrow model of reflectance in uncalibrated photometric stereo. In Proc. of Int’l Conf. on Computer Vision (ICCV), pages 816–823, 2003. 2 D. Goldman, B. Curless, A. Hertzmann, and S. Seitz. Shape and spatially-varying brdfs from photometric stereo. In Proc. of Int’l Conf. on Computer Vision (ICCV), pages 341–348, 2005. 2 H. Hayakawa. Photometric stereo under a light source with arbitrary motion. JOSA A, 11(11):3079–3089, 1994. 6 A. Hertzmann and S. Seitz. Example-based photometric stereo: shape reconstruction with general, varying BRDFs. IEEE Trans. on Pattern Analysis and Machine Intelligence, 27(8): 1254–1264, 2005. 1, 2 T. Higo, Y. Matsushita, and K. Ikeuchi. Consensus photometric stereo. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pages 1157–1 164, 2010. 2 M. Holroyd, J. Lawrence, G. Humphreys, and T. Zickler. A photometric approach for estimating normals and tangents. ACM Transactions on Graphics, 27: 133, 2008. 2 S. Koppal and S. Narasimhan. Clustering appearance for scene analysis. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pages 1323–1330, 2006. 1, 2, 3 P. Kovesi. Shapelets correlated with surface normals produce surfaces. In Proc. of Int’l Conf. on Computer Vision (ICCV), pages 994–1001, 2005. 8 W. Matusik, H. Pfister, M. Brand, and L. McMillan. A data-driven reflectance model. In Proc. of ACM SIGGRAPH, pages 27–31, 2003. 2, 3 T. Okabe, I. Sato, and Y. Sato. Attached shadow coding: Estimating surface normals from shadows under unknown reflectance and lighting conditions. In Proc. of Int’l Conf. on Computer Vision (ICCV), pages 1693–1700, 2009. 2, 7 G. Oxholm, P. Bariya, and K. Nishino. The scale of geometric texture. In Proc. of European Conf. on Computer Vision (ECCV), 2012.
[26]
[27]
[28]
[29]
[30]
[31]
[32]
[33] 1 I. Sato, T. Okabe, Q. Yu, and Y. Sato. Shape reconstruction based on similarity in radiance changes under varying illumination. In Proc. of Int’l Conf. on Computer Vision (ICCV), pages 1–8, 2007. 1, 2, 3, 6, 7 B. Shi, Y. Matsushita, Y. Wei, C. Xu, and P. Tan. Self-calibrating photometric stereo. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pages 1118–1 125, 2010. 2 B. Shi, P. Tan, Y. Matsushita, and K. Ikeuchi. Elevation angle from reflectance monotonicity: Photometric stereo for general isotropic reflectances. In Proc. of European Conf. on Computer Vision (ECCV), 2012. 2 W. Silver. Determining shape and reflectance using multiple images. Master’s thesis, M.I.T., Dept. of Electrical Engineering and Computer Science, 1980. 2 P. Tan, L. Quan, and T. Zickler. The geometry of reflectance symmetries. IEEE Trans. on Pattern Analysis and Machine Intelligence, 33(12):2506–2520, 2011. 2 J. Tenenbaum, V. De Silva, and J. Langford. A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319–2323, 2000. 3 R. Woodham. photometric method for determining surface orientation from multiple images. Optical Engineering, 1(7): 139–144, 1980. 1 L. Wu, A. Ganesh, B. Shi, Y. Matsushita, Y. Wang, and Y. Ma. Robust photometric stereo via low-rank matrix completion and recov-
[354]pATZ7ae.rn1ydWZm,IhManu2rCok0,P1cKnhrav0.foicTde2ao,nP.Id6fgCATot,eamslni.fgpTueRaltCnidcorgea,Vp-fl2.iogs8nr(dh1atCTcp().oE:1WmCt8IpoE3un0Vtge)–E.r1,p8TiDc4ase6gnot,sr2e.(0Ao6pnC5h–IP.2taoV7m)9,erpn2cta0.igAo1efsaEt7l2uyr0es3oi–-:
[23]fSaCDlecp.otiNMmlotaienpydsucatoezr,noatfVkKhRie.,oshKyIbosken.grtiH,uodc8anshr6ka(iuo,n2raftd)nu:a2Admceu9sKTtl–o.ub2msIyK4ka2eptn,uhido2cantdmh0o,i1eu6.m0sM(4euDt)2r:mdie4ct1ao8srnbm–jp4eih3cnot1lsi,n.g1mI9n.seth’I0rlaEip.cJe2osEutarenTdaonlresa-f 111444999755