cvpr cvpr2013 cvpr2013-394 cvpr2013-394-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Lap-Fai Yu, Sai-Kit Yeung, Yu-Wing Tai, Stephen Lin
Abstract: We present a shading-based shape refinement algorithm which uses a noisy, incomplete depth map from Kinect to help resolve ambiguities in shape-from-shading. In our framework, the partial depth information is used to overcome bas-relief ambiguity in normals estimation, as well as to assist in recovering relative albedos, which are needed to reliably estimate the lighting environment and to separate shading from albedo. This refinement of surface normals using a noisy depth map leads to high-quality 3D surfaces. The effectiveness of our algorithm is demonstrated through several challenging real-world examples.
[1] J. T. Barron and J. Malik. Color constancy, intrinsic images, and shape estimation. In ECCV (4), pages 57–70, 2012.
[2] P. N. Belhumeur, D. J. Kriegman, and A. L. Yuille. The basrelief ambiguity. IJCV, 35(1):33–44, Nov. 1999. Figure15.Left:rawpointcloud.Right:pointcloudrefindwith our resultant normals.
[3] J. Dolson, J. Baek, C. Plagemann, and S. Thrun. Upsampling range data in dynamic environments. In CVPR, 2010.
[4] J.-D. Durou, M. Falcone, and M. Sagona. Numerical methods for shape-from-shading: A new survey with benchmarks. CVIU, 109(1):22–43, 2008.
[5] B. V. Funt and G. D. Finlayson. Color Constant Color Indexing. PAMI, 17(5):522–529, May 1995.
[6] B. K. P. Horn and M. J. Brooks. Shape from shading. MIT Press, Cambridge, MA, USA, 1989.
[7] R. Huang and W. A. P. Smith. Shape-from-shading under complex natural illumination. In ICIP, pages 13–16, 2011.
[8] M. K. Johnson and E. H. Adelson. Shape estimation in natural illumination. In CVPR, pages 2553–2560, 2011.
[9] K. J. Lee, Q. Zhao, X. Tong, M. Gong, S. Izadi, S. U. Lee, P. Tan, and S. Lin. Estimation of intrinsic image sequences from image+depth video. In ECCV, pages 327–340, 2012.
[10] Z. Lu, Y.-W. Tai, M. Ben-Ezra, and M. S. Brown. A framework for ultra high resolution 3d imaging. In CVPR, 2010.
[11] S. K. Nayar and R. M. Bolle. Reflectance based object recognition. IJCV, 17(3):219–240, 1996.
[12] G. Oxholm and K. Nishino. Shape and reflectance from natural illumination. In ECCV (1), pages 528–541, 2012.
[13] J. Park, H. Kim, Y.-W. Tai, M. Brown, and I. Kweon. High quality depth map upsampling for 3d-tof cameras. In ICCV, 2011.
[14] J. Pearl. Probabilistic reasoning in intelligent systems: networks of plausible inference. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1988.
[15] P. P ´erez, M. Gangnet, and A. Blake. Poisson image editing. ACM Trans. Graph., 22(3):313–318, July 2003.
[16] R. Ramamoorthi and P. Hanrahan. An efficient representation for irradiance environment maps. In SIGGRAPH, 2001 .
[17] J. Sun, L. Yuan, J. Jia, and H.-Y. Shum. Image completion with structure propagation. ACM Trans. Graph., 24(3), 2005.
[18] R. Woodham. Photometric method for determining surface orientation from multiple images. Opt. Eng., 19(1), 1980.
[19] C. Wu, B. Wilburn, Y. Matsushita, and C. Theobalt. Highquality shape from multi-view stereo and shading under general illumination. In CVPR, pages 969–976, 2011.
[20] Q. Yang, R. Yang, J. Davis, and D. Nister. Spatial-depth super resolution for range images. In CVPR, 2007.
[21] L.-F. Yu, S.-K. Yeung, Y.-W. Tai, D. Terzopoulos, and T. F. Chan. Outdoor photometric stereo. In ICCP, 2013.
[22] R. Zhang, P.-S. Tsai, J. E. Cryer, and M. Shah. Shape from shading: A survey. IEEE PAMI, 21(8):690–706, 1999. 11111444442222202200