cvpr cvpr2013 cvpr2013-114 cvpr2013-114-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Zhe Yang, Zhiwei Xiong, Yueyi Zhang, Jiao Wang, Feng Wu
Abstract: This paper proposes novel density modulated binary patterns for depth acquisition. Similar to Kinect, the illumination patterns do not need a projector for generation and can be emitted by infrared lasers and diffraction gratings. Our key idea is to use the density of light spots in the patterns to carry phase information. Two technical problems are addressed here. First, we propose an algorithm to design the patterns to carry more phase information without compromising the depth reconstruction from a single captured image as with Kinect. Second, since the carried phase is not strictly sinusoidal, the depth reconstructed from the phase contains a systematic error. We further propose a pixelbased phase matching algorithm to reduce the error. Experimental results show that the depth quality can be greatly improved using the phase carried by the density of light spots. Furthermore, our scheme can achieve 20 fps depth reconstruction with GPU assistance.
[1] C. Albitar, P. Graebling, and C. Doignon. Robust structured light coding for 3d reconstruction. In ICCV, 2007. 2
[2] F. Blais. Review of 20 years of range sensor development. Journal of Electronic Imaging, 13(1):23 1–240, 2004. 2
[3] J. Charles and M. Everingham. Learning shape models for monocular human pose estimation from microsoft xbox kinect. In ICCV Workshops, 2011. 1
[4] S. Y. Chen, Y. F. Li, and J. W. Zhang. Vision processing for realtime 3-d data acqusition based on coded structure light. IEEE Transactions on Image Processing, 17(2): 167– 176, 2008. 2
[5] T. Chen, H. Lensch, C. Fuchs, and H. P. Seidel. Polarization and phase-shifting for 3d scanning of translucent objects. In CVPR, 2007. 2 333 1 1 Figure 10. Scene with a static object (left) and a moving object (right). (a) The proposed scheme using block matching. (b) The proposed scheme using pixel-based phase matching. (c) The proposed scheme after depth integration.
[6] T. Chen, H. P. Seidel, and H. Lensch. Modulated phase-
[7]
[8]
[9]
[10]
[11]
[12]
[13]
[14]
[15]
[16]
[17] shifting for 3d scanning. In CVPR, 2008. 2 P. Fong and F. Buron. Sensing deforming and moving objects with commercial off the shelf hardware. In CVPR, 2005. 2 B. Freedman, A. Shpunt, M. Machline, and Y. Arieli. Depth mapping using projected patterns. US Patent Application 2010/0118123, 2010. 1, 2 J. Gu, T. Kobayashi, M. Gupta, and S. K. Nayar. Multiplexed illumination for scene recovery in the presence of global illumination. In ICCV, 2011. 2 M. Gupta and S. K. Nayar. Micro phase shifting. In CVPR, 2012. 2 S. Inokuchi, K. Sato, and F. Matsuda. Range-imageing system for 3-d object recognition. In ICPR, 1984. 2 S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison, and A. Fitzgibbon. Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In ACM Symposium on User Interface Software and Technology, 2011. 1 H. Kawasaki, R. Furukawa, R. Sagawa, and Y. Yagi. Dynamic scene shape reconstruction using a single structure light pattern. In CVPR, 2008. 2 K. Khoshelham and S. O. Elberink. Accuracy and resolution of kinect depth data for indoor mapping applications. Sensors, 12(2): 1437–1454, 2012. 1, 2 T. P. Koninckx and L. V. Gool. Real-time range acquisition by adaptive structure light. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(3):432–445, 2006. 2 T. P. Koninckx, P. Peers, P. Dutre, and L. V. Gool. Sceneadapted structure light. In CVPR, 2005. 3 X. Maurice, P. Graebling, and C. Doignon. A pattern framework driven by the hamming distance for structured light- based reconstruction with a single image. In CVPR, 2011. 2
[18] S. K. Nayar, G. Krishnan, M. D. Grossberg, and R. Raskar. Fast separation of direct and global components of a scene using high frequency illumination. In ACM SIGGRAPH, 2006. 2
[19] P.Vuylsteke and A. Oosterlinck. Range image acqusition with a single binary-encoded light pattern. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(2): 148–164, 1990. 2
[20] J. Salvi, J. Pages, and J. Batlle. Pattern codifications strategies in structured light systems. Pattern Recognition, 37(4):827–849, 2004. 2
[21] D. Scharstein and R. Szeliski. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision, 47(1):7–42, 2002. 4
[22] J. Smisek, M. Jancosek, and T. Pajdla. 3d with kinect. In ICCV Workshops, 2011. 1, 6
[23] V. Srinivasan, H. C. Liu, and M. Halioua. Automated phasemeasuring profilometry of 3-d diffuse objects. Applied Optics, 23(18):3105–3108, 1984. 1, 5
[24] W. Susanto, M. Rohrbach, and B. Schiele. 3d object detection with multiple kinects. In ECCV Workshops, 2012. 1
[25] Y. Taguchi, A. Agrawal, and O. Tuzel. Motion-aware structured light using spatio-temporal decodable patterns. In ECCV, 2012. 3
[26] Y. Wang, K. Liu, Q. Hao, D. L. Lau, and L. G. Hassebrook. Period coded phase shifting strategy for real-time 3-d structured light illumination. IEEE Transactions on Image Processing, 20(1 1):3001–3013, 2011. 2
[27] T. Weise, B. Leibe, and L. van Gool. Fast 3d scanning with
[28]
[29]
[30]
[31]
[32]
[33] 333222 automatic motion compensation. In CVPR, 2007. 2, 3 P. Wissmann, R. Schmitt, and F. Forster. Fast and accurate 3d scanning using coded phase shifting and high speed pattern projection. In 3DIMPVT, 2011. 2 L. Xia, C. C. Chen, and J. K. Aggarwal. Human detection using depth information by kinect. In CVPR Workshops, 2011. 1 Z. Zalevsky, A. Shpunt, A. Maizels, and J. Garcia. Method and system for object reconstruction. US Patent Application 2010/0177164, 2010. 4 S. Zhang. Flexible 3d shape measurement using projector defocusing: extended measurement range. Optics letters, 35(7):934–936, 2010. 2 S. Zhang, D. Royer, and S. T. Yau. Gpu-assisted highresolution, real-time 3-d shape measurement. Optics Express, 14(20):9120–9129, 2006. 3 Y. Zhang, Z. Xiong, and F. Wu. Hybrid structured light for scalable depth sensing. In ICIP, 2012. 3