cvpr cvpr2013 cvpr2013-467 cvpr2013-467-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Linjie Luo, Cha Zhang, Zhengyou Zhang, Szymon Rusinkiewicz
Abstract: We propose a novel algorithm to reconstruct the 3D geometry of human hairs in wide-baseline setups using strand-based refinement. The hair strands arefirst extracted in each 2D view, and projected onto the 3D visual hull for initialization. The 3D positions of these strands are then refined by optimizing an objective function that takes into account cross-view hair orientation consistency, the visual hull constraint and smoothness constraints defined at the strand, wisp and global levels. Based on the refined strands, the algorithm can reconstruct an approximate hair surface: experiments with synthetic hair models achieve an accuracy of ∼3mm. We also show real-world examples to demonsotfra ∼te3 mthme capability t soh capture full-head hamairp styles as mwoenll- as hair in motion with as few as 8 cameras.
[1] T. Beeler, B. Bickel, P. Beardsley, B. Sumner, and
[2]
[3]
[4]
[5]
[6]
[7]
[8]
[9]
[10] M. Gross. High-quality single-shot capture of facial geometry. ACM Trans. Graph., 29, 2010. 1 T. Beeler, B. Bickel, G. Noris, S. Marschner, P. Beardsley, R. W. Sumner, and M. Gross. Coupled 3d reconstruction of sparse facial hair and skin. ACM Trans. Graph., 3 1:117: 1–1 17: 10, August 2012. 2 M. Bergou, M. Wardetzky, S. Robinson, B. Audoly, and E. Grinspun. Discrete elastic rods. In SIGGRAPH, 2008. 5 M. Chai, L. Wang, Y. Weng, Y. Yu, B. Guo, and K. Zhou. Single-view hair modeling for portrait manipulation. ACM Trans. Graph., 3 1(4): 116: 1–1 16:8, July 2012. 2, 3, 5 C. H. Esteban and F. Schmitt. Silhouette and stereo fusion for 3d object modeling. Comput. Vis. Image Underst., 96(3):367–392, Dec. 2004. 1, 2, 6 Y. Furukawa and J. Ponce. Carved visual hulls for image-based modeling. Int. J. Comput. Vision, 81(1):53–67, Jan 2009. 2 Y. Furukawa and J. Ponce. Accurate, dense, and robust multiview stereopsis. IEEE Trans. on PAMI, 32: 1362– 1376, 2010. 1, 6 W. Jakob, J. T. Moon, and S. Marschner. Capturing hair assemblies fiber by fiber. ACM Trans. Graph., 28(5): 164: 1–164:9, December 2009. 1, 2 M. Kass, A. Witkin, and D. Terzopoulos. Snakes: Active contour models. International Journal of Computer Vision, 1(4):321–331, 1988. 2 M. Kazhdan, M. Bolitho, and H. Hoppe. Poisson sur-
[11]
[12]
[13]
[14]
[15]
[16]
[17]
[18] face reconstruction. In Proc. SGP, 2006. 2, 3, 6 K. N. Kutulakos and S. M. Seitz. A theory of shape by space carving. International Journal of Computer Vision, 38(3): 199–218, 2000. 2 T. Lay Herrrera, A. Zinke, and A. Weber. Lighting hair from the inside: A thermal approach to hair reconstruction. In ACM Transactions on Graphics, volume 31, 2012. 1, 2 M. Lhuillier and L. Quan. A quasi-dense approach to surface reconstruction from uncalibrated images. IEEE Trans. PAMI, 27(3):418–433, Mar 2005. 5 D. G. Lowe. Object recognition from local scaleinvariant features. In Proc. ICCV, 1999. 2 L. Luo, H. Li, S. Paris, T. Weise, M. Pauly, and S. Rusinkiewicz. Multi-view hair capture using orientation fields. In Proc. CVPR, 2012. 1, 3, 6 D. W. Marquardt. An algorithm for least-squares estimation of nonlinear parameters. Journal of the Society for Industrial and Applied Mathematics, 11(2). 3 S. Marschner, H. W. Jensen, M. C. andS. Worley, and P. Hanrahan. Light scattering from human hair fibers. ACM Trans. Graph., 22(3):780–791, July 2003. 1, 6 J. Matas, O. Chum, M. Urban, and T. Pajdla. Robust wide-baseline stereo from maximally stable extremal regions. Image and Vision Computing, 22(10):761 767, 2004. 3 T. Mihashi, C. Tempelaar-Lietz, and G. Borshukov. Generating realistic human hair for The Matrix Reloaded. In ACM SIGGRAPH Sketches and Appli- –
[19]
[20]
[21]
[22]
[23]
[24]
[25]
[26]
[27]
[28] cations Program, 2003. 1 S. Paris, H. Briceño, and F. Sillion. Capture of hair geometry from multiple images. ACM Trans. Graph., 23(3):712–719, August 2004. 2, 3 S. Paris, W. Chang, O. I. Kozhushnyan, W. Jarosz, W. Matusik, M. Zwicker, and F. Durand. Hair Photobooth: Geometric and photometric acquisition of real hairstyles. ACM Trans. Graph., 27(3):30: 1–30:9, August 2008. 1, 2, 6 S. M. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski. A comparison and evaluation of multiview stereo reconstruction algorithms. In Proceedings of CVPR, 2006. 2 E. Tola, V.Lepetit, and P. Fua. A Fast Local Descriptor for Dense Matching. In Proc. CVPR, 2008. 2 T. Tuytelaars and L. V. Gool. Wide baseline stereo matching based on local, affinely invariant regions. In BMVC, Sep 2000. 3 Y. Wei, E. Ofek, L. Quan, and H.-Y. Shum. Modeling hair from multiple views. ACM Trans. Graph., 24(3):816–820, July 2005. 1, 2 O. Woodford, P. Torr, I. Reid, and A. Fitzgibbon. Global stereo reconstruction under second order smoothness priors. In Proc. CVPR, 2008. 1 T. Yamaguchi, B. Wilburn, and E. Ofek. Video-based modeling of dynamic hair. In Proc. PSIVT, 2008. 2 C. Yuksel, S. Schaefer, and J. Keyser. Hair meshes. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2009), 28(5): 166: 1–166:7, 2009. 6
[29] Q. Zhang, J. Tong, H. Wang, Z. Pan, and R. Yang. Simulation guided hair dynamics modeling from video. Computer Graphics Forum, 3 1(7pt1). 2 222777111 222777222