iccv iccv2013 iccv2013-145 iccv2013-145-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Katherine L. Bouman, Bei Xiao, Peter Battaglia, William T. Freeman
Abstract: Passively estimating the intrinsic material properties of deformable objects moving in a natural environment is essential for scene understanding. We present a framework to automatically analyze videos of fabrics moving under various unknown wind forces, and recover two key material properties of the fabric: stiffness and area weight. We extend features previously developed to compactly represent static image textures to describe video textures, such as fabric motion. A discriminatively trained regression model is then used to predict the physical properties of fabric from these features. The success of our model is demonstrated on a new, publicly available database offabric videos with corresponding measured ground truth material properties. We show that our predictions are well correlated with ground truth measurements of stiffness and density for the fabrics. Our contributions include: (a) a database that can be used for training and testing algorithms for passively predicting fabric properties from video, (b) an algorithm for predicting the material properties of fabric from a video, and (c) a perceptual study of humans’ ability to estimate the material properties of fabric from videos and images.
[1] K. Bhat, C. Twigg, J. Hodgins, P. Khosla, Z. Popovi, and S. Seitz.
[2]
[3]
[4]
[5]
[6]
[7]
[8]
[9]
[10]
[11]
[12]
[13]
[14] Estimating cloth simulation parameters from video. Eurographics Association, 2003. 2 R. W. Fleming, R. O. Dror, and E. H. Adelson. Real-world illumination and the perception of surface reflectance properties. Journal of Vision, 2003. 2 D. J. Heeger and J. R. Bergen. Pyramid-based texture analysis/synthesis. SIGGRAPH ’95, 1995. 6 Y.-x. Ho, M. S. Landy, and L. T. Maloney. How direction of illumination affects visually perceived surface roughness. Journal of Vision, 2006. 2 N. Jojic and T. S. Huang. Estimating cloth draping parameters from range data. In In International Workshop on Synthetic-Natural Hybrid Coding and 3-D Imaging, 1997. 2 B. Julesz. Visual pattern discrimination. IRE Transactions on Information Theory, 1962. 6 S. Kawabata and M. Niwa. Fabric performance in clothing and clothing manufacture. Journal of the Textile Institute, 1989. 2 F. B. Leloup, M. R. Pointer, P. Dutr, and P. Hanselaer. Geometry of illumination, luminance contrast, and gloss perception. Journal of the Optical Society of America, 2010. 3 C. Liu. Beyond pixels : exploring new representations and applications for motion analysis. Thesis, Massachusetts Institute of Technology, 2009. 5 C. Liu, L. Sharan, E. Adelson, and R. Rosenholtz. Exploring features in a bayesian framework for material recognition. 2010. 2 E. Miguel, D. Bradley, B. Thomaszewski, B. Bickel, W. Matusik, M. A. Otaduy, and S. Marschner. Data-driven estimation of cloth simulation models. Computer Graphics Forum (Proc. of Eurographics), 2012. 2 J. Portilla and E. P. Simoncelli. A parametric texture model based on joint statistics of complex wavelet coefficients. IJCV, 2000. 5, 6 C. Schuldt, I. Laptev, and B. Caputo. Recognizing human actions: a local SVM approach. In ICPR 2004, volume 3, Aug. 2004. 6 L. Sharan, Y. Li, I. Motoyoshi, S. Nishida, and E. H. Adelson. Image statistics for surface reflectance perception. Journal of the Optical Society of America. A, Optics, image science, and vision, Apr. 2008.
[15]
[16]
[17]
[18] 2 E. P. Simoncelli and W. T. Freeman. The steerable pyramid: A flexible architecture for multi-scale derivative computation. In IEEE ICIP, 1995. 5 D. Soteropoulos, K. Fetfatsidis, J. A. Sherwood, and J. Langworthy. Digital method of analyzing the bending stiffness of NonCrimp fabrics. AIP Conference Proceedings, 2011. 2 H. Wang, J. F. O’Brien, and R. Ramamoorthi. Data-driven elastic models for cloth: modeling and measurement. SIGGRAPH, 2011. 2 S. C. Zhu, Y. Wu, and D. Mumford. Filters, random fields and maximum entropy (FRAME) towards a unified theory for texture modeling. IJCV, 1998. 6 11999911