cvpr cvpr2013 cvpr2013-349 cvpr2013-349-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Yu Ji, Jinwei Ye, Jingyi Yu
Abstract: Transparent gas flows are difficult to reconstruct: the refractive index field (RIF) within the gas volume is uneven and rapidly evolving, and correspondence matching under distortions is challenging. We present a novel computational imaging solution by exploiting the light field probe (LFProbe). A LF-probe resembles a view-dependent pattern where each pixel on the pattern maps to a unique ray. By . ude l. edu observing the LF-probe through the gas flow, we acquire a dense set of ray-ray correspondences and then reconstruct their light paths. To recover the RIF, we use Fermat’s Principle to correlate each light path with the RIF via a Partial Differential Equation (PDE). We then develop an iterative optimization scheme to solve for all light-path PDEs in conjunction. Specifically, we initialize the light paths by fitting Hermite splines to ray-ray correspondences, discretize their PDEs onto voxels, and solve a large, over-determined PDE system for the RIF. The RIF can then be used to refine the light paths. Finally, we alternate the RIF and light-path estimations to improve the reconstruction. Experiments on synthetic and real data show that our approach can reliably reconstruct small to medium scale gas flows. In particular, when the flow is acquired by a small number of cameras, the use of ray-ray correspondences can greatly improve the reconstruction.
[1] L. Aleksandrov, A. Maheshwari, and J.-R. Sack. Approximation algorithms for geometric shortest path problems. In ACM symposium on Theory of Computing, 2000.
[2] B. Atcheson, I. Ihrke, W. Heidrich, A. Tevs, D. Bradley, M. Magnor, and H.-P. Seidel. Time-resolved 3D capture of non-stationary gas flows. ACM SIGGRAPH Asia, 2008.
[3] A. Blake. Specular stereo. In Proc. of international joint conference on Artificial intelligence, pages 973–976, 1985.
[4] T. Bonfort and P. Sturm. Voxel carving for specular surfaces. In ICCV, 2003.
[5] M. Born and E. Wolf. Principles of optics: electromagnetic theory of propagation, interference and diffraction of light. Pergamon Press, New York, 1959.
[6] J. Canny and J. Reif. New lower bound techniques for robot motion planning problems. In 28th IEEE Symposium on Foundations of Computer Science, pages 49–60, Oct. 1987.
[7] S. B. Dalziel, G. O. Hughes, and B. R. Sutherland. Whole-field density measurements by synthetic schlieren. Experiments in Fluids, 28:322–335, 2000.
[8] C. De Boor. A practical guide to splines. Springer, revised edition, 2001.
[9] E. W. Dijkstra. A note on two problems in connexion with graphs. Numerische Mathematik, 1:269–271, 1959.
[10] Y. Ding, F. Li, Y. Ji, and J. Yu. Dynamic fluid surface acquisition using a camera array. In ICCV, 2011.
[11] Y. Ding and J. Yu. Recovering shape characteristics on near-flat specular surfaces. In CVPR, 2008.
[12] W. L. Howes. Rainbow schlieren and its applications. Appl. Opt., 23(14):2449–2460, Jul 1984.
[13] I. Ihrke. Reconstruction and Rendering of Time-Varying Natural Phenomena. PhD thesis, Universit a¨t des Saarlandes, Department of Computer Science, 2007.
[14] I. Ihrke, G. Ziegler, A. Tevs, C. Theobalt, M. Magnor, and H.P. Seidel. Eikonal rendering: Efficient light transport in refractive objects. ACM Trans. on Graphics (SIGGRAPH’07), pages 59–1 59–9, 2007.
[15] K. Ikeuchi. Determining surface orientations of specular surfaces by using the photometric stereo method. IEEE TPAMI, 3(6):661–669, nov. 1981.
[16] K. Kutulakos and E. Steger. A theory of refractive and specular 3D shape by light-path triangulation. In ICCV, 2005.
[17] V. Lakshminarayanan, A. Ghatak, and K. Thyagarajan. Lagrangian Optics. Springer, Nov. 2001.
[18] G. Meier. Computerized background-oriented schlieren. Experiments in Fluids, 33: 181–187, 2002.
[19] A. Mohan, G. Woo, S. Hiura, Q. Smithwick, and R. Raskar. Bokode: imperceptible visual tags for camera based interaction from a distance. In ACM SIGGRAPH, 2009.
[20] N. Morris and K. Kutulakos. Dynamic refraction stereo. In ICCV, 2005.
[21] H. Murase. Surface shape reconstruction ofan undulating transparent object. In ICCV, 1990.
[22] R. Ng, M. Levoy, M. Br´ edif, G. Duval, M. Horowitz, and P. Hanrahan. Light field photography with a hand-held plenoptic camera. Computer Science Tech Report CSTR 2005-02, Stanford University, –
[23]
[24]
[25]
[26]
[27]
[28]
[29]
[30]
[31] Apr 2005. M. Raffel, H. Richard, and G. E. A. Meier. On the applicability of background oriented optical tomography for large scale aerodynamic investigations. Experiments in Fluids, 28:477–481, 2000. A. Sankaranarayanan, A. Veeraraghavan, O. Tuzel, and A. Agrawal. Specular surface reconstruction from sparse reflection correspondences. In CVPR, 2010. S. Savarese and P. Perona. Local analysis for 3D reconstruction of specular surfaces. In CVPR, 2001 . H. Schardin. Die schlierenverfahren und ihre anwendungen. In Ergebnisse der exakten naturwissenschaften, volume 20, pages 303– 439. 1942. M. Tarini, H. P. A. Lensch, M. Goesele, and H.-P. Seidel. 3D acquisition of mirroring objects using striped patterns. Graph. Models, 67:233–259, July 2005. G. Wetzstein, R. Raskar, and W. Heidrich. Hand-held schlieren photography with light field probes. In ICCP, 2011. G. Wetzstein, D. Roodnick, R. Raskar, and W. Heidrich. Refractive Shape from Light Field Distortion. In ICCV, 2011. J. Ye, Y. Ji, F. Li, and J. Yu. Angular domain reconstruction of dynamic 3d fluid surfaces. In CVPR, 2012. Z. Zhang. A flexible new technique for camera calibration. IEEE TPAMI, 22(1 1):1330–1334, Nov. 2000. 222555 111422