cvpr cvpr2013 cvpr2013-283 cvpr2013-283-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Christian Richardt, Yael Pritch, Henning Zimmer, Alexander Sorkine-Hornung
Abstract: We present a solution for generating high-quality stereo panoramas at megapixel resolutions. While previous approaches introduced the basic principles, we show that those techniques do not generalise well to today’s high image resolutions and lead to disturbing visual artefacts. As our first contribution, we describe the necessary correction steps and a compact representation for the input images in order to achieve a highly accurate approximation to the required ray space. Our second contribution is a flow-based upsampling of the available input rays which effectively resolves known aliasing issues like stitching artefacts. The required rays are generated on the fly to perfectly match the desired output resolution, even for small numbers of input images. In addition, the upsampling is real-time and enables direct interactive control over the desired stereoscopic depth effect. In combination, our contributions allow the generation of stereoscopic panoramas at high output resolutions that are virtually free of artefacts such as seams, stereo discontinuities, vertical parallax and other mono-/stereoscopic shape distortions. Our process is robust, and other types of multiperspective panoramas, such as linear panoramas, can also benefit from our contributions. We show various comparisons and high-resolution results.
[1] A. Agarwala, M. Agrawala, M. Cohen, D. Salesin, and R. Szeliski. Photographing long scenes with multi-viewpoint panoramas. ACM Transactions on Graphics, 25(3), 2006.
[2] M. Brown and D. G. Lowe. Automatic panoramic image stitching using invariant features. IJCV, 74(1), 2007.
[3] P. J. Burt and E. H. Adelson. A multiresolution spline with application to image mosaics. ACM Transactions on Graphics, 2(4), 1983.
[4] D. Claus and A. W. Fitzgibbon. A rational function lens distortion model for general cameras. In CVPR, 2005.
[5] R. Gupta and R. I. Hartley. Linear pushbroom cameras. PAMI, 19(9), 1997.
[6] P. Gwosdek, H. Zimmer, S. Grewenig, A. Bruhn, and J. Weickert. A highly efficient GPU implementation for variational optic flow based on the Euler-Lagrange framework. In ECCV CVGPU Workshop, 2010.
[7] R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, 2004.
[8] R. T. Held and M. S. Banks. Misperceptions in stereoscopic displays: a vision science perspective. In APGV, 2008.
[9] S. B. Kang, R. Szeliski, and M. Uyttendaele. Seamless stitching using multi-perspective plane sweep. Technical Report MSR-TR-2004-48, Microsoft Research, 2004.
[10] J. Kopf, B. Chen, R. Szeliski, and M. Cohen. Street Slide: browsing street level imagery. ACM Transactions on Graphics, 29(4), 2010.
[11] A. Levin, A. Zomet, S. Peleg, and Y. Weiss. Seamless image stitching in the gradient domain. In ECCV, 2004.
[12] Y. Li, H.-Y. Shum, C.-K. Tang, and R. Szeliski. Stereo reconstruction from multiperspective panoramas. PAMI, 26(1), 2004.
[13] H. Lieng, J. Tompkin, and J. Kautz. Interactive multi-perspective imagery from photos and videos. Computer Graphics Forum, 31(2), 2012.
[14] B. D. Lucas and T. Kanade. An iterative image registration technique with an application to stereo vision. In IJCAI, 1981.
[15] S. Peleg, M. Ben-Ezra, and Y. Pritch. Omnistereo: Panoramic stereo imaging. PAMI, 23(3), 2001 .
[16] A. Rav-Acha, G. Engel, and S. Peleg. Minimal aspect distortion (MAD) mosaicing of long scenes. IJCV, 78(2–3), 2008.
[17] A. Rav-Acha, Y. Shor, and S. Peleg. Mosaicing with parallax using time warping. In CVPR Workshops, 2004.
[18] A. Román and H. P. A. Lensch. Automatic multiperspective images. In Eurographics Symposium on Rendering, 2006.
[19] B. Rousso, S. Peleg, and I. Finci. Video mosaicing using manifold projection. In BMVC, 1997.
[20] H.-Y. Shum and L.-W. He. Rendering with concentric mosaics. In SIGGRAPH, 1999.
[21] H.-Y. Shum and R. Szeliski. Systems and experiment paper: Construction of panoramic image mosaics with global and local alignment. IJCV, 36(2), 2000.
[22] N. Snavely, S. M. Seitz, and R. Szeliski. Photo tourism: exploring photo collections in 3D. ACM Transactions on Graphics, 25(3), 2006.
[23] R. Szeliski. Image alignment and stitching: a tutorial. Foundations and Trends in Computer Graphics and Vision, 2(1), 2006.
[24] D. N. Wood, A. Finkelstein, J. F. Hughes, C. E. Thayer, and D. H. Salesin. Multiperspective panoramas for cel animation.
[25]
[26]
[27]
[28]
[29]
[30] In SIGGRAPH, 1997. C. Wu, S. Agarwal, B. Curless, , and S. M. Seitz. Multicore bundle adjustment. In CVPR, 2011. J. Yu and L. McMillan. General linear cameras. In ECCV, 2004. J. Yu, L. McMillan, and P. Sturm. Multiperspective modeling, rendering and imaging. Computer Graphics Forum, 29(1), 2010. E. Zheng, R. Raguram, P. Fite-Georgel, and J.-M. Frahm. Efficient generation of multi-perspective panoramas. In 3DIMPVT, 2011. H. Zimmer, A. Bruhn, and J. Weickert. Optic flow in harmony. IJCV, 93(3), 2011. A. Zomet, D. Feldman, S. Peleg, and D. Weinshall. Mosaicing new views: the crossed-slits projection. PAMI, 25(6), 2003. 11111222226666613311