iccv iccv2013 iccv2013-226 iccv2013-226-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Feng Liu, Yuzhen Niu, Hailin Jin
Abstract: Shaky stereoscopic video is not only unpleasant to watch but may also cause 3D fatigue. Stabilizing the left and right view of a stereoscopic video separately using a monocular stabilization method tends to both introduce undesirable vertical disparities and damage horizontal disparities, which may destroy the stereoscopic viewing experience. In this paper, we present a joint subspace stabilization method for stereoscopic video. We prove that the low-rank subspace constraint for monocular video [10] also holds for stereoscopic video. Particularly, the feature trajectories from the left and right video share the same subspace. Based on this proof, we develop a stereo subspace stabilization method that jointly computes a common subspace from the left and right video and uses it to stabilize the two videos simultaneously. Our method meets the stereoscopic constraints without 3D reconstruction or explicit left-right correspondence. We test our method on a variety of stereoscopic videos with different scene content and camera motion. The experiments show that our method achieves high-quality stabilization for stereoscopic video in a robust and efficient way.
[1] S. Baker, E. Bennett, S. B. Kang, and R. Szeliski. Removing rolling shutter wobble. In IEEE Conference on Computer Vision and Pattern Recognition, pages 2392 2399, 2010.
[2] P. Bhat, C. L. Zitnick, N. Snavely, A. Agarwala, M. Agrawala, M. Cohen, B. Curless, and S. B. Kang. Using photographs to enhance videos of a static scene. In Eurographics Workshop on Rendering, 2007.
[3] C. Buehler, M. Bosse, and L. McMillan. Non-metric imagebased rendering for video stabilization. In IEEE CVPR, pages 609–614, Dec. 2001.
[4] Y. Caspi and M. Irani. Aligning non-overlapping sequences. Int. J. Comput. Vision, 48(1):39–51, 2002.
[5] A. Fitzgibbon, Y. Wexler, and A. Zisserman. Image-based rendering using image-based priors. International Journal of Computer Vision, 63(2): 141–151, July 2005.
[6] M. L. Gleicher and F. Liu. Re-cinematography: Improving the camerawork of casual video. ACM Trans. Multimedia Comput. Commun. Appl. , 5(1): 1–28, 2008.
[7] A. Goldstein and R. Fattal. Video stabilization using epipolar geometry. ACM Transactions on Graphics, 2012.
[8] M. Grundmann, V. Kwatra, D. Castro, and I. Essa. Effective calibration free rolling shutter removal. IEEE ICCP, 2012.
[9] M. Grundmann, V. Kwatra, and I. Essa. Auto-directed video stabilization with robust l1 optimal camera paths. In IEEE CVPR, 2011.
[10] M. Irani. Multi-frame correspondence estimation using subspace constraints. Int. J. Comput. Vision, 48(1):39–51, 2002.
[11] M. Lambooij, W. IJsselsteijn, and I. Heynderickx. Visual discomfort in stereoscopic displays: a review. In Stereoscopic Displays and Virtual Reality Systems XIV, 2007. –
[12] K.-Y. Lee, Y.-Y. Chuang, B.-Y. Chen, and M. Ouhyoung. Video stabilization using robust feature trajectories. In IEEE ICCV, 2009.
[13] C.-W. Liu, T.-H. Huang, M.-H. Chang, K.-Y. Lee, C.-K. Liang, and Y.-Y. Chuang. 3d cinematography principles and their applications to stereoscopic media processing. In ACM International Conference on Multimedia, 2011.
[14] F. Liu, M. Gleicher, H. Jin, and A. Agarwala. Contentpreserving warps for 3d video stabilization. ACM Transactions on Graphics, 28(3):44: 1–44:9, 2009.
[15] F. Liu, M. Gleicher, J. Wang, H. Jin, and A. Agarwala. Subspace video stabilization. ACM Transactions on Graphics, 30(1):4: 1–4: 10, 2011.
[16] S. Liu, Y. Wang, L. Yuan, J. Bu, P. Tan, and J. Sun. Video stabilization with a depth camera. In IEEE CVPR, 2012.
[17] D. Lowe. Distinctive image features from scale-invariant keypoints. Intl. J. of Computer Vision, 60(2), 2004.
[18] Y. Matsushita, E. Ofek, W. Ge, X. Tang, and H.-Y. Shum. Full-frame video stabilization with motion inpainting. IEEE Trans. on Pattern Anal. Mach. Intell. , 28(7), 2006.
[19] B. Mendiburu. 3D Movie Making: Stereoscopic Digital Cinema from Script to Screen. Focal Press, 2009.
[20] C. Morimoto and R. Chellappa. Evaluation of image stabilization algorithms. In DARPA Image Understanding Workshop, pages 295–302, May 1997.
[21] J. Shi and C. Tomasi. Good features to track. In IEEE CVPR, pages 593–600, 1994.
[22] B. M. Smith, L. Zhang, H. Jin, and A. Agarwala. Light field video stabilization. In IEEE ICCV, 2009.
[23] L. Wolf and A. Zomet. Wide baseline matching between unsynchronized video sequences. Int. J. Comput. Vision, 68(1):43–52, 2006. 80