nips nips2013 nips2013-167 nips2013-167-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Dan Rosenbaum, Daniel Zoran, Yair Weiss
Abstract: Motivated by recent progress in natural image statistics, we use newly available datasets with ground truth optical flow to learn the local statistics of optical flow and compare the learned models to prior models assumed by computer vision researchers. We find that a Gaussian mixture model (GMM) with 64 components provides a significantly better model for local flow statistics when compared to commonly used models. We investigate the source of the GMM’s success and show it is related to an explicit representation of flow boundaries. We also learn a model that jointly models the local intensity pattern and the local optical flow. In accordance with the assumptions often made in computer vision, the model learns that flow boundaries are more likely at intensity boundaries. However, when evaluated on a large dataset, this dependency is very weak and the benefit of conditioning flow estimation on the local intensity pattern is marginal. 1
[1] M. Bethge. Factorial coding of natural images: how effective are linear models in removing higher-order dependencies? 23(6):1253–1268, June 2006.
[2] Michael J. Black and P. Anandan. A framework for the robust estimation of optical flow. In ICCV, pages 231–236, 1993.
[3] Daniel J. Butler, Jonas Wulff, Garrett B. Stanley, and Michael J. Black. A naturalistic open source movie for optical flow evaluation. In ECCV (6), pages 611–625, 2012.
[4] David J. Fleet, Michael J. Black, Yaser Yacoob, and Allan D. Jepson. Design and use of linear models for image motion analysis. International Journal of Computer Vision, 36(3):171–193, 2000.
[5] Andreas Geiger, Philip Lenz, and Raquel Urtasun. Are we ready for autonomous driving? the kitti vision benchmark suite. In CVPR, pages 3354–3361, 2012.
[6] Berthold KP Horn and Brian G Schunck. Determining optical flow. Artificial intelligence, 17(1):185–203, 1981.
[7] Bruce D Lucas, Takeo Kanade, et al. An iterative image registration technique with an application to stereo vision. In Proceedings of the 7th international joint conference on Artificial intelligence, 1981.
[8] Xiaofeng Ren. Local grouping for optical flow. In CVPR, 2008.
[9] Stefan Roth and Michael J. Black. On the spatial statistics of optical flow. International Journal of Computer Vision, 74(1):33–50, 2007.
[10] J Sohl-Dickstein and BJ Culpepper. Hamiltonian annealed importance sampling for partition function estimation. 2011.
[11] Deqing Sun, Stefan Roth, and Michael J Black. Secrets of optical flow estimation and their principles. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 2432–2439. IEEE, 2010.
[12] Li Xu, Zhenlong Dai, and Jiaya Jia. Scale invariant optical flow. In Computer Vision–ECCV 2012, pages 385–399. Springer, 2012.
[13] Henning Zimmer, Andr´ s Bruhn, and Joachim Weickert. Optic flow in harmony. International e Journal of Computer Vision, 93(3):368–388, 2011.
[14] Daniel Zoran and Yair Weiss. Natural images, gaussian mixtures and dead leaves. In NIPS, pages 1745–1753, 2012. 9