cvpr cvpr2013 cvpr2013-400 cvpr2013-400-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Amit Agrawal, Srikumar Ramalingam
Abstract: Imaging systems consisting of a camera looking at multiple spherical mirrors (reflection) or multiple refractive spheres (refraction) have been used for wide-angle imaging applications. We describe such setups as multi-axial imaging systems, since a single sphere results in an axial system. Assuming an internally calibrated camera, calibration of such multi-axial systems involves estimating the sphere radii and locations in the camera coordinate system. However, previous calibration approaches require manual intervention or constrained setups. We present a fully automatic approach using a single photo of a 2D calibration grid. The pose of the calibration grid is assumed to be unknown and is also recovered. Our approach can handle unconstrained setups, where the mirrors/refractive balls can be arranged in any fashion, not necessarily on a grid. The axial nature of rays allows us to compute the axis of each sphere separately. We then show that by choosing rays from two or more spheres, the unknown pose of the calibration grid can be obtained linearly and independently of sphere radii and locations. Knowing the pose, we derive analytical solutions for obtaining the sphere radius and location. This leads to an interesting result that 6-DOF pose estimation of a multi-axial camera can be done without the knowledge of full calibration. Simulations and real experiments demonstrate the applicability of our algorithm.
[1] A. Agrawal, S. Ramalingam, Y. Taguchi, and V. Chari. A theory of multi-layer flat refractive geometry. In CVPR, pages 3346–3353, June 2012.
[2] A. Agrawal, Y. Taguchi, and S. Ramalingam. Analytical forward projection for axial non-central dioptric and catadioptric cameras. In ECCV, volume 63 13, pages 129–143, Sept. 2010.
[3] S. Baker and S. Nayar. A theory of single-viewpoint catadioptric image formation. Int’l J. Computer Vision, 35(2): 175–196, Nov. 1999.
[4] J.-Y. Bouguet. Camera calibration toolbox for matlab. http://www.vision.caltech.edu/bouguetj.
[5] V. Caglioti, P. Taddei, G. Boracchi, S. Gasparini, and A. Giusti. Single-image calibration of off-axis catadioptric cameras using lines. In OMNIVIS, Oct. 2007.
[6] M. Demazure. Sur deux problemes de reconstruction. Technical Report 882, INRIA, 1988.
[7] Y. Ding, J. Yu, and P. Sturm. Multi-perspective stereo matching and volumetric reconstruction. In ICCV, pages 1827– 1834, Sept. 2009.
[8] Y. Francken, C. Hermans, and P. Bekaert. Screen-camera calibration using a spherical mirror. In Canadian Conf. Com-
[9]
[10]
[11]
[12]
[13]
[14]
[15]
[16]
[17]
[18]
[19] puter and Robot Vision, pages 11–20, May 2007. R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, 2000. J. A. Hesch, A. I. Mourikis, and S. I. Roumeliotis. Extrinsic camera calibration using multiple reflections. In ECCV, pages 3 11–325, Sept. 2010. M. Kanbara, N. Ukita, M. Kidode, and N. Yokoya. 3D scene reconstruction from reflection images in a spherical mirror. In ICPR, volume 4, pages 874–879, 2006. Y. Kojima, R. Sagawa, T. Echigo, and Y. Yagi. Calibration and performance evaluation of omnidirectional sensor with compound spherical mirrors. In OMNIVIS, 2005. D. Lanman, D. Crispell, M. Wachs, and G. Taubin. Spherical catadioptric arrays: Construction, multi-view geometry, and calibration. In 3DPVT, pages 81–88, 2006. B. Micusik and T. Pajdla. Structure from motion with wide circular field of view cameras. IEEE Trans. Pattern Anal. Machine Intell., 28(7): 1135–1 149, 2006. S. Nayar. Sphereo: Determining depth using two specular spheres and a single camera. In SPIE Conf. Optics, Illumination, and Image Sensing for Machine Vision III, pages 245–254, Nov. 1988. K. Nishino and S. Nayar. The World in an Eye. In CVPR, volume I, pages 444–45 1, June 2004. D. Nist e´r and H. Stew e´nius. A minimal solution to the generalised 3-point pose problem. J. Mathematical Imaging and Vision, 27(1):67–79, 2007. S. Ramalingam, P. Sturm, and S. K. Lodha. Theory and calibration algorithms for axial cameras. In ACCV, 2006. R. Sagawa, N. Kurita, T. Echigo, and Y. Yagi. Compound catadioptric stereo sensor for omnidirectional object detec-
[20]
[21]
[22]
[23]
[24]
[25]
[26]
[27] tion. In IROS, volume 3, pages 2612–2617, Sept. 2004. D. Scaramuzza. Ocamcalib: Omnidirectional camera calibration toolbox for matlab. https://sites.google.com/site/scarabotix/ocamcalib-toolbox. P. Sturm and T. Bonfort. How to compute the pose of an object without a direct view. In ACCV, pages 21–3 1, 2006. P. Sturm and S. Ramalingam. A generic concept for camera calibration. In ECCV, 2004. P. Sturm, S. Ramalingam, J.-P. Tardif, S. Gasparini, and J. Barreto. Camera models and fundamental concepts used in geometric computer vision. Foundations and Trends in Computer Graphics and Vision, 6(1-2): 1–183, 2011. Y. Taguchi, A. Agrawal, A. Veeraraghavan, S. Ramalingam, and R. Raskar. Axial-cones: Modeling spherical catadioptric cameras for wide-angle light field rendering. ACM Trans. Graph., 29(6):172: 1–172:8, Dec. 2010. K. Takahashi, S. Nobuhara, and T. Matsuyama. A new mirror-based extrinsic camera calibration using an orthogonality constraint. In CVPR, June 2012. J.-P. Tardif, P. Sturm, M. Trudeau, and S. Roy. Calibration of cameras with radially symmetric distortion. IEEE Trans. Pattern Anal. Machine Intell., 3 1(9): 1552–1566, 2009. S. Thirthala and M. Pollefeys. Multi-view geometry of 1D radial cameras and its application to omnidirectional camera calibration. In ICCV, volume 2, pages 1539–1546, 2005. 11111444440000046644