iccv iccv2013 iccv2013-353 knowledge-graph by maker-knowledge-mining

353 iccv-2013-Revisiting the PnP Problem: A Fast, General and Optimal Solution


Source: pdf

Author: Yinqiang Zheng, Yubin Kuang, Shigeki Sugimoto, Kalle Åström, Masatoshi Okutomi

Abstract: In this paper, we revisit the classical perspective-n-point (PnP) problem, and propose the first non-iterative O(n) solution that is fast, generally applicable and globally optimal. Our basic idea is to formulate the PnP problem into a functional minimization problem and retrieve all its stationary points by using the Gr¨ obner basis technique. The novelty lies in a non-unit quaternion representation to parameterize the rotation and a simple but elegant formulation of the PnP problem into an unconstrained optimization problem. Interestingly, the polynomial system arising from its first-order optimality condition assumes two-fold symmetry, a nice property that can be utilized to improve speed and numerical stability of a Gr¨ obner basis solver. Experiment results have demonstrated that, in terms of accuracy, our proposed solution is definitely better than the state-ofthe-art O(n) methods, and even comparable with the reprojection error minimization method.

Reference: text


Summary: the most important sentenses genereted by tfidf model

sentIndex sentText sentNum sentScore

1 se Abstract In this paper, we revisit the classical perspective-n-point (PnP) problem, and propose the first non-iterative O(n) solution that is fast, generally applicable and globally optimal. [sent-10, score-0.118]

2 Our basic idea is to formulate the PnP problem into a functional minimization problem and retrieve all its stationary points by using the Gr¨ obner basis technique. [sent-11, score-0.342]

3 The novelty lies in a non-unit quaternion representation to parameterize the rotation and a simple but elegant formulation of the PnP problem into an unconstrained optimization problem. [sent-12, score-0.383]

4 Interestingly, the polynomial system arising from its first-order optimality condition assumes two-fold symmetry, a nice property that can be utilized to improve speed and numerical stability of a Gr¨ obner basis solver. [sent-13, score-0.659]

5 Experiment results have demonstrated that, in terms of accuracy, our proposed solution is definitely better than the state-ofthe-art O(n) methods, and even comparable with the reprojection error minimization method. [sent-14, score-0.338]

6 Introduction Given n (n ≥ 3) 3D reference points in the object framewoGrki vaennd nth (enir ≥ corresponding c2eD p projections, tboj edcette frrammineethe orientation and position of a fully calibrated perspective camera is known as the perspective-n-point (PnP) problem [9]. [sent-16, score-0.12]

7 Unfortunately, to the best of our knowledge, there does not exist a fast (preferably, real-time) and globally optimal solution, which is accurate and applicable to a PnP problem with any point number n (n ≥ 3), any 3eD to point configuration tahn dan arbitrary camera pose. [sent-19, score-0.218]

8 To properly account for the latest progress, we would like to roughly categorize them into two groups - the multi-stage methods and the direct minimization methods. [sent-25, score-0.113]

9 Typically, the multi-stage methods first estimate the coordinates of some (or all) points in the camera framework, and transform the PnP problem into the 3D-3D absolute pose problem, for which there exist closed-form solution- s [2 1]. [sent-26, score-0.125]

10 Without estimating point coordinates, the well-known direct linear transformation (DLT) method [9] is also a multi-stage method, since it first determines the projection matrix and then extracts the calibration parameters and the camera pose. [sent-36, score-0.143]

11 In contrast, the direct minimization methods are characteristic of minimizing a properly defined error function, either in the image space or the object space, while taking into consideration all nonlinear constraints. [sent-41, score-0.19]

12 It is widely known that minimizing the reprojection error is the best criterion, which leads to a challenging nonconvex fractional programming problem. [sent-42, score-0.189]

13 As a trade off, some direct minimization methods [6, 16] minimize instead certain algebraic error functions via local optimization techniques. [sent-46, score-0.256]

14 [6] offered an alternating minimization method to minimize an algebraic error defined in the image space. [sent-49, score-0.202]

15 The above direct minimization methods [6, 16, 17, 20] share another shortage that they return only a single solution, which might not correspond to the true camera pose in case of multiple solutions. [sent-55, score-0.235]

16 To resolve these drawbacks, Hesch and Roumeliotis [10] developed a direct least square (DLS) method with complexity O(n), in which all stationary points are retrieved by solving the polynomial system derived from its first-order optimal condition via the resultant technique. [sent-56, score-0.419]

17 Unfortunately, they parameterized rotation by using the Cayley representation, which is degenerate in all cases of 180 degree rotations around the x-, y- and z-axis1 . [sent-57, score-0.13]

18 The accuracy deteriorates seriously when the camera pose approaches these singularities. [sent-58, score-0.088]

19 As pointed out in [ 15], in addition to the number of points n, the configuration of the 3D reference points plays 1On the project page, Hesch and Roumeliotis provided a remedy by solving DLS three times under different rotated 3D points. [sent-59, score-0.262]

20 A desirable PnP solution should be able to handle all 3D point configurations, including the ordinary-3D, the planar and the quasi-singular (nearplanar or near-linear) configuration. [sent-63, score-0.198]

21 However, some existing methods, like [ 14, 20], handle the ordinary-3D and the planar configuration separately, thus tend to be inaccurate in the in-between quasi-singular case. [sent-64, score-0.168]

22 Overview of the Proposed Solution In this paper, we propose the first non-iterative O(n) solution that is fast, globally optimal and universally applicable. [sent-68, score-0.149]

23 Our basic idea is to formulate the PnP problem into a minimization problem and retrieve all its stationary points by using the Gr¨ obner basis technique. [sent-69, score-0.342]

24 By using a unusual non-unit quaternion representation to parameterize rotation, we formulate the PnP problem into an unconstrained optimization problem. [sent-71, score-0.284]

25 The polynomial system arising from its first-order optimality condition is simpler than using the standard unit quaternion parameterization. [sent-72, score-0.588]

26 More interestingly, this polynomial system is of odd-degree, thus assuming two-fold symmetry, a nice property that can be utilized to improve speed and numerical stability of a Gr¨ obner basis solver. [sent-73, score-0.467]

27 Being globally optimal, our proposed solution successfully conquers the problem of local optimality (or even divergence) that might upset a local optimization based method. [sent-74, score-0.223]

28 Unlike [10], our solution does not suffer from any degeneracy of camera pose. [sent-76, score-0.188]

29 Experiment results have demonstrated that, in terms of accuracy, our proposed solution is definitely better than the examined state-of-the-art methods. [sent-77, score-0.121]

30 Actually, although our cost function is only algebraically meaningful, its accuracy is even comparable to that of the reprojection error minimization method. [sent-78, score-0.255]

31 Therefore, the proposed solution is universally applicable to any PnP problem, irrespective of the 3D point configuration, the camera pose and the number of points. [sent-81, score-0.27]

32 T,i Given n 3D reference points qi = yi = 1, 2, · · · ,n, in the object reference framew? [sent-90, score-0.135]

33 matrix R and the translation vector t, accounting for camera orientation and position, respectively. [sent-95, score-0.121]

34 Considering that the perspective camera has been calibrated, we simply assume that the projections pi are measured in the normalized homogeneous image coordinate framework. [sent-96, score-0.098]

35 Rotation Parameterization A critical issue is how to parameterize the rotation matrix R, such that the orthonormal constraint RRT = I and the determinant constraint det(R) = 1could be satisfied. [sent-100, score-0.157]

36 There are various parameterization methods for R, such as the Euler angle, rotation axis-angle, Cayley and unit quaternion parameterization. [sent-101, score-0.404]

37 To facilitate global optimization via polynomial system solving, we advocate instead the non-unit quaternion parameterization, which is free of any trigonometric function. [sent-102, score-0.439]

38 Specifically, letting s = a2 + b2 + c2 + d2, the non-unit quaternion parameterization reads R =1s⎢⎡⎢ ⎢ ⎢ ⎢a2 +2b bcd2+− 2c2a2a−cd 2 a2−2 bcbcd2+ −c2 2a db−d2 a2 −2cb d 2− +2 ca 2cb+d2⎥ ⎥ ⎥⎤⎥ ⎥,(2) where a, b, c, d are the four unknown parameters. [sent-103, score-0.35]

39 It⎦ is straightforward to verify that the parameterization in Eq. [sent-104, score-0.109]

40 and At first sight, the above parameterization is unattractive at all. [sent-106, score-0.109]

41 It is possible to exploit this property to resolve the concerns on the non-unit quaternion representation. [sent-116, score-0.196]

42 Although it is only an algebraic error, as will be demonstrated in the experiment section, its accuracy is very close to that of minimizing the reprojection error, i. [sent-156, score-0.147]

43 In addition, it suffers from no degeneracy of camera pose, and is independent of the 3D point configuration. [sent-167, score-0.147]

44 Relation to Existing Works In the previous section, we have used the non-unit quaternion to parameterize the rotation, and fixed its scale by using the reciprocal of the average depth. [sent-170, score-0.284]

45 Through some basic operations, one can verify that the Cayley parameterization is the same as R(1, b, c, d), that is, fixing the scale of Eq. [sent-182, score-0.109]

46 The major advantage lies in that the polynomial system in [ 10] is simpler to solve, since there remain only three variables. [sent-184, score-0.2]

47 Here, we prefer to solve the polynomial system of the first-order optimality condition of Eq. [sent-189, score-0.317]

48 The investigated solvers include the blind GB solver without utilizing symmetry (Blind GB), the GB solver using two-fold symmetry (Symmetric GB), the Symmetric GB followed by one damped Newton polishing step (Symmetric GB + Polish) and the resultant based solver used in DLS [10]. [sent-207, score-0.725]

49 The horizontal axis shows the log10 value of the absolute error between the ground-truth unitnorm quaternion and the estimated quaternion after normalization, while the vertical axis shows the counts over 5,000 independent runs. [sent-210, score-0.469]

50 (1 1) with respect to a, b, c, d, the first-order optimality condition reads ∂∂af= 0,∂∂bf= 0,∂∂cf= 0,∂∂df= 0, (13) which is composed of four three-degree polynomials with respect to a, b, c, d. [sent-213, score-0.209]

51 A Blind Gr¨ obner Basis Solver Although solving multivariate polynomial systems is challenging in general, the multiview geometry community has achieved much progress by means of the Gr¨ obner basis (GB) technique [3]. [sent-216, score-0.446]

52 [13] even developed an automatic generator of GB solvers, which facilitates the solving of polynomial systems arising from geometric computer vision problems. [sent-218, score-0.292]

53 Finally, the solutions to the original polynomial system are extracted from the eigen-factorization of the action matrix. [sent-220, score-0.245]

54 By using the automatic generator in [13], we have found that the polynomial system in Eq. [sent-222, score-0.256]

55 The size of the elimination template is 575×656, lwuthiiolne sth. [sent-224, score-0.099]

56 One might be interested in solving the polynomial system arising from the first-order optimality condition of Eq. [sent-228, score-0.426]

57 22334477 Due to the unit-norm constraint, a Lagrange multiplier has to be introduced, thus leading to a three-degree polynomial system with respect to five variables. [sent-230, score-0.2]

58 , the elimination template is of size 1523×1603) and thus much selliomweinr. [sent-233, score-0.099]

59 a tTiohnis t vemerpifliaetse th ise o advantages ×of1 our )no ann-dun thiut quaternion parameterization and our unconstrained formulation. [sent-234, score-0.335]

60 (1 1), we have further noted that the polynomial system in Eq. [sent-238, score-0.2]

61 [2] developed general techniques to make use of p-fold symmetry (p = 2 in our problem) arising from some minimal problems. [sent-246, score-0.24]

62 The basic idea is to directly eliminate the trivial all-zero solution and carefully generate new equations such that the symmetry could be preserved. [sent-247, score-0.208]

63 By using symmetry, the size of the elimination template and that of the action matrix could be drastically reduced, which in return improves computational speed and numerical stability. [sent-248, score-0.154]

64 In [2], one has to solve an integer linear system to extract the symmetric solutions from the action matrix, which is very slow. [sent-249, score-0.124]

65 When implementing the two-fold symmetry GB solver for Eq. [sent-250, score-0.204]

66 With an elimination template of size 348×376 and an action matrix of size 40×40, our towfo s-ifzoeld 3 symmetry dG aBn s aoclvtieorn nta mkeastr xabo ouft s i1z8e. [sent-253, score-0.23]

67 1, its numerical stability is also stronger than the blind version. [sent-256, score-0.162]

68 It is worthy of mentioning that the five-variable polynomial system from Eq. [sent-257, score-0.2]

69 (13) is the first fully symmetric system, arising from a non-minimal problem, that we know of. [sent-260, score-0.115]

70 Solution Polishing and Extraction After obtaining all stationary points of Eq. [sent-263, score-0.119]

71 (1 1), we can further improve the numerical stability by polishing them via a single damped Newton step. [sent-264, score-0.3]

72 Specifically, assuming that w is a stationary point, we polish w through the updating rule w ← w Δw. [sent-265, score-0.125]

73 w1, − −th Δew polishing strategy can drastically improve the numerical precision, although only one damped Newton step is used. [sent-268, score-0.246]

74 After the polishing step, we only retain those real and physically feasible stationary points with positive definite Hessian, i. [sent-271, score-0.247]

75 a Wnte hcaenvea ioobsse wrivtehd 4 a ≤fe nw ≤ex 5tr,e itm ise cases, in which two widely different stationary points have almost the same objective value, yet the objective value of the correct stationary point is even slightly larger. [sent-280, score-0.237]

76 The authors of DLS [10] provided a remedy to conquer the degeneracy of the Cayley representation by solving DLS three times under differently rotated 3D points. [sent-291, score-0.132]

77 Considering that our objective function is only algebraically meaningful, it might be of great interest to com- it with the reprojection error minimization method. [sent-293, score-0.289]

78 bTehe toretafol rye, d we mrenintim froizme t hhee reprojection error by using ≤th 5e. [sent-296, score-0.158]

79 varying point numbers (1st and 2nd columns, δ=2 pixels) and varying noise levels (3rd and 4th columns, n=10) in case of ordinary-3D, quasi-singular and planar point configuration, shown in (a), (b) and (c), respectively. [sent-332, score-0.157]

80 × × incorporates the symmetric GB solver and the polishing strategy. [sent-333, score-0.241]

81 e Tnchee points are randomly generated in the camera framework. [sent-343, score-0.09]

82 Then, we choose the ground-truth translation ttrue such that the origin of the object framework coincides with the centroid of these 3D points, and rotate these 3D points by using a randomly generated ground-truth rotation matrix Rtrue. [sent-345, score-0.298]

83 eTnhte t htrean dsoltat ipornod error nisd measured by the relative difference between ttrue and t defined as etrans(%) = ||ttrue t||/||t|| 100. [sent-347, score-0.141]

84 We present the average rotation and translation error in the 1st and 2nd column of Fig. [sent-358, score-0.244]

85 At each noise level, we run 500 independent trials and report the average rotation and translation error in the 3rd and 4th column of Fig. [sent-362, score-0.244]

86 However, this does not necessarily mean that any direct minimization method is accurate. [sent-370, score-0.144]

87 2, OPnP has definitely better accuracy than the examined state-of-the-art methods (except DLS+++), irrespective of the point configuration and the point number. [sent-378, score-0.206]

88 Being an algebraic error based method, it is even comparable with the reprojection error based method OPnP+LM. [sent-379, score-0.301]

89 As pointed out by Hartley [7], minimizing a reasonably defined algebraic error might provide accurate results, as long as all constraints are exactly enforced and data are properly normalized. [sent-381, score-0.209]

90 Our OPnP solution exactly handles the challenging rotation constraint and uses centralized 3D points and image projections (Eq. [sent-382, score-0.258]

91 The mean rotation error (left) and the mean translation error (right) w. [sent-392, score-0.383]

92 2 Computational Time The complexity of solving the polynomial system in Eq. [sent-398, score-0.2]

93 We vary the noise level from 0 to 5 pixels and show the mean rotation and translation error over 500 independent trials in Fig. [sent-417, score-0.275]

94 Conclusion We have revisited the PnP problem and proposed the first non-iterative O(n) solution that is fast, general and globally optimal. [sent-427, score-0.118]

95 Our contribution is to parameterize the rotation by 22335500 Figure5. [sent-428, score-0.157]

96 using non-unit quaternion and formulate the PnP problem into an unconstrained optimization problem. [sent-432, score-0.226]

97 Surprisingly, the polynomial system arising from its first-order optimality condition is of odd-degree, thus assuming two-fold symmetry, a nice property that can be utilized to improve speed and numerical stability of a Gr¨ obner basis solver. [sent-433, score-0.659]

98 As verified by experiment results, even with a few point correspondences, our proposed solution is quite accurate, irrespective of the point configuration and the camera pose. [sent-434, score-0.292]

99 A novel [13] [14] [15] [16] [17] [18] [19] [20] [21] parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation. [sent-510, score-0.107]

100 Globally optimal O(n) solution to the PnP problem for general camera models. [sent-557, score-0.13]


similar papers computed by tfidf model

tfidf for this paper:

wordName wordTfidf (topN-words)

[('pnp', 0.428), ('opnp', 0.362), ('dls', 0.34), ('epnp', 0.208), ('quaternion', 0.196), ('polynomial', 0.161), ('lhm', 0.149), ('symmetry', 0.131), ('polishing', 0.128), ('obner', 0.126), ('cayley', 0.113), ('rpnp', 0.113), ('gb', 0.111), ('parameterization', 0.109), ('sdp', 0.105), ('rotation', 0.099), ('planar', 0.085), ('gr', 0.084), ('stationary', 0.082), ('reprojection', 0.081), ('error', 0.077), ('solution', 0.077), ('arising', 0.075), ('remedy', 0.074), ('solver', 0.073), ('optimality', 0.071), ('elimination', 0.068), ('translation', 0.068), ('algebraic', 0.066), ('schweighofer', 0.064), ('ttrue', 0.064), ('damped', 0.063), ('gn', 0.062), ('minimization', 0.059), ('parameterize', 0.058), ('degeneracy', 0.058), ('rotatoin', 0.057), ('transaltoin', 0.057), ('generator', 0.056), ('numerical', 0.055), ('stability', 0.054), ('direct', 0.054), ('camera', 0.053), ('blind', 0.053), ('hesch', 0.052), ('configuration', 0.052), ('tpami', 0.048), ('polynomials', 0.047), ('condition', 0.046), ('projections', 0.045), ('reads', 0.045), ('solutions', 0.045), ('definitely', 0.044), ('acos', 0.043), ('ctrl', 0.043), ('esoratdierg', 0.043), ('garro', 0.043), ('polish', 0.043), ('roumeliotis', 0.043), ('rrt', 0.043), ('rtkrue', 0.043), ('rtrue', 0.043), ('titech', 0.043), ('trigonometric', 0.043), ('relaxation', 0.042), ('globally', 0.041), ('symmetric', 0.04), ('system', 0.039), ('qi', 0.038), ('retrieve', 0.038), ('irrespective', 0.038), ('algebraically', 0.038), ('mtm', 0.038), ('dlt', 0.038), ('yubin', 0.038), ('points', 0.037), ('point', 0.036), ('kuang', 0.035), ('pose', 0.035), ('might', 0.034), ('minimal', 0.034), ('multiview', 0.033), ('unfortunately', 0.032), ('newton', 0.032), ('nice', 0.032), ('pointed', 0.032), ('mean', 0.031), ('universally', 0.031), ('fractional', 0.031), ('kukelova', 0.031), ('template', 0.031), ('degenerate', 0.031), ('inaccurate', 0.031), ('centroid', 0.03), ('rigorously', 0.03), ('strategic', 0.03), ('reciprocal', 0.03), ('unconstrained', 0.03), ('reference', 0.03), ('ms', 0.03)]

similar papers list:

simIndex simValue paperId paperTitle

same-paper 1 0.99999964 353 iccv-2013-Revisiting the PnP Problem: A Fast, General and Optimal Solution

Author: Yinqiang Zheng, Yubin Kuang, Shigeki Sugimoto, Kalle Åström, Masatoshi Okutomi

Abstract: In this paper, we revisit the classical perspective-n-point (PnP) problem, and propose the first non-iterative O(n) solution that is fast, generally applicable and globally optimal. Our basic idea is to formulate the PnP problem into a functional minimization problem and retrieve all its stationary points by using the Gr¨ obner basis technique. The novelty lies in a non-unit quaternion representation to parameterize the rotation and a simple but elegant formulation of the PnP problem into an unconstrained optimization problem. Interestingly, the polynomial system arising from its first-order optimality condition assumes two-fold symmetry, a nice property that can be utilized to improve speed and numerical stability of a Gr¨ obner basis solver. Experiment results have demonstrated that, in terms of accuracy, our proposed solution is definitely better than the state-ofthe-art O(n) methods, and even comparable with the reprojection error minimization method.

2 0.22860433 323 iccv-2013-Pose Estimation with Unknown Focal Length Using Points, Directions and Lines

Author: Yubin Kuang, Kalle Åström

Abstract: In this paper, we study the geometry problems of estimating camera pose with unknown focal length using combination of geometric primitives. We consider points, lines and also rich features such as quivers, i.e. points with one or more directions. We formulate the problems as polynomial systems where the constraints for different primitives are handled in a unified way. We develop efficient polynomial solvers for each of the derived cases with different combinations of primitives. The availability of these solvers enables robust pose estimation with unknown focal length for wider classes of features. Such rich features allow for fewer feature correspondences and generate larger inlier sets with higher probability. We demonstrate in synthetic experiments that our solvers are fast and numerically stable. For real images, we show that our solvers can be used in RANSAC loops to provide good initial solutions.

3 0.17973644 342 iccv-2013-Real-Time Solution to the Absolute Pose Problem with Unknown Radial Distortion and Focal Length

Author: Zuzana Kukelova, Martin Bujnak, Tomas Pajdla

Abstract: Theproblem ofdetermining the absoluteposition andorientation of a camera from a set of 2D-to-3D point correspondences is one of the most important problems in computer vision with a broad range of applications. In this paper we present a new solution to the absolute pose problem for camera with unknown radial distortion and unknown focal length from five 2D-to-3D point correspondences. Our new solver is numerically more stable, more accurate, and significantly faster than the existing state-of-the-art minimal fourpoint absolutepose solvers for this problem. Moreover, our solver results in less solutions and can handle larger radial distortions. The new solver is straightforward and uses only simple concepts from linear algebra. Therefore it is simpler than the state-of-the-art Gr¨ obner basis solvers. We compare our new solver with the existing state-of-theart solvers and show its usefulness on synthetic and real datasets. 1

4 0.17289402 115 iccv-2013-Direct Optimization of Frame-to-Frame Rotation

Author: Laurent Kneip, Simon Lynen

Abstract: This work makes use of a novel, recently proposed epipolar constraint for computing the relative pose between two calibrated images. By enforcing the coplanarity of epipolar plane normal vectors, it constrains the three degrees of freedom of the relative rotation between two camera views directly—independently of the translation. The present paper shows how the approach can be extended to n points, and translated into an efficient eigenvalue minimization over the three rotational degrees of freedom. Each iteration in the non-linear optimization has constant execution time, independently of the number of features. Two global optimization approaches are proposed. The first one consists of an efficient Levenberg-Marquardt scheme with randomized initial value, which already leads to stable and accurate results. The second scheme consists of a globally optimal branch-and-bound algorithm based on a bound on the eigenvalue variation derived from symmetric eigenvalue-perturbation theory. Analysis of the cost function reveals insights into the nature of a specific relative pose problem, and outlines the complexity under different conditions. The algorithm shows state-of-the-art performance w.r.t. essential-matrix based solutions, and a frameto-frame application to a video sequence immediately leads to an alternative, real-time visual odometry solution. Note: All algorithms in this paper are made available in the OpenGV library. Please visit http : / / l aurent kne ip .github . i / opengv o

5 0.095560551 368 iccv-2013-SYM-FISH: A Symmetry-Aware Flip Invariant Sketch Histogram Shape Descriptor

Author: Xiaochun Cao, Hua Zhang, Si Liu, Xiaojie Guo, Liang Lin

Abstract: Recently, studies on sketch, such as sketch retrieval and sketch classification, have received more attention in the computer vision community. One of its most fundamental and essential problems is how to more effectively describe a sketch image. Many existing descriptors, such as shape context, have achieved great success. In this paper, we propose a new descriptor, namely Symmetric-aware Flip Invariant Sketch Histogram (SYM-FISH) to refine the shape context feature. Its extraction process includes three steps. First the Flip Invariant Sketch Histogram (FISH) descriptor is extracted on the input image, which is a flip-invariant version of the shape context feature. Then we explore the symmetry character of the image by calculating the kurtosis coefficient. Finally, the SYM-FISH is generated by constructing a symmetry table. The new SYM-FISH descriptor supplements the original shape context by encoding the symmetric information, which is a pervasive characteristic of natural scene and objects. We evaluate the efficacy of the novel descriptor in two applications, i.e., sketch retrieval and sketch classification. Extensive experiments on three datasets well demonstrate the effectiveness and robustness of the proposed SYM-FISH descriptor.

6 0.088210665 17 iccv-2013-A Global Linear Method for Camera Pose Registration

7 0.085712865 184 iccv-2013-Global Fusion of Relative Motions for Robust, Accurate and Scalable Structure from Motion

8 0.078621298 152 iccv-2013-Extrinsic Camera Calibration without a Direct View Using Spherical Mirror

9 0.07323999 90 iccv-2013-Content-Aware Rotation

10 0.071687728 280 iccv-2013-Multi-view 3D Reconstruction from Uncalibrated Radially-Symmetric Cameras

11 0.070957214 27 iccv-2013-A Robust Analytical Solution to Isometric Shape-from-Template with Focal Length Calibration

12 0.068849333 421 iccv-2013-Total Variation Regularization for Functions with Values in a Manifold

13 0.063400537 292 iccv-2013-Non-convex P-Norm Projection for Robust Sparsity

14 0.062383175 110 iccv-2013-Detecting Curved Symmetric Parts Using a Deformable Disc Model

15 0.058214173 174 iccv-2013-Forward Motion Deblurring

16 0.056095339 140 iccv-2013-Elastic Net Constraints for Shape Matching

17 0.054083813 138 iccv-2013-Efficient and Robust Large-Scale Rotation Averaging

18 0.052215524 133 iccv-2013-Efficient Hand Pose Estimation from a Single Depth Image

19 0.052073803 56 iccv-2013-Automatic Registration of RGB-D Scans via Salient Directions

20 0.051267475 314 iccv-2013-Perspective Motion Segmentation via Collaborative Clustering


similar papers computed by lsi model

lsi for this paper:

topicId topicWeight

[(0, 0.136), (1, -0.075), (2, -0.046), (3, 0.009), (4, -0.042), (5, 0.033), (6, 0.029), (7, -0.055), (8, 0.024), (9, -0.004), (10, 0.025), (11, -0.031), (12, -0.117), (13, -0.018), (14, 0.039), (15, 0.09), (16, 0.089), (17, 0.087), (18, -0.006), (19, -0.015), (20, 0.08), (21, -0.095), (22, -0.076), (23, -0.021), (24, 0.0), (25, -0.007), (26, 0.1), (27, 0.01), (28, -0.09), (29, -0.028), (30, -0.046), (31, 0.036), (32, -0.079), (33, 0.027), (34, -0.045), (35, -0.076), (36, -0.044), (37, -0.043), (38, -0.08), (39, 0.056), (40, -0.028), (41, -0.023), (42, 0.014), (43, -0.036), (44, -0.039), (45, -0.041), (46, 0.083), (47, -0.021), (48, -0.055), (49, -0.099)]

similar papers list:

simIndex simValue paperId paperTitle

same-paper 1 0.93012077 353 iccv-2013-Revisiting the PnP Problem: A Fast, General and Optimal Solution

Author: Yinqiang Zheng, Yubin Kuang, Shigeki Sugimoto, Kalle Åström, Masatoshi Okutomi

Abstract: In this paper, we revisit the classical perspective-n-point (PnP) problem, and propose the first non-iterative O(n) solution that is fast, generally applicable and globally optimal. Our basic idea is to formulate the PnP problem into a functional minimization problem and retrieve all its stationary points by using the Gr¨ obner basis technique. The novelty lies in a non-unit quaternion representation to parameterize the rotation and a simple but elegant formulation of the PnP problem into an unconstrained optimization problem. Interestingly, the polynomial system arising from its first-order optimality condition assumes two-fold symmetry, a nice property that can be utilized to improve speed and numerical stability of a Gr¨ obner basis solver. Experiment results have demonstrated that, in terms of accuracy, our proposed solution is definitely better than the state-ofthe-art O(n) methods, and even comparable with the reprojection error minimization method.

2 0.8988657 323 iccv-2013-Pose Estimation with Unknown Focal Length Using Points, Directions and Lines

Author: Yubin Kuang, Kalle Åström

Abstract: In this paper, we study the geometry problems of estimating camera pose with unknown focal length using combination of geometric primitives. We consider points, lines and also rich features such as quivers, i.e. points with one or more directions. We formulate the problems as polynomial systems where the constraints for different primitives are handled in a unified way. We develop efficient polynomial solvers for each of the derived cases with different combinations of primitives. The availability of these solvers enables robust pose estimation with unknown focal length for wider classes of features. Such rich features allow for fewer feature correspondences and generate larger inlier sets with higher probability. We demonstrate in synthetic experiments that our solvers are fast and numerically stable. For real images, we show that our solvers can be used in RANSAC loops to provide good initial solutions.

3 0.8849166 342 iccv-2013-Real-Time Solution to the Absolute Pose Problem with Unknown Radial Distortion and Focal Length

Author: Zuzana Kukelova, Martin Bujnak, Tomas Pajdla

Abstract: Theproblem ofdetermining the absoluteposition andorientation of a camera from a set of 2D-to-3D point correspondences is one of the most important problems in computer vision with a broad range of applications. In this paper we present a new solution to the absolute pose problem for camera with unknown radial distortion and unknown focal length from five 2D-to-3D point correspondences. Our new solver is numerically more stable, more accurate, and significantly faster than the existing state-of-the-art minimal fourpoint absolutepose solvers for this problem. Moreover, our solver results in less solutions and can handle larger radial distortions. The new solver is straightforward and uses only simple concepts from linear algebra. Therefore it is simpler than the state-of-the-art Gr¨ obner basis solvers. We compare our new solver with the existing state-of-theart solvers and show its usefulness on synthetic and real datasets. 1

4 0.8337658 27 iccv-2013-A Robust Analytical Solution to Isometric Shape-from-Template with Focal Length Calibration

Author: Adrien Bartoli, Daniel Pizarro, Toby Collins

Abstract: We study the uncalibrated isometric Shape-fromTemplate problem, that consists in estimating an isometric deformation from a template shape to an input image whose focal length is unknown. Our method is the first that combines the following features: solving for both the 3D deformation and the camera ’s focal length, involving only local analytical solutions (there is no numerical optimization), being robust to mismatches, handling general surfaces and running extremely fast. This was achieved through two key steps. First, an ‘uncalibrated’ 3D deformation is computed thanks to a novel piecewise weak-perspective projection model. Second, the camera’s focal length is estimated and enables upgrading the 3D deformation to metric. We use a variational framework, implemented using a smooth function basis and sampled local deformation models. The only degeneracy which we easily detect– for focal length estimation is a flat and fronto-parallel surface. Experimental results on simulated and real datasets show that our method achieves a 3D shape accuracy – slightly below state of the art methods using a precalibrated or the true focal length, and a focal length accuracy slightly below static calibration methods.

5 0.79942364 115 iccv-2013-Direct Optimization of Frame-to-Frame Rotation

Author: Laurent Kneip, Simon Lynen

Abstract: This work makes use of a novel, recently proposed epipolar constraint for computing the relative pose between two calibrated images. By enforcing the coplanarity of epipolar plane normal vectors, it constrains the three degrees of freedom of the relative rotation between two camera views directly—independently of the translation. The present paper shows how the approach can be extended to n points, and translated into an efficient eigenvalue minimization over the three rotational degrees of freedom. Each iteration in the non-linear optimization has constant execution time, independently of the number of features. Two global optimization approaches are proposed. The first one consists of an efficient Levenberg-Marquardt scheme with randomized initial value, which already leads to stable and accurate results. The second scheme consists of a globally optimal branch-and-bound algorithm based on a bound on the eigenvalue variation derived from symmetric eigenvalue-perturbation theory. Analysis of the cost function reveals insights into the nature of a specific relative pose problem, and outlines the complexity under different conditions. The algorithm shows state-of-the-art performance w.r.t. essential-matrix based solutions, and a frameto-frame application to a video sequence immediately leads to an alternative, real-time visual odometry solution. Note: All algorithms in this paper are made available in the OpenGV library. Please visit http : / / l aurent kne ip .github . i / opengv o

6 0.6754635 436 iccv-2013-Unsupervised Intrinsic Calibration from a Single Frame Using a "Plumb-Line" Approach

7 0.67258483 90 iccv-2013-Content-Aware Rotation

8 0.66857225 152 iccv-2013-Extrinsic Camera Calibration without a Direct View Using Spherical Mirror

9 0.65916693 49 iccv-2013-An Enhanced Structure-from-Motion Paradigm Based on the Absolute Dual Quadric and Images of Circular Points

10 0.64484835 141 iccv-2013-Enhanced Continuous Tabu Search for Parameter Estimation in Multiview Geometry

11 0.64455044 138 iccv-2013-Efficient and Robust Large-Scale Rotation Averaging

12 0.63116181 184 iccv-2013-Global Fusion of Relative Motions for Robust, Accurate and Scalable Structure from Motion

13 0.63091594 17 iccv-2013-A Global Linear Method for Camera Pose Registration

14 0.58044499 280 iccv-2013-Multi-view 3D Reconstruction from Uncalibrated Radially-Symmetric Cameras

15 0.56338447 185 iccv-2013-Go-ICP: Solving 3D Registration Efficiently and Globally Optimally

16 0.54666334 348 iccv-2013-Refractive Structure-from-Motion on Underwater Images

17 0.50434858 140 iccv-2013-Elastic Net Constraints for Shape Matching

18 0.4902851 421 iccv-2013-Total Variation Regularization for Functions with Values in a Manifold

19 0.46906126 250 iccv-2013-Lifting 3D Manhattan Lines from a Single Image

20 0.4684543 292 iccv-2013-Non-convex P-Norm Projection for Robust Sparsity


similar papers computed by lda model

lda for this paper:

topicId topicWeight

[(2, 0.046), (7, 0.08), (26, 0.065), (27, 0.031), (31, 0.047), (34, 0.025), (42, 0.133), (45, 0.219), (64, 0.024), (73, 0.036), (89, 0.153), (95, 0.014), (98, 0.025)]

similar papers list:

simIndex simValue paperId paperTitle

same-paper 1 0.80944312 353 iccv-2013-Revisiting the PnP Problem: A Fast, General and Optimal Solution

Author: Yinqiang Zheng, Yubin Kuang, Shigeki Sugimoto, Kalle Åström, Masatoshi Okutomi

Abstract: In this paper, we revisit the classical perspective-n-point (PnP) problem, and propose the first non-iterative O(n) solution that is fast, generally applicable and globally optimal. Our basic idea is to formulate the PnP problem into a functional minimization problem and retrieve all its stationary points by using the Gr¨ obner basis technique. The novelty lies in a non-unit quaternion representation to parameterize the rotation and a simple but elegant formulation of the PnP problem into an unconstrained optimization problem. Interestingly, the polynomial system arising from its first-order optimality condition assumes two-fold symmetry, a nice property that can be utilized to improve speed and numerical stability of a Gr¨ obner basis solver. Experiment results have demonstrated that, in terms of accuracy, our proposed solution is definitely better than the state-ofthe-art O(n) methods, and even comparable with the reprojection error minimization method.

2 0.79928398 117 iccv-2013-Discovering Details and Scene Structure with Hierarchical Iconoid Shift

Author: Tobias Weyand, Bastian Leibe

Abstract: Current landmark recognition engines are typically aimed at recognizing building-scale landmarks, but miss interesting details like portals, statues or windows. This is because they use a flat clustering that summarizes all photos of a building facade in one cluster. We propose Hierarchical Iconoid Shift, a novel landmark clustering algorithm capable of discovering such details. Instead of just a collection of clusters, the output of HIS is a set of dendrograms describing the detail hierarchy of a landmark. HIS is based on the novel Hierarchical Medoid Shift clustering algorithm that performs a continuous mode search over the complete scale space. HMS is completely parameter-free, has the same complexity as Medoid Shift and is easy to parallelize. We evaluate HIS on 800k images of 34 landmarks and show that it can extract an often surprising amount of detail and structure that can be applied, e.g., to provide a mobile user with more detailed information on a landmark or even to extend the landmark’s Wikipedia article.

3 0.71230567 291 iccv-2013-No Matter Where You Are: Flexible Graph-Guided Multi-task Learning for Multi-view Head Pose Classification under Target Motion

Author: Yan Yan, Elisa Ricci, Ramanathan Subramanian, Oswald Lanz, Nicu Sebe

Abstract: We propose a novel Multi-Task Learning framework (FEGA-MTL) for classifying the head pose of a person who moves freely in an environment monitored by multiple, large field-of-view surveillance cameras. As the target (person) moves, distortions in facial appearance owing to camera perspective and scale severely impede performance of traditional head pose classification methods. FEGA-MTL operates on a dense uniform spatial grid and learns appearance relationships across partitions as well as partition-specific appearance variations for a given head pose to build region-specific classifiers. Guided by two graphs which a-priori model appearance similarity among (i) grid partitions based on camera geometry and (ii) head pose classes, the learner efficiently clusters appearancewise related grid partitions to derive the optimal partitioning. For pose classification, upon determining the target’s position using a person tracker, the appropriate regionspecific classifier is invoked. Experiments confirm that FEGA-MTL achieves state-of-the-art classification with few training data.

4 0.71052682 156 iccv-2013-Fast Direct Super-Resolution by Simple Functions

Author: Chih-Yuan Yang, Ming-Hsuan Yang

Abstract: The goal of single-image super-resolution is to generate a high-quality high-resolution image based on a given low-resolution input. It is an ill-posed problem which requires exemplars or priors to better reconstruct the missing high-resolution image details. In this paper, we propose to split the feature space into numerous subspaces and collect exemplars to learn priors for each subspace, thereby creating effective mapping functions. The use of split input space facilitates both feasibility of using simple functionsfor super-resolution, and efficiency ofgenerating highresolution results. High-quality high-resolution images are reconstructed based on the effective learned priors. Experimental results demonstrate that theproposed algorithmperforms efficiently and effectively over state-of-the-art methods.

5 0.71037024 212 iccv-2013-Image Set Classification Using Holistic Multiple Order Statistics Features and Localized Multi-kernel Metric Learning

Author: Jiwen Lu, Gang Wang, Pierre Moulin

Abstract: This paper presents a new approach for image set classification, where each training and testing example contains a set of image instances of an object captured from varying viewpoints or under varying illuminations. While a number of image set classification methods have been proposed in recent years, most of them model each image set as a single linear subspace or mixture of linear subspaces, which may lose some discriminative information for classification. To address this, we propose exploring multiple order statistics as features of image sets, and develop a localized multikernel metric learning (LMKML) algorithm to effectively combine different order statistics information for classification. Our method achieves the state-of-the-art performance on four widely used databases including the Honda/UCSD, CMU Mobo, and Youtube face datasets, and the ETH-80 object dataset.

6 0.70850235 137 iccv-2013-Efficient Salient Region Detection with Soft Image Abstraction

7 0.70815575 427 iccv-2013-Transfer Feature Learning with Joint Distribution Adaptation

8 0.70635635 259 iccv-2013-Manifold Based Face Synthesis from Sparse Samples

9 0.70614249 323 iccv-2013-Pose Estimation with Unknown Focal Length Using Points, Directions and Lines

10 0.70297027 178 iccv-2013-From Semi-supervised to Transfer Counting of Crowds

11 0.70183653 415 iccv-2013-Text Localization in Natural Images Using Stroke Feature Transform and Text Covariance Descriptors

12 0.70062226 392 iccv-2013-Similarity Metric Learning for Face Recognition

13 0.6986081 376 iccv-2013-Scene Text Localization and Recognition with Oriented Stroke Detection

14 0.69843018 342 iccv-2013-Real-Time Solution to the Absolute Pose Problem with Unknown Radial Distortion and Focal Length

15 0.69620532 26 iccv-2013-A Practical Transfer Learning Algorithm for Face Verification

16 0.69614744 27 iccv-2013-A Robust Analytical Solution to Isometric Shape-from-Template with Focal Length Calibration

17 0.69456494 232 iccv-2013-Latent Space Sparse Subspace Clustering

18 0.69372058 360 iccv-2013-Robust Subspace Clustering via Half-Quadratic Minimization

19 0.69339973 330 iccv-2013-Proportion Priors for Image Sequence Segmentation

20 0.69335735 79 iccv-2013-Coherent Object Detection with 3D Geometric Context from a Single Image