Shape-From-Template with Curves

作者: Mathias Gallardo , Daniel Pizarro , Toby Collins , Adrien Bartoli

DOI: 10.1007/S11263-019-01214-Z

关键词: Image (mathematics)Partial differential equationReconstruction methodCritical point (mathematics)Surface (mathematics)Hidden Markov modelMathematical analysisDeformation (mechanics)MathematicsPattern recognition (psychology)

摘要: Shape-from-Template (SfT) is the problem of using a shape template to infer deformable object observed in an image. The usual case SfT ‘Surface’ SfT, where 2D surface embedded 3D, and image perspective projection. We introduce ‘Curve’ comprising two new cases 1D curve. first when curve second 3D present thorough theoretical study these for isometric deformations, which are good approximation ropes, cables wires. Unlike Surface we show that Curve only ever solvable up discrete ambiguities. necessary sufficient conditions solvability with critical point analysis. further unlike cannot be solved locally exact non-holonomic Partial Differential Equations. Our main technical contributions two-fold. First, give stable, global reconstruction method models as Hidden Markov Model. This can generate all candidate solutions. Second, non-convex refinement novel angle-based deformation parameterization. quantitative qualitative results showing real shaped objects such necklace successfully reconstructed SfT.

参考文章(45)
Toby Collins, Adrien Bartoli, Nicolas Bourdel, Michel Canis, Robust, Real-Time, Dense and Deformable 3D Organ Tracking in Laparoscopic Videos medical image computing and computer assisted intervention. pp. 404- 412 ,(2016) , 10.1007/978-3-319-46720-7_47
J. Lofberg, YALMIP : a toolbox for modeling and optimization in MATLAB international conference on robotics and automation. pp. 284- 289 ,(2004) , 10.1109/CACSD.2004.1393890
Erol Özgür, Adrien Bartoli, Particle-SfT: A Provably-Convergent, Fast Shape-from-Template Algorithm International Journal of Computer Vision. ,vol. 123, pp. 184- 205 ,(2017) , 10.1007/S11263-016-0968-4
Adrien Bartoli, Erol Ozgur, A Perspective on Non-Isometric Shape-from-Template international symposium on mixed and augmented reality. pp. 5- 10 ,(2016) , 10.1109/ISMAR-ADJUNCT.2016.0026
Mathias Gallardo, Toby Collins, Adrien Bartoli, Using Shading and a 3D Template to Reconstruct Complex Surface Deformations. british machine vision conference. ,(2016) , 10.5244/C.30.38
Daniel Pizarro, David Casillas-Perez, Solutions of Quadratic First-Order ODEs applied to Computer Vision Problems. arXiv: Numerical Analysis. ,(2017)
Qi Liu-Yin, Rui Yu, Lourdes Agapito, Andrew Fitzgibbon, Chris Russell, Better Together: Joint Reasoning for Non-rigid 3D Reconstruction with Specularities and Shading Procedings of the British Machine Vision Conference 2016. ,(2016) , 10.5244/C.30.42
Rikard Berthilsson, Kalle Åström, Anders Heyden, Reconstruction of General Curves, Using Factorization and Bundle Adjustment International Journal of Computer Vision. ,vol. 41, pp. 171- 182 ,(2001) , 10.1023/A:1011104020586
Catalina Sbert, Andreas F. Solé, 3D Curves Reconstruction Based on Deformable Models Journal of Mathematical Imaging and Vision. ,vol. 18, pp. 211- 223 ,(2003) , 10.1023/A:1022821409482
H. Martinsson, F. Gaspard, A. Bartoli, J. -M. Lavest, Energy-based reconstruction of 3D curves for quality control energy minimization methods in computer vision and pattern recognition. pp. 414- 428 ,(2007) , 10.1007/978-3-540-74198-5_32