Schwarps: Locally Projective Image Warps Based on 2D Schwarzian Derivatives

作者: Rahat Khan , Daniel Pizarro , Adrien Bartoli

DOI: 10.1007/978-3-319-10593-2_1

关键词: Invariant (mathematics)Projective structureSmoothnessImage registrationAlgorithmAffine transformationCamera resectioningExtrapolationCurrent (mathematics)Partial derivativeSurface (mathematics)Differential (infinitesimal)3D reconstructionComputer sciencePartial differential equation

摘要: Image warps -or just warps- capture the geometric deformation existing between two images of a deforming surface. The current approach to enforce warp’s smoothness is penalize its second order partial derivatives. Because this favors locally affine warps, fails local projective component image deformation. This may have negative impact on applications such as registration and deformable 3D reconstruction. We propose novel penalty designed smooth warp while capturing deformation’s structure. Our based equivalents Schwarzian derivatives, which are differential invariants exactly preserved by homographies. methodology derive set Partial Differential Equations with homographies solutions. call system equations we explicitly them for 2D functions using properties name Schwarp estimated penalizing residual equations. Experimental evaluation shows that Schwarps outperform in modeling extrapolation power, lead far better results Shape-from-Template camera calibration from

参考文章(28)
Adrien Bartoli, Mathieu Perriollat, Sylvie Chambon, Generalized Thin-Plate Spline Warps International Journal of Computer Vision. ,vol. 88, pp. 85- 110 ,(2010) , 10.1007/S11263-009-0303-4
Daniel Rueckert, Luke I Sonoda, Carmel Hayes, Derek LG Hill, Martin O Leach, David J Hawkes, Nonrigid registration using free-form deformations: application to breast MR images IEEE Transactions on Medical Imaging. ,vol. 18, pp. 712- 721 ,(1999) , 10.1109/42.796284
L. Torresani, A. Hertzmann, C. Bregler, Nonrigid Structure-from-Motion: Estimating Shape and Motion with Hierarchical Priors IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 30, pp. 878- 892 ,(2008) , 10.1109/TPAMI.2007.70752
Mathieu Salzmann, Julien Pilet, Slobodan Ilic, Pascal Fua, None, Surface Deformation Models for Nonrigid 3D Shape Recovery IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 29, pp. 1481- 1487 ,(2007) , 10.1109/TPAMI.2007.1080
Guo Lei, Recognition of planar objects in 3-D space from single perspective views using cross ratio international conference on robotics and automation. ,vol. 6, pp. 432- 437 ,(1990) , 10.1109/70.59368
F.L. Bookstein, Principal warps: thin-plate splines and the decomposition of deformations IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 11, pp. 567- 585 ,(1989) , 10.1109/34.24792
Julien Pilet, Vincent Lepetit, Pascal Fua, Fast Non-Rigid Surface Detection, Registration and Realistic Augmentation International Journal of Computer Vision. ,vol. 76, pp. 109- 122 ,(2008) , 10.1007/S11263-006-0017-9
Svetlana Lazebnik, Jean Ponce, The Local Projective Shape of Smooth Surfaces and Their Outlines International Journal of Computer Vision. ,vol. 63, pp. 65- 83 ,(2005) , 10.1007/S11263-005-4947-4
Kalle Astrom, Fundamental limitations on projective invariants of planar curves IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 17, pp. 77- 81 ,(1995) , 10.1109/34.368148