SuperPoint: Self-Supervised Interest Point Detection and Description

作者: Daniel DeTone , Tomasz Malisiewicz , Andrew Rabinovich

DOI: 10.1109/CVPRW.2018.00060

关键词:

摘要: This paper presents a self-supervised framework for training interest point detectors and descriptors suitable large number of multiple-view geometry problems in computer vision. As opposed to patch-based neural networks, our fully-convolutional model operates on full-sized images jointly computes pixel-level locations associated one forward pass. We introduce Homographic Adaptation, multi-scale, multi-homography approach boosting detection repeatability performing cross-domain adaptation (e.g., synthetic-to-real). Our model, when trained the MS-COCO generic image dataset using is able repeatedly detect much richer set points than initial pre-adapted deep any other traditional corner detector. The final system gives rise state-of-the-art homography estimation results HPatches compared LIFT, SIFT ORB.

参考文章(28)
Cordelia Schmid, Roger Mohr, Christian Bauckhage, Evaluation of Interest Point Detectors International Journal of Computer Vision. ,vol. 37, pp. 151- 172 ,(2000) , 10.1023/A:1008199403446
Edward Rosten, Tom Drummond, Machine learning for high-speed corner detection european conference on computer vision. pp. 430- 443 ,(2006) , 10.1007/11744023_34
Raul Mur-Artal, J. M. M. Montiel, Juan D. Tardos, ORB-SLAM: A Versatile and Accurate Monocular SLAM System IEEE Transactions on Robotics. ,vol. 31, pp. 1147- 1163 ,(2015) , 10.1109/TRO.2015.2463671
Karen Simonyan, Andrew Zisserman, Very Deep Convolutional Networks for Large-Scale Image Recognition computer vision and pattern recognition. ,(2014)
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, C. Lawrence Zitnick, Microsoft COCO: Common Objects in Context Computer Vision – ECCV 2014. pp. 740- 755 ,(2014) , 10.1007/978-3-319-10602-1_48
Yannick Verdie, Kwang Moo Yi, Pascal Fua, Vincent Lepetit, TILDE: A Temporally Invariant Learned DEtector computer vision and pattern recognition. pp. 5279- 5288 ,(2015) , 10.1109/CVPR.2015.7299165
Richard Hartley, Andrew Zisserman, Multiple view geometry in computer vision ,(2000)
C. Harris, M. Stephens, A COMBINED CORNER AND EDGE DETECTOR alvey vision conference. pp. 147- 151 ,(1988) , 10.5244/C.2.23
Ethan Rublee, Vincent Rabaud, Kurt Konolige, Gary Bradski, ORB: An efficient alternative to SIFT or SURF international conference on computer vision. pp. 2564- 2571 ,(2011) , 10.1109/ICCV.2011.6126544
Jianbo Shi, Tomasi, Good features to track computer vision and pattern recognition. pp. 593- 600 ,(1994) , 10.1109/CVPR.1994.323794