Learning to predict part mobility from a single static snapshot

作者: Ruizhen Hu , Wenchao Li , Oliver Van Kaick , Ariel Shamir , Hao Zhang

DOI: 10.1145/3130800.3130811

关键词:

摘要: We introduce a method for learning model the mobility of parts in 3D objects. Our allows not only to understand dynamic functionalities one or more object, but also apply functions static models. Specifically, learned part can predict mobilities object given form single snapshot reflecting spatial configuration space, and transfer from relevant units training data. The data consists set different motion types. Each unit is composed pair (one moving reference part), along with usage examples consisting few snapshots capturing states unit. Taking advantage linearity characteristic exhibited by most motions everyday objects, utilizing part-relation descriptors, we define mapping units. This employs motion-dependent snapshot-to-unit distance obtained via metric learning. show that our scheme leads accurate prediction proper transfer. demonstrate other applications such as motion-driven detection hierarchy construction.

参考文章(28)
Harald Steck, Hinge Rank Loss and the Area Under the ROC Curve european conference on machine learning. pp. 347- 358 ,(2007) , 10.1007/978-3-540-74958-5_33
Andrei Sharf, Hui Huang, Cheng Liang, Jiapei Zhang, Baoquan Chen, Minglun Gong, Mobility-Trees for Indoor Scenes Manipulation Computer Graphics Forum. ,vol. 33, pp. 2- 14 ,(2014) , 10.1111/CGF.12204
Yixin Zhu, Yibiao Zhao, Song-Chun Zhu, Understanding tools: Task-oriented object modeling, learning and recognition computer vision and pattern recognition. pp. 2855- 2864 ,(2015) , 10.1109/CVPR.2015.7298903
Xi Zhao, He Wang, Taku Komura, Indexing 3D Scenes Using the Interaction Bisector Surface ACM Transactions on Graphics. ,vol. 33, pp. 22- ,(2014) , 10.1145/2574860
Tianjia Shao, Wilmot Li, Kun Zhou, Weiwei Xu, Baining Guo, Niloy J. Mitra, Interpreting concept sketches international conference on computer graphics and interactive techniques. ,vol. 32, pp. 56- ,(2013) , 10.1145/2461912.2462003
Jun Wang, KangKang Yin, Kun Zhou, Michiel van de Panne, Falai Chen, Baining Guo, Joint-aware manipulation of deformable models international conference on computer graphics and interactive techniques. ,vol. 28, pp. 35- ,(2009) , 10.1145/1531326.1531341
Tucker Hermans, Fuxin Li, James M. Rehg, Aaron F. Bobick, Learning contact locations for pushing and orienting unknown objects ieee-ras international conference on humanoid robots. pp. 435- 442 ,(2013) , 10.1109/HUMANOIDS.2013.7030011
Art Tevs, Alexander Berner, Michael Wand, Ivo Ihrke, Martin Bokeloh, Jens Kerber, Hans-Peter Seidel, Animation cartography—intrinsic reconstruction of shape and motion ACM Transactions on Graphics. ,vol. 31, pp. 1- 15 ,(2012) , 10.1145/2159516.2159517
Helmut Grabner, Juergen Gall, Luc Van Gool, What makes a chair a chair computer vision and pattern recognition. pp. 1529- 1536 ,(2011) , 10.1109/CVPR.2011.5995327
Manolis Savva, Angel X. Chang, Pat Hanrahan, Matthew Fisher, Matthias Nießner, SceneGrok: inferring action maps in 3D environments international conference on computer graphics and interactive techniques. ,vol. 33, pp. 212- ,(2014) , 10.1145/2661229.2661230