Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Tasks
作者： Michelle A. Lee , Yuke Zhu , Peter Zachares , Matthew Tan , Krishnan Srinivasan
关键词:
摘要: Contact-rich manipulation tasks in unstructured environments often require both haptic and visual feedback. It is nontrivial to manually design a robot controller that combines these …
arxiv.org
sci-hub.se 参考文章(78)
Konstantinos Bousmalis, Alex Irpan, Paul Wohlhart, Yunfei Bai, Matthew Kelcey, Mrinal Kalakrishnan, Laura Downs, Julian Ibarz, Peter Pastor, Kurt Konolige, Sergey Levine, Vincent Vanhoucke, Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Grasping 2018 IEEE International Conference on Robotics and Automation (ICRA). pp. 4243- 4250 ,(2018) , 10.1109/ICRA.2018.8460875
Andrew Owens, Alexei A. Efros, Audio-Visual Scene Analysis with Self-Supervised Multisensory Features european conference on computer vision. pp. 639- 658 ,(2018) , 10.1007/978-3-030-01231-1_39
Edward H. Adelson, Roberto Calandra, Sergey Levine, Wenzhen Yuan, Justin Lin, Manu Upadhyaya, Andrew Owens, The Feeling of Success: Does Touch Sensing Help Predict Grasp Outcomes? Conference on Robot Learning. pp. 314- 323 ,(2017)
Noah D. Goodman, Mike Wu, Multimodal Generative Models for Scalable Weakly-Supervised Learning neural information processing systems. ,vol. 31, pp. 5575- 5585 ,(2018)
Justin Fu, Sergey Levine, Pieter Abbeel, One-shot learning of manipulation skills with online dynamics adaptation and neural network priors intelligent robots and systems. pp. 4019- 4026 ,(2016) , 10.1109/IROS.2016.7759592
Chelsea Finn, Sergey Levine, Roy H. Campbell, Dumitru Erhan, Mohammad Babaeizadeh, Stochastic Variational Video Prediction international conference on learning representations. ,(2018)
Yang Gao, Lisa Anne Hendricks, Katherine J. Kuchenbecker, Trevor Darrell, Deep learning for tactile understanding from visual and haptic data international conference on robotics and automation. pp. 536- 543 ,(2016) , 10.1109/ICRA.2016.7487176
Yuke Zhu, Ziyu Wang, Josh Merel, Andrei Rusu, Tom Erez, Serkan Cabi, Saran Tunyasuvunakool, János Kramár, Raia Hadsell, Nando de Freitas, Nicolas Heess, Reinforcement and Imitation Learning for Diverse Visuomotor Skills robotics science and systems. ,vol. 14, ,(2018) , 10.15607/RSS.2018.XIV.009
George Kantor, Guan-Horng Liu, Manuela M. Veloso, Avinash Siravuru, Sai P. Selvaraj, Learning End-to-end Multimodal Sensor Policies for Autonomous Navigation. Conference on Robot Learning. pp. 249- 261 ,(2017)
Kuan-Ting Yu, Alberto Rodriguez, Realtime State Estimation with Tactile and Visual Sensing for Inserting a Suction-held Object intelligent robots and systems. pp. 1628- 1635 ,(2018) , 10.1109/IROS.2018.8594077