iGibson, a Simulation Environment for Interactive Tasks in Large Realistic Scenes.

作者: Silvio Savarese , Li Fei-Fei , Roberto Martín-Martín , Linxi Fan , Fei Xia

DOI:

关键词:

摘要: We present iGibson, a novel simulation environment to develop robotic solutions for interactive tasks in large-scale realistic scenes. Our contains fifteen fully home-sized scenes populated with rigid and articulated objects. The are replicas of 3D scanned real-world homes, aligning the distribution objects layout that real world. iGibson integrates several key features facilitate study tasks: i) generation high-quality visual virtual sensor signals (RGB, depth, segmentation, LiDAR, flow, among others), ii) domain randomization change materials (both texture dynamics) and/or their shapes, iii) integrated sampling-based motion planners generate collision-free trajectories robot bases arms, iv) intuitive human-iGibson interface enables efficient collection human demonstrations. Through experiments, we show full interactivity agents learn useful representations accelerate training downstream manipulation tasks. also enable generalization navigation agents, imitation learning simple demonstrated behaviors. is open-sourced comprehensive examples documentation. For more information, visit our project website: this http URL

参考文章(65)
S. Lavalle, Rapidly-exploring random trees : a new tool for path planning The annual research report. ,(1998)
Diederik P. Kingma, Jimmy Ba, Adam: A Method for Stochastic Optimization arXiv: Learning. ,(2014)
Changhyun Choi, Henrik I. Christensen, RGB-D object pose estimation in unstructured environments Robotics and Autonomous Systems. ,vol. 75, pp. 595- 613 ,(2016) , 10.1016/J.ROBOT.2015.09.020
Philipp Fischer, Thomas Brox, None, U-Net: Convolutional Networks for Biomedical Image Segmentation medical image computing and computer assisted intervention. pp. 234- 241 ,(2015) , 10.1007/978-3-319-24574-4_28
Kris Hauser, Victor Ng-Thow-Hing, Fast smoothing of manipulator trajectories using optimal bounded-acceleration shortcuts international conference on robotics and automation. pp. 2493- 2498 ,(2010) , 10.1109/ROBOT.2010.5509683
Christophe Schlick, An inexpensive BRDF model for physically-based rendering Computer Graphics Forum. ,vol. 13, pp. 233- 246 ,(1994) , 10.1111/1467-8659.1330233
Ahmed Hussain Qureshi, Yasar Ayaz, Intelligent bidirectional rapidly-exploring random trees for optimal motion planning in complex cluttered environments Robotics and Autonomous Systems. ,vol. 68, pp. 1- 11 ,(2015) , 10.1016/J.ROBOT.2015.02.007
Arthur Guez, David Silver, Hado van Hasselt, Deep reinforcement learning with double Q-Learning national conference on artificial intelligence. pp. 2094- 2100 ,(2016)
Emanuel Todorov, Tom Erez, Yuval Tassa, MuJoCo: A physics engine for model-based control intelligent robots and systems. pp. 5026- 5033 ,(2012) , 10.1109/IROS.2012.6386109
R. Bohlin, L.E. Kavraki, Path planning using lazy PRM international conference on robotics and automation. ,vol. 1, pp. 521- 528 ,(2000) , 10.1109/ROBOT.2000.844107