An Exploration of Embodied Visual Exploration

作者: Kristen Grauman , Santhosh K. Ramakrishnan , Dinesh Jayaraman

DOI:

关键词: Scope (project management)Data scienceRobotEmbodied cognitionExploration problemComputer sciencePerceptionEmpirical research

摘要: Embodied computer vision considers perception for robots in novel, unstructured environments. Of particular importance is the embodied visual exploration problem: how might a robot equipped with camera scope out new environment? Despite progress thus far, many basic questions pertinent to this problem remain unanswered: (i) What does it mean an agent explore its environment well? (ii) Which methods work well, and under which assumptions environmental settings? (iii) Where do current approaches fall short, where future seek improve? Seeking answers these questions, we first present taxonomy existing algorithms create standard framework benchmarking them. We then perform thorough empirical study of four state-of-the-art paradigms using proposed two photorealistic simulated 3D environments, architecture, diverse evaluation metrics. Our experimental results offer insights suggest performance metrics baselines exploration. Code, models data are publicly available: https URL

参考文章(72)
Amir Roshan Zamir, Khurram Soomro, Mubarak Shah, UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild arXiv: Computer Vision and Pattern Recognition. ,(2012)
Diederik P. Kingma, Jimmy Ba, Adam: A Method for Stochastic Optimization arXiv: Learning. ,(2014)
Yi Sun, Faustino Gomez, Jürgen Schmidhuber, Planning to be surprised: optimal Bayesian exploration in dynamic environments artificial general intelligence. pp. 41- 51 ,(2011) , 10.1007/978-3-642-22887-2_5
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, C. Lawrence Zitnick, Microsoft COCO: Common Objects in Context Computer Vision – ECCV 2014. pp. 740- 755 ,(2014) , 10.1007/978-3-319-10602-1_48
J. Schmidhuber, Curious model-building control systems international joint conference on neural network. pp. 1458- 1463 ,(1991) , 10.1109/IJCNN.1991.170605
Çaglar Gülçehre, Yoshua Bengio, Yoshua Bengio, Yoshua Bengio, KyungHyun Cho, Junyoung Chung, Empirical evaluation of gated recurrent neural networks on sequence modeling arXiv: Neural and Evolutionary Computing. ,(2014)
Peter Hart, Nils Nilsson, Bertram Raphael, A Formal Basis for the Heuristic Determination of Minimum Cost Paths IEEE Transactions on Systems Science and Cybernetics. ,vol. 4, pp. 100- 107 ,(1968) , 10.1109/TSSC.1968.300136
Alexander L. Strehl, Michael L. Littman, An analysis of model-based Interval Estimation for Markov Decision Processes Journal of Computer and System Sciences. ,vol. 74, pp. 1309- 1331 ,(2008) , 10.1016/J.JCSS.2007.08.009
William S. Lovejoy, A survey of algorithmic methods for partially observed Markov decision processes Annals of Operations Research. ,vol. 28, pp. 47- 66 ,(1991) , 10.1007/BF02055574
Martin A. Fischler, Robert C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography Communications of The ACM. ,vol. 24, pp. 381- 395 ,(1981) , 10.1145/358669.358692