Robot Shaping: An Experiment in Behavior Engineering

作者: Marco Colombetti , Marco Dorigo

DOI:

关键词:

摘要: From the Publisher: foreword by Lashon Booker "[This] book gives a clear and comprehensive exposition of [the authors] extensive experience in integrating reinforcement learning autonomous robotics. Their continuing contribution is to development distinct engineering discipline (`Behavior engineering') through which such robots can be created. I am excited because their efforts combine some best theoretical ideas with strong eye for practical - what will actually work." -- Stewart W. Wilson, The Rowland Institute Science To program an robot act reliably dynamic environment complex task. dynamics are unpredictable, robots' sensors provide noisy input. A robot, one that acquire knowledge interaction its then adapt behavior, greatly simplifies designer's work. need not given all details environment, actuators finely tuned. Robot Shaping about designing building robots. term "shaping" comes from experimental psychology, where it describes incremental training animals. authors propose new discipline, "behavior engineering," methodologies tools creating techniques based on classifier systems, architecture originated John Holland, they have added several ideas, as "mutespec," system "energy," population size. In present Behavior Analysis Training (BAT) example behavior methodology.

参考文章(22)
Richard S. Sutton, Learning to Predict by the Methods of Temporal Differences Machine Learning. ,vol. 3, pp. 9- 44 ,(1988) , 10.1023/A:1022633531479
L. P. Kaelbling, M. L. Littman, A. W. Moore, Reinforcement learning: a survey Journal of Artificial Intelligence Research. ,vol. 4, pp. 237- 285 ,(1996) , 10.1613/JAIR.301
M. Dorigo, U. Schnepf, Genetics-based machine learning and behavior-based robotics: a new synthesis systems man and cybernetics. ,vol. 23, pp. 141- 154 ,(1993) , 10.1109/21.214773
Luc Steels, The artificial life roots of artificial intelligence Artificial Life. ,vol. 1, pp. 75- 110 ,(1993) , 10.1162/ARTL.1993.1.75
M. Dorigo, U. Schnepf, Organisation of robot behaviour through genetic learning processes international conference on advanced robotics robots in unstructured environments. pp. 1456- 1460 ,(1991) , 10.1109/ICAR.1991.240535
Dave Cliff, Phil Husbands, Inman Harvey, Explorations in evolutionary robotics Adaptive Behavior. ,vol. 2, pp. 73- 110 ,(1993) , 10.1177/105971239300200104
Rodney A. Brooks, Pattie Maes, Learning to coordinate behaviors national conference on artificial intelligence. pp. 796- 802 ,(1990)
Paul R. Thagard, Richard E. Nisbett, Keith J. Holyoak, John H. Holland, Stephen W. Smoliar, Induction: Processes of Inference, Learning, and Discovery ,(1989)
Rodney A. Brooks, Intelligence without representation Artificial Intelligence. ,vol. 47, pp. 139- 159 ,(1991) , 10.1016/0004-3702(91)90053-M