Approximating Arbitrary Reinforcement Signal by Learning Classifier Systems using Micro Genetic Algorithm

作者: Ali Hamzeh , Adel Rahmani

DOI:

关键词:

摘要: Learning Classifier Systems are Evolutionary mechanisms which combine Genetic Algorithm and the Reinforcement paradigm. try to evolve state-action-reward mappings propose best action for each environmental state maximize achieved reward. In first versions of learning classifier systems, state-action pairs can only be mapped a constant real-valued So model fairly complex environment, LCSs had develop redundant different reward values. But an extension well-known LCS, called Accuracy Based System or XCS, was recently developed able map linear function. This new extension, XCSF, more compact population than original XCS. some further researches have shown that this is not proper when input parameters from certain intervals. As solution issue, in our previous works, we proposed novel inspired by idea using evolutionary approach approximate landscape. The results seem promising, but approach, XCSFG, converged goal very slowly. paper, XCSFG employs micro-GA its needed extremely smaller simple GA. expect help converge faster. Reported show assumed as alternative XCSF family with respect convergence speed, approximation accuracy compactness.

参考文章(21)
Stewart W. Wilson, Classifier Systems for Continuous Payoff Environments Genetic and Evolutionary Computation – GECCO 2004. pp. 824- 835 ,(2004) , 10.1007/978-3-540-24855-2_96
Gregorio Toscano Pulido, Carlos A. Coello Coello, The Micro Genetic Algorithm 2: Towards Online Adaptation in Evolutionary Multiobjective Optimization Lecture Notes in Computer Science. pp. 252- 266 ,(2003) , 10.1007/3-540-36970-8_18
P.L. Lanzi, D. Loiacono, S.W. Wilson, D.E. Goldberg, XCS with computed prediction for the learning of Boolean functions congress on evolutionary computation. ,vol. 1, pp. 588- 595 ,(2005) , 10.1109/CEC.2005.1554736
Damien Ernst, Arthur Louette, Introduction to Reinforcement Learning MIT Press. ,(1998)
B. WIDROW, M. E. HOFF, Adaptive switching circuits Neurocomputing: foundations of research. pp. 123- 134 ,(1988) , 10.21236/AD0241531
Carlos A. Coello Coello Coello, Gregorio Toscano Pulido, A Micro-Genetic Algorithm for Multiobjective Optimization international conference on evolutionary multi criterion optimization. pp. 126- 140 ,(2001) , 10.1007/3-540-44719-9_9
Stewart W. Wilson, Classifiers that approximate functions Natural Computing. ,vol. 1, pp. 211- 234 ,(2002) , 10.1023/A:1016535925043
David E. Goldberg, Sizing Populations for Serial and Parallel Genetic Algorithms international conference on genetic algorithms. pp. 70- 79 ,(1989)
Stewart W. Wilson, Classifier fitness based on accuracy Evolutionary Computation. ,vol. 3, pp. 149- 175 ,(1995) , 10.1162/EVCO.1995.3.2.149
Pier Luca Lanzi, Daniele Loiacono, Stewart W. Wilson, David E. Goldberg, Generalization in the XCSF Classifier System: Analysis, Improvement, and Extension Evolutionary Computation. ,vol. 15, pp. 133- 168 ,(2007) , 10.1162/EVCO.2007.15.2.133