Back to list

Q-Learning algorithm for Particle Swarm Optimization

Details

Multi-agent optimization using NetLogo environment

Our developers have implemented the code for simulation of the multi-agent optimization process in the NetLogo environment.

Algorithm is an enhanced version of the particle swarm optimization method where in addition to selection of the appropriate movement velocity in the problem search space, each agent also learns an optimal strategy for internal parameter selection based on his current position.

These parameters include maximum and minimum velocity values, the size of the neighborhood taken into account, trade-off between the effect of global optimum found so far and optimum value in the neighborhood etc.

The algorithm was implemented based on the description in the paper “Intelligent Particle Swarm Optimization Using Q-Learning” by M. Khajenejad, F. Afshinmanesh, A. Mar and B. Araabi. For all the required parameters, the corresponding graphical interface controls was prepared. Code was commented and documented.

dca1178c2347b7a406c134c343a53994587a0bfb.jpg
e01990ee1b2fb8b92e08c92e748986fbf0a40a5a.jpg
6629ad6dbb45445f7d2874bbdd82ba954ed3cc44.jpg
614d6a4b2439314bd1fde1e661b6c56d7f5b25a5.jpg