Coevolutionary Learning of Neuromodulated Controllers for Multi-Stage and Gamified Tasks

Chloe M. Barnes, Anikó Ekárt, Kai Olav Ellefsen, Kyrre Glette, Peter R. Lewis, Jim Tørresen: Coevolutionary Learning of Neuromodulated Controllers for Multi-Stage and Gamified Tasks. In: Proceedings of the IEEE 1st International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS), pp. 129–138, IEEE, 2020.

Abstract

Neural networks have been widely used in agent learning architectures; however, learning multiple context dependent tasks simultaneously or sequentially is problematic when using them. Behavioural plasticity enables humans and animals alike to respond to changes in context and environmental stimuli, without degrading learnt knowledge; this can be achieved by regulating behaviour with neuromodulation - a biological process found in the brain. We demonstrate that modulating activity-propagating signals when evolving neural networks enables agents to learn context-dependent and multi-stage tasks more easily. Further, we show that this benefit is preserved when agents occupy an environment shared with other neuromodulated agents. Additionally we show that neuromodulation helps agents that have evolved alone to adapt to changes in environmental stimuli when they continue to evolve in a shared environment.


BibTeX (Download)

@inproceedings{Barnes2020CoevolutionaryTasks,
title = {Coevolutionary Learning of Neuromodulated Controllers for Multi-Stage and Gamified Tasks},
author = {Chloe M. Barnes and Anikó Ekárt and Kai Olav Ellefsen and Kyrre Glette and Peter R. Lewis and Jim Tørresen},
url = {https://ieeexplore.ieee.org/document/9196458},
doi = {10.1109/ACSOS49614.2020.00034},
year  = {2020},
date = {2020-08-17},
urldate = {2020-01-01},
booktitle = {Proceedings of the IEEE 1st International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS)},
pages = {129--138},
publisher = {IEEE},
abstract = {Neural networks have been widely used in agent learning architectures; however, learning multiple context dependent tasks simultaneously or sequentially is problematic when using them. Behavioural plasticity enables humans and animals alike to respond to changes in context and environmental stimuli, without degrading learnt knowledge; this can be achieved by regulating behaviour with neuromodulation - a biological process found in the brain. We demonstrate that modulating activity-propagating signals when evolving neural networks enables agents to learn context-dependent and multi-stage tasks more easily. Further, we show that this benefit is preserved when agents occupy an environment shared with other neuromodulated agents. Additionally we show that neuromodulation helps agents that have evolved alone to adapt to changes in environmental stimuli when they continue to evolve in a shared environment.},
keywords = {Agent-Based Systems, ANNs, Artificial Life, Behavioural Plasticity, Evolutionary Algorithms, Neuroevolution, Neuromodulation, River Crossing},
pubstate = {published},
tppubtype = {inproceedings}
}