Generating adaptive behaviour within a memory-prediction framework |
| |
Authors: | Rawlinson David Kowadlo Gideon |
| |
Institution: | Department of Electrical and Electronic Engineering, National ICT Australia, University of Melbourne, Victoria, Australia. david.rawlinson@nicta.com.au |
| |
Abstract: | The Memory-Prediction Framework (MPF) and its Hierarchical-Temporal Memory implementation (HTM) have been widely applied to unsupervised learning problems, for both classification and prediction. To date, there has been no attempt to incorporate MPF/HTM in reinforcement learning or other adaptive systems; that is, to use knowledge embodied within the hierarchy to control a system, or to generate behaviour for an agent. This problem is interesting because the human neocortex is believed to play a vital role in the generation of behaviour, and the MPF is a model of the human neocortex.We propose some simple and biologically-plausible enhancements to the Memory-Prediction Framework. These cause it to explore and interact with an external world, while trying to maximize a continuous, time-varying reward function. All behaviour is generated and controlled within the MPF hierarchy. The hierarchy develops from a random initial configuration by interaction with the world and reinforcement learning only. Among other demonstrations, we show that a 2-node hierarchy can learn to successfully play "rocks, paper, scissors" against a predictable opponent. |
| |
Keywords: | |
本文献已被 PubMed 等数据库收录! |
|