“School of Cognitive Sciences”
Back to Papers HomeBack to Papers of School of Cognitive Sciences
| Paper IPM / Cognitive Sciences / 13831 |
|
||||||
| Abstract: | |||||||
|
This paper discusses the notion of context transfer in reinforcement learning tasks. Context transfer, as defined in this paper, implies knowledge transfer between source and target tasks that share the same environment dynamics and reward function but have different states or action spaces. In other words, the agents learn the same task while using different sensors and actuators. This requires the existence of an underlying common Markov decision process (MDP) to which all the agentsâ MDPs can be mapped. This is formulated in terms of the notion ofMDP homomorphism.The learning framework isð-learning. To transfer the knowledge between these tasks, the feature space is used as a translator and is expressed as a partialmapping between the state-action spaces of different tasks.Theð-values learned during the learning process of the source tasks are mapped to the sets ofð-values for the target task.These transferred ð-values are merged together and used to initialize the learning process of the target task. An interval-based approach is used to represent and merge the knowledge of the source tasks. Empirical results show that the transferred initialization can be beneficial to the learning process of the target task.
Download TeX format |
|||||||
| back to top | |||||||
