“Bulletin Board”

 School of Mathematics - October 31, 2014

BioMath Lecture

Collecting Reward to Defend Homeostasis: A Homeostatic Reinforcement Learning Theory
Mahdi Keramati
UCL Gatsby Unit
September 25, 2014



Efficient regulation of internal homeostasis and defending it against perturbations requires adaptive behavioral strategies. However, the computational principles mediating the interaction between homeostatic and associative learning processes remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning motivated behaviors may be modulated by internal states. Our theory mathematically proves that seeking rewards is equivalent to the fundamental objective of physiological stability, defining the notion of physiological rationality of behavior. We further suggest a formal basis for temporal discounting of rewards by showing that discounting motivates animals to follow the shortest path in the space of physiological variables toward the desired setpoint. We also explain how animals learn to act predictively to preclude prospective homeostatic challenges, and several other behavioral patterns. Finally, we suggest a computational role for the interaction between the hypothalamus and the brain reward system.


Date and Time: Thursday, September 25, 2014 at 13:30-16:30
Place: Niavaran Bldg., Niavaran Square, Tehran, Iran
back to top
scroll left or right