Groupe d’études et de recherche en analyse des décisions

Quasi-hyperbolic discounting in Markov decision processes

Anna Jaśkiewicz Wrocław University of Science and Technology, Pologne

Anna Jaśkiewicz

Lien pour le webinaire
Nº du webinaire : 962 7774 9870
Code secret : 285404

The Markov decision processes under quasi-hyperbolic discounting are studied. This type of discounting nicely models human behaviour, which is time-inconsistent in the long run. The decision maker has preferences changing in time. Therefore, the standard approach based on the Bellman optimality principle fails. Within a dynamic game-theoretic framework, the existence of randomised stationary Markov perfect equilibria for a large class of Markov decision processes with transitions having a density function is proved. Moreover, under some additional conditions, this equilibrium can be replaced by a deterministic one. During the talk many examples will be discussed to illustrate our results, including a portfolio selection model with quasi-hyperbolic discounting.