Back to activities
Fondation HEC Montréal seminar

Truncation and smoothing approximations for Markov Decision Processes with unbounded rates


Oct 4, 2017   11:00 AM — 12:00 PM

Alain Jean-Marie Centre de Recherche de Sophia-Antipolis Méditerranée, INRIA, France

The analysis of Markov Decision Processes (MDPs) often involves the proof that a threshold policy is optimal. The "structured value iteration" technique, described in e.g. the book of Puterman, allows to do this. When continuous-time MDPs have unbounded transition rates, they cannot be uniformized and this technique cannot be applied anymore. In this talk, we explain how recent results from Guo and Hernández-Lerma, and Blok and Spieksma, allow to handle this situation. As an illustration, we apply their truncation and smoothing technique to the optimal control of a single-server queueing system.

Free entrance.
Welcome to everyone!

Georges Zaccour organizer


Room 4488
André-Aisenstadt Building
Université de Montréal Campus
2920, chemin de la Tour Montréal QC H3T 1J4 Canada

Associated organizations

Research Axis