Back to activities
ISS Informal Systems Seminar

Reinforcement Learning for Non-Markovian Environments


Jan 13, 2023   11:30 AM — 12:30 PM

Vivek Borkar Department of Electrical Engineering, Indian Institute of Technology Bombay, India

Vivek Borkar

Presentation on YouTube

This talk will discuss some of what I feel to be key issues in dealing with reinforcement learning in non-Markovian environments, drawing parallels with some classical ideas in stochastic control. This will be used to motivate a particular objective, viz., approximation of certain conditional laws, which is very much in the tradition of control of POMDPs using belief states.

Biography: Vivek Borkar is currently an emeritus faculty at the Indian Institute of Technology Bombay, Mumbai. He studied electrical engineering at IIT Bombay and subsequently did his M.S. and Ph.D. in resp. Case Western Reserve Uni. and Uni. of California at Berkeley. His interests are in stochastic control and optimization, covering theory, algorithms and applications.

Peter E. Caines organizer
Aditya Mahajan organizer
Shuang Gao organizer


Online meeting
Montréal Québec

Associated organization

Centre for intelligent machines (CIM)

Research Axes