How to study reinforcement learning (answered by Sergio Valcarcel Macua on Quora)

Link

Https://www.quora.com/What-are-the-best-books-about-reinforcement-learning

The main RL problems is related to:
-Information Representation:from POMDP to predictive state representation to deep-learning to Td-networks
-Inverse rl:how To learn the reward?
-Algorithms
+ Off-policy
+ Large Scale:linear and nonlinear approximations of the value function
+ Policy Search vs. Q-learning based
-Beyond MDP
+ Policy search for Black-box optimization with global performance guarantees

Recommended Papers:

* Algorithms for reinforcement Learning:csaba Szepesvari. Nice compendium of implemented algorithms. 

* Reinforcement learning and Dynamic programming using Function approximators. Busoniu, Lucian; Robert Babuska; Bart De Schutter; Damien Ernst (2010). This was a very practical book that explains some state-of-the-art algorithms (i.e., useful for real world problems) like F Itted-q-iteration and its variations.

* Reinforcement Learning:state-of-the-art. Vol. adaptation, Learning, and optimization. Wiering, M., Van Otterlo, M. (Eds.), 2012. Springer, Berlin. In Sutton's words "This book was a valuable resource for students wanting to
go beyond the older textbooks and for Resea Rchers wanting to easily catch up with
recent developments ".

* Optimal Adaptive Control and differential games by reinforcement learning Principles:draguna Vrabie, Kyriakos G. Va Mvoudakis, Frank L. Lewis. I am not familiar with this one, but I have seen it recommended.

* Markov decision Processes in Artificial Intelligence, Sigaud o. & Buffet O. Editors, ISTE Ld, Wiley and Son S Inc.,

.

There is also several good specialized monographs and surveys on the topic, some of these is:

+ "from Bandits to Monte-carlo Tree search:the optimistic Principle applied to optimization and planning" by Remi Munos ( New trends on machine learning). This monograph covers important Nonconvex optimistic optimization methods the can is applied to policy search.

+ "reinforcement learning in Robotics:a Survey" by J. Kober, J. A. Bagnell and J. Peters.

+ "A Tutorial on Linear Function approximators for Dynamic programming and reinforcement learning" by A. Geramifard, T. J. Walsh, S. Tllex, G. Chowdhary, N. Roy and J. P. How (Foundations and Trends in machine learning).

+ "A Survey on Policy Search for robotic" by Newmann and Peters (Foundations and Trends in machine learning).

How to study reinforcement learning (answered by Sergio Valcarcel Macua on Quora)