On Solving Large Markov Decision Processes:
  • Performance Bounds for Lambda Policy Iteration and Application to the Game of Tetris. To appear. pdf hal
  • Classification-based Policy Iteration with a Critic. With Victor Gabillon, Alessandro Lazaric and Mohammad Ghavamzadeh. ICML 2011. pdf hal
  • Should one compute the Temporal Difference fix point or minimize the Bellman Residual? The unified oblique projection view. ICML 2010. pdf hal slides
  • Least-Squares Lambda Policy Iteration: Bias-Variance Trade-off in Control Problems. With Christophe Thiéry. ICML 2010. pdf hal slides
  • Performance bound for Approximate Optimistic Policy Iteration With Christophe Thiéry. INRIA Tech report. pdf hal
  • Biasing Approximate Dynamic Programming with a Lower Discount Factor. With Marek Petrik. NIPS 2008. pdf hal

    On the Tetris Application:
  • Building Controllers for Tetris. With Christophe Thiéry. International Computer Games Association Journal 32 (2009) 3-11. pdf hal
  • Improvements on Learning Tetris with Cross Entropy. With Christophe Thiéry. International Computer Games Association Journal 32 (2009). pdf hal
  • Construction d'un joueur artificiel pour Tetris. With Christophe Thiéry. Revue d'Intelligence Artificielle 23, 2-3 (2009) 387-407. pdf hal
  • La carotte et le bâton... et Tetris. With Alain Dutech and Christophe Thiéry. Interstices (2008). html

    Miscellaneous:
  • Block-synchronous harmonic control for scalable trajectory planning. With Bernard Girau, Amine Boumaza and Cesar-Torres Huitzil. Robotics, Automation and Control I-Tech Publications (2008). pdf hal
  • Convergence and rate of convergence of simple ant models. With Amine Boumaza. INRIA Tech Report (2007). pdf hal
  • Optimal control subsumes harmonic control. With Amine Boumaza. INRIA Tech Report (2006). pdf hal slides
  • Asynchronous Neurocomputing for optimal control and reinforcement learning with large state spaces. Neurocomputing 23 (2005). pdf hal


    Contact Information

    E-mail : Firstname.Name@inria.fr, Phone: +33 (0)3 54 95 85 03, Fax: +33 (0)3 83 59 30 79, Office : C 022
    Mailbox 1: Maia, INRIA Lorraine, 615 rue du Jardin Botanique, 54600 Villers-les-Nancy, FRANCE.
    Mailbox 2: Maia, LORIA, Campus Scientifique BP 239, 54506 Vandoeuvre-lès-Nancy CEDEX, FRANCE.