Predictive State Representations

I will keep on this page some PSR-related links of interest. Feel free to email me if you have any to add. All links to papers are to the PDF version unless otherwise noted.

Introduction & Theory

• http://www.eecs.umich.edu/~baveja/PSRmainpage.html
  An outline of PSRs and the issues related to them. By Satinder Singh.
• http://www.eecs.umich.edu/~baveja/
  Satinder Singh's homepage

• Papers

  • Predictive Representations of State
    by Michael Littman, Richard Sutton and Satinder Singh. In Advances in Neural Information Processing Systems 14 (NIPS), pages 1555-1561, 2002.
  • Predictive State Representations: A New Theory for Modeling Dynamical Systems
    by Satinder Singh, Michael R. James and Matthew R. Rudary. In Uncertainty in Artificial Intelligence: Proceedings of the Twentieth Conference (UAI), pages 512-519, 2004.

Learning & Discovery

• http://www.cs.mcgill.ca/~aghiza/projects/nserc2004/
  Discovery of Core Tests in Predictive State Representations - Adrian Ghizaru's NSERC USRA project from Summer 2004

• Papers

  • Learning Predictive State Representations (ps.gz)
    by Satinder Singh, Michael Littman, Nicholas Jong, David Pardoe and Peter Stone. In Proceedings of the Twentieth International Conference on Machine Learning (ICML), pages 712-719, 2003.
  • Learning and Discovery of Predictive State Representations in Dynamical Systems with Reset
    by Michael James and Satinder Singh. In Proceedings of the Twenty-First International Conference on Machine Learning (ICML), pages 417-424, 2004.
  • Learning Low Dimensional Predictive Representations
    by Matthew Rosencrantz, Geoff Gordon, and Sebastian Thrun. In Proceedings of the Twenty-First International Conference on Machine Learning (ICML), 2004.
  • Schema Learning: Experience-Based Construction of Predictive Action Models
    by M. Holmes and C. Isbell. Accepted to Advances in Neural Information Processing Systems 17 (NIPS), 2005.
  • Using Predictive Representations to Improve Generalization in Reinforcement Learning
    by Eddie Rafols, Mark Ring, Richard Sutton, Brian Tanner. Accepted to the Nineteenth International Joint Conference on Artificial Intelligence (IJCAI), 2005.
  • Temporal-Difference Networks
    by Sutton, R. S., Tanner, B. Accepted to Advances in Neural Information Processing Systems 17 (NIPS), 2005.
  • Combining Memory and Landmarks with Predictive State Representations
    by Michael R. James, Britton Wolfe, and Satinder Singh. To appear in Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), 2005.

Nonlinear PSRs

• Papers

  • A Nonlinear Predictive State Representation
    by Matthew Rudary and Satinder Singh. In Advances in Neural Information Processing Systems 16 (NIPS), pages 855-862, 2004.

Planning

• Papers

  • Planning with Predictive State Representations
    by Michael R. James, Satinder Singh, and Michael Littman. In Proceedings of the International Conference on Machine Learning and Applications (ICMLA) pages 304-311, 2004.
  • Planning in Models that Combine Memory with Predictive Representations of State
    by Michael R. James and Satinder Singh. To appear in Proceedings of the Twentieth National Conference on Artificial Intelligence (AAAI), 2005.

Back to Chris Hundt's web site