QuickPOMDPs.jl

QuickPOMDPs is a package that makes defining Markov decision processes (MDPs) and partially observable Markov decision processes easy.

The models defined with QuickPOMDPs are compatible with POMDPs.jl and can be used with any solvers from that ecosystem that are appropriate for the problem.

Defining a model with QuickPOMDPs does not require any object-oriented programming, so this package may be easier for some users (e.g. those coming from MATLAB) to pick up than POMDPs.jl itself.

QuickPOMDPs contains two interfaces:

1. The Discrete Explicit Interface, is suitable for problems with small discrete state, action, and observation spaces. This interface is pedagogically useful because each element of the $(S, A, O, R, T, Z, \gamma)$ tuple for a POMDP and $(S, A, R, T, \gamma)$ tuple for an MDP is defined explicitly in a straightforward manner. See the Discrete Explicit Interface page for more details.
2. The Quick Interface is much more flexible, exposing nearly all of the features of POMDPs.jl as constructor keyword arguments. See the Quick Interface page for more details.

See the Solver tutorials in the POMDPExamples package for examples of how to solve and simulate problems defined with QuickPOMDPs.

Contents

• Discrete Explicit Interface
• • Example
  • Constructor Documentation
  • Usage from Python
• Quick Interface
• • Example
  • Keyword arguments
  • IDs and defining methods
  • State, action, and observation type inference
  • Visualization