POMDPTools: the standard library for POMDPs.jl

The POMDPs.jl package does nothing more than define an interface or language for interacting with and solving (PO)MDPs; it does not contain any implementations. In practice, defining and solving POMDPs is made vastly easier if some commonly-used structures are provided. The POMDPTools package contains these implementations. Thus, the relationship between POMDPs.jl and POMDPTools is similar to the relationship between a programming language and its standard library.

The POMDPTools package source code is hosted in the POMDPs.jl github repository in the lib/POMDPTools directory.

The contents of the library are outlined below:

• Implemented Distributions
• • Sparse Categorical (SparseCat)
  • Implicit
  • Bool Distribution
  • Deterministic
  • Uniform
  • Pretty Printing
• Model Tools
• • Interface Extensions
  • Model Transformations
  • Utility Types
• Visualization
• Implemented Belief Updaters
• • Discrete (Bayesian Filter)
  • K Previous Observations
  • Previous Observation
  • Nothing Updater
• Implemented Policies
• • Function
  • Alpha Vector Policy
  • Random Policy
  • Stochastic Policies
  • Vector Policies
  • Value Dict Policy
  • Exploration Policies
  • Playback Policy
  • Utility Wrapper
  • Pretty Printing Policies
• Policy Evaluation
• Implemented Simulators
• • Which Simulator Should I Use?
  • Stepping through
  • Rollouts
  • History Recorder
  • sim()
  • Histories
  • Parallel
  • Display
• CommonRLInterface Integration
• • Environment Wrapper Types
  • Constructors
• Testing
• • Testing (PO)MDP Models
  • Testing Solvers