A Julia interface for defining, solving and simulating partially observable Markov decision processes and their fully observable counterparts.

Package Features

  • General interface that can handle problems with discrete and continuous state/action/observation spaces
  • A number of popular state-of-the-art solvers available to use out of the box
  • Tools that make it easy to define problems and simulate solutions
  • Simple integration of custom solvers into the existing interface

Available Packages

The POMDPs.jl package contains the interface used for expressing and solving Markov decision processes (MDPs) and partially observable Markov decision processes (POMDPs) in the Julia programming language. The JuliaPOMDP community maintains these packages. The packages currently maintained by JuliaPOMDP are as follows:

MDP solvers:

POMDP solvers:

Support Tools:

Manual Outline