Solver Documentation
Documentation for the SARSOP.jl
user interface.
Contents
Index
SARSOP.POMDPFile
SARSOP.PolicyGraphGenerator
SARSOP.SARSOPEvaluator
SARSOP.SARSOPSimulator
SARSOP.SARSOPSolver
POMDPs.simulate
SARSOP.evaluate
SARSOP.generate_graph
SARSOP.load_policy
SARSOP.to_pomdpx
Solver
SARSOP.SARSOPSolver
— TypeSARSOPSolver
Base solver type for SARSOP. Contains an options dictionary with the following entries:
- 'fast': use fast (but very picky) alternate parser for .pomdp files
- 'randomization': turn on randomization for the sampling algorithm
- 'precision': run ends when target precision is reached
- 'timeout': [sec] If running time exceeds the specified value, pomdpsol writes out a policy and terminates
- 'memory': [MB] If memory usage exceeds the specified value, pomdpsol writes out a policy and terminates
- 'trial-improvement-factor': terminates when the gap between bounds reaches this value
- 'policy-interval': the time interval between two consecutive write-out of policy files
verbose
: [true/false] whether to print output from the solver. Default: true
File manipulation
SARSOP.POMDPFile
— TypePOMDPFile
Writes a pomdpx file from a pomdp defined using the explicit interface of POMDPs.jl
Constructors
POMDPFile(filename)
just stores the file name if the file existsPOMDPFile(pomdp::POMDP, filename="model.pomdpx"; verbose=true)
writes a .pomdpx file from the pomdp definition
SARSOP.to_pomdpx
— Functionto_pomdpx(pomdp::POMDPFile)
Convert a .pomdp file to a .pomdpx file.
SARSOP.load_policy
— Functionload_policy(pomdp::POMDP, file_name::AbstractString)
Load a policy from an xml file output by SARSOP.
Simulation and Evaluation
SARSOP.SARSOPSimulator
— TypeSARSOPSimulator
simulate a sarsop policy from the xml files
sim_len
number of steps to use in simulation (default 10)sim_num
number of simulationsfast
use fast (but very picky) alternate parser for .pomdp filessrand
set the random seed for the simulationoutput_file
where to write the resultspolicy_filename
policy file locationpomdp_filename
pomdpx file location
POMDPs.simulate
— FunctionPOMDPs.simulate(sim::SARSOPSimulator)
Simulate a SARSOP policy according to the config specified by sim::SARSOPSimulator
SARSOP.SARSOPEvaluator
— TypeSARSOPEvaluator
simulate a sarsop policy from the xml files
sim_len
number of steps to use in simulation (default 10)sim_num
number of simulationsfast
use fast (but very picky) alternate parser for .pomdp filessrand
set the random seed for the simulationmemory
[MB] No memory limit by default. If memory usage exceeds the specified value, the evaluator will switch back
to a more conservative (and slow) methods.
output_file
where to write the resultspolicy_filename
policy file locationpomdp_filename
pomdpx file location
SARSOP.evaluate
— Functionevaluate(ev::SARSOPEvaluator)
simulate a SARSOP policy according to the configuration specified by ev::SARSOPEvaluator
Policy Graph Generation
SARSOP.PolicyGraphGenerator
— TypePolicyGraphGenerator
fast = false
use fast (but very picky) alternate parser for .pomdp filesgraph_max_depth
maximum horizon of the generated policy graph. There is no limit by default.graph_max_branch
maximum number of branches of the generated policy graph. Shown will be top in probability. There is no limit by default.graph_min_prob
minimum probability threshold for a branch to be shown in the policy graph defaults to zerograph_filename
output name for the DOT file to be generatedpomdp_filename
pomdp file inputpolicy_filename
policy file input
SARSOP.generate_graph
— Functiongenerate_graph(graphgen::PolicyGraphGenerator)
Generate a policy graph, see PolicyGraphGenerator to see the available options.