MATLAB Answers

Is there any existing POMDP library/function in MATLAB?

29 views (last 30 days)
J AI
J AI on 12 Aug 2020
Commented: J AI on 10 Nov 2020
I am looking for an existing Partially Observable MDP (POMDP) library/function that implements a simple POMDP problem using, let's say, Enumeration algorithm. Basically, I have developed my own algorithm for the pruning stage of solving POMDP, and thus need an existing library where I can replace the pruning part with my own pruning algorithm. I have tried writing my own code to do that for a POMDP problem (Tiger-problem) but somehow does not match the results that I found using existing POMDP structures in Julia and R. I have attached the codes I have written (I haven't attached my pruning algorithm though for obvious reasons).
Any help will be highly appreciated. Thanks in advance!
FYI: My pruning algorithm works perfectly because I have verified the algorithm using random alpha vectors.

Accepted Answer

Paul Fackler
Paul Fackler on 3 Nov 2020
My Matlab based toolbox MDPSolve has several POMDP solvers. pomdp solves using discretization of the belief states, pomdpsolve uses an alpha vector approach.
https://sites.google.com/site/mdpsolve/

More Answers (0)

Products


Release

R2020a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!