Model-based Policy Iteration Algorithm for Deterministic Cleaning Robot

An Example for Reinforcement Learning using Model-based Policy iteration Approach


Updated Mon, 17 Mar 2014 21:34:48 +0000

View License

Model-based policy iteration Algorithm for Deterministic Cleaning Robot. This code is a very simple implementation of a policy iteration algorithm, which makes it a useful start point for beginners in the field of Reinforcement learning and dynamic programming.
The deterministic cleaning-robot MDP: a cleaning robot has to collect a used can also has to recharge its batteries. the state describes the position of the robot and the action describes the direction of motion. The robot can move to the left or to the right. The first (1) and the final (6) states are the terminal states. The goal is to find an optimal policy that maximizes the return from any initial state. Here the policy-iteration (model-based policy iteration DP). Reference: Algorithm 2-5, from:
title={Reinforcement learning and dynamic programming using function approximators},
author={Busoniu, Lucian and Babuska, Robert and De Schutter, Bart and Ernst, Damien},
publisher={CRC Press}

Cite As

Reza Ahmadzadeh (2023). Model-based Policy Iteration Algorithm for Deterministic Cleaning Robot (, MATLAB Central File Exchange. Retrieved .

MATLAB Release Compatibility
Created with R2010a
Compatible with any release
Platform Compatibility
Windows macOS Linux
Find more on Sequence and Numeric Feature Data Workflows in Help Center and MATLAB Answers

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!
Version Published Release Notes