Sending episode number to simulink during training

10 views (last 30 days)
Hello every one,
I am using reinforcement learning with two agents and I am going to laod the number of episode from workspace in simulink by "from workspace block". I tried trainingStats.EpisodeIndex(1) but I recieved error. As trainingStats would appear after terminating episode 1, I dont have any idea to find the episode number in simulink.
I would appreciate any help.
Ehsan Hosseini
Ehsan Hosseini on 24 Jan 2023
Thanks at first.
For my reinforcement learning agent, I need to build a special reward for my reinforcement learning agent that starts giving a penalty after episode 100th. For that, I need to read the number of episode in Simulink and if it is below the 100th episode, then the reward is set to zero, and after the 100th episode, It starts getting a penalty.
I have to agents and for example after 4 episods in the Workspace I have this index in the below Fig.

Sign in to comment.

Accepted Answer

Emmanouil Tzorakoleftherakis
Edited: Emmanouil Tzorakoleftherakis on 24 Jan 2023
The training stats are not available until after training is done, so you cannot use trainingStats.EpisodeIndex during training. The easiest way to accomplish what you want is by using the reset function. Take a look at this example.
The reset function is called before every episode, so you can use it to create a counter for the episode number and assign it either to a workspace variable, or directly to e.g. a Constant block in Simulink.
Hope that helps

Sign in to comment.

More Answers (1)

Fangjun Jiang
Fangjun Jiang on 24 Jan 2023
Try the Constant block and specify the value as trainingStats.EpisodeIndex(1). Read the document of the "From Workspace" block to see if it is what you needed.
  1 Comment
Ehsan Hosseini
Ehsan Hosseini on 24 Jan 2023
Thanks for your help. I received the following error:
Error evaluating parameter 'Value' in 'PV/Control_rll/Constant34'
Error using rl.env.SimulinkEnvWithAgent>localHandleSimoutErrors (line 668)
Unable to resolve the name trainingStats.EpisodeIndex.

Sign in to comment.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!