What is in a reinforcement learning saved agent .mat file

4 views (last 30 days)
I am working with reinforcement learning in Simulink and MATLAB to perform continuous feedback control of a dynamic system. The saved agent files are very large after training on my model, and I was wondering what information is actually being saved in this file. Is there a way of looking at what is actually saved in the saved agent .mat file after training?

Answers (1)

Emmanouil Tzorakoleftherakis
Edited: Emmanouil Tzorakoleftherakis on 28 May 2021
Why don't you load the file and check? When you saved the agen tin the .mat file, did you save anything else with it? Are you maybe saving a large experience buffer with the agent?
Another thing to consider is that along with the agent, some training data is also saved to be able to recreate training results post training. This additional data also contains any logged signals from Simulink/Simscape. I would recommend turning off signal logging and checking the size of the mat file again.
  4 Comments
Michael Ciriacy
Michael Ciriacy on 3 Jun 2021
Edited: Michael Ciriacy on 3 Jun 2021
After shutting off the signal logging in the Simulink model the size of the agent is still increasing about 16,000 KB per episode. This did help but is there anything else that could help decrease the size of the saved agent files? I would also like to know what else is being saved in the agent file at the end of the episode if that is possible. I am working with a model that could take a large amount of episodes so I would like to keep the saved agent as small as possible for a large number of episodes.

Sign in to comment.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!