MATLAB Answers

invalid input argument during training of custom rl-environment

2 views (last 30 days)
Dolores Garcia
Dolores Garcia on 14 Oct 2020
I have a working custom rl-environment but after training for many episodes, it outputs this error message:
Invalid input argument type or size such as observation, reward, isdone or loggedSignals
Since it happens during training and the function that outputs the error doesn't have any information about those variables I can't find the bug.
I also try to then take that example and use:
InitialObs = reset(env)
[NextObs,Reward,IsDone,LoggedSignals] = step(env,index);
to regenerate the error with the steps and actions the agent chose but then it doesn't happen, any ideas of why this may be happening?
When I check all vectors they have the correct sizes and it trains without a problem for a while.

  0 Comments

Sign in to comment.

Answers (1)

Emmanouil Tzorakoleftherakis
It seems this is a problem with how you step function populates the states and outputs, or maybe you need to transpose somewhere to get rid of that error. It's hard to be more precise without a reproduction model.
I would suggest either adding a break point right before the line that causes the error, or printing the values to see if you can identify the cause of the error.

  0 Comments

Sign in to comment.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!