Hello everyone, I want to use the RL toolbox in my work. In my custom environment, it has several observations that are in rlNumericSpec, and others are in rlFiniteSetSpec.
I understand that in order to create an ObservationInfo, I can use:
Observation(1) = rlNumericSpec([4 1]);
Observation(2) = rlFiniteSetSpec([1 2 3]);
However, in my custom reset (as well as step) function, how should I return the observation, so that the system can recognized it?