use lstm: True doesn't work with a custom model on a Dict observation space
use lstm: True doesn't work with a custom model on a Dict observation space: a task in MiMo-V2.6-RL-harbor-code: MiMo-V2.6-RL Code (Harbor) (Harbor dataset). I'm training on a custom env whose observation space is a gym.spaces.Dict (a few named sub-fields). I have a custom model registered via…
The task
I'm training on a custom env whose observation space is a `gym.spaces.Dict` (a few named sub-fields). I have a `custom_model` registered via `ModelCatalog.register_custom_model(...)` that knows how to consume that dict observation and produce a feature vector. I'd like to stack an LSTM on top of it, so my model…
Part of FineEnvs/MiMo-V2.6-RL-harbor-code.