I'm seeing weird samples when I train DQN/DDPG with batched environments and replay: n-step sequences and…

I'm seeing weird samples when I train DQN/DDPG with batched environments and replay: n-step sequences and…: a task in MiMo-V2.6-RL-harbor-code: MiMo-V2.6-RL Code (Harbor) (Harbor dataset). The exact internal data structures, storage layout, and validation locations are up to the implementation…

The task

The exact internal data structures, storage layout, and validation locations are up to the implementation. Preserve existing single-environment behavior by treating omitted environment identity as the default environment.

Part of FineEnvs/MiMo-V2.6-RL-harbor-code.