Job logs stop being written after a single write failure
Job logs stop being written after a single write failure: a task in MiMo-V2.6-RL-harbor-code: MiMo-V2.6-RL Code (Harbor) (Harbor dataset). I'm running jobs through mist and reading their logs via the async log streaming. For most jobs this works fine, but every once in a while I notice that a…
The task
I'm running jobs through mist and reading their logs via the async log streaming. For most jobs this works fine, but every once in a while I notice that a job's log file just stops growing partway through the job — even though the job itself keeps running and producing output. When I look later, the tail of the log…
Part of FineEnvs/MiMo-V2.6-RL-harbor-code.