HF RL Explorer

I want a stateful EosDetector C++ helper for streaming chat generation stop detection.

I want a stateful EosDetector C++ helper for streaming chat generation stop detection.: a task in MiMo-V2.6-RL-harbor-code: MiMo-V2.6-RL Code (Harbor) (Harbor dataset). For a detector created with token ids {10000, 10001} , stop pieces { "<eos ", "<stop " } , and padding 1, 1 , appending pieces…

The task

For a detector created with token ids `{10000, 10001}`, stop pieces `{ "<eos>", "<stop>" }`, and padding `1, 1`, appending pieces `"<"`, `"eo"`, and `"s>"` should return `MAYBE_EOS`, `MAYBE_EOS`, then `EOS`, and `getDelta()` should return null so the stop marker is not shown to the user. After `reset()`, appending…

Part of FineEnvs/MiMo-V2.6-RL-harbor-code.