HF RL Explorer

Feature request: support Kafka static membership to avoid rebalances on worker restart

Feature request: support Kafka static membership to avoid rebalances on worker restart: a task in MiMo-V2.6-RL-harbor-code: MiMo-V2.6-RL Code (Harbor) (Harbor dataset). We run a Faust app with several worker instances in the same consumer group. Whenever we do a rolling deploy (or any single…

The task

We run a Faust app with several worker instances in the same consumer group. Whenever we do a rolling deploy (or any single instance restarts briefly), the whole group goes through a rebalance — every other worker pauses processing while partitions get reshuffled, and then most of them get the same partitions back…

Part of FineEnvs/MiMo-V2.6-RL-harbor-code.