bug: SitemapRequestList.persistState() throws when sitemap loading has finished
bug: SitemapRequestList.persistState() throws when sitemap loading has finished: a task in MiMo-V2.6-RL-harbor-code: MiMo-V2.6-RL Code (Harbor) (Harbor dataset). This is because after parsing the sitemaps fully, the SitemapRequestList closes the internal stream with .push(null)…
The task
This is because after parsing the sitemaps fully, the `SitemapRequestList` [closes the internal stream with `.push(null)`](https://github.com/apify/crawlee/blob/f3eb99d9fa9a7aa0ec1dcb9773e666a9ac14fb76/packages/core/src/storages/sitemap_request_list.ts#L364).
Part of FineEnvs/MiMo-V2.6-RL-harbor-code.