When I call dask.array.from array() on a large numpy.memmap , Dask seems to touch the whole mapped file…
When I call dask.array.from array() on a large numpy.memmap , Dask seems to touch the whole mapped file…: a task in MiMo-V2.6-RL-oss: Agentic RL Environments (MiMo RL release). When I call dask.array.from array() on a large numpy.memmap, Dask seems to touch the whole mapped file while just…
The task
When I call dask.array.from_array() on a large numpy.memmap, Dask seems to touch the whole mapped file while just building the graph, and on big files it can blow up memory before any computation starts. Could this avoid reading the memmap contents during tokenization and just…
Part of XiaomiMiMo/MiMo-V2.6-RL-oss.