Support OCI "modelcar" sidecars for model loading
Support OCI "modelcar" sidecars for model loading: a task in MiMo-V2.6-RL-harbor-code: MiMo-V2.6-RL Code (Harbor) (Harbor dataset). Today, when an InferenceService pod is admitted, model data is provisioned by an init container that copies the model from the configured storageUri into a shared…
The task
Today, when an `InferenceService` pod is admitted, model data is provisioned by an init container that copies the model from the configured `storageUri` into a shared volume before the serving container starts. For large models this copy dominates the cold-start time, and the data is re-fetched on every pod start.
Part of FineEnvs/MiMo-V2.6-RL-harbor-code.